.Google's Gary Illyes reveals Googlebot collects web links rather than "complying with" all of them, contradicting formal documents.Googlebot picks up web links instead of following them in real-time.Gary Illyes discussed this relevant information in Google.com's 'Search Off The File' podcast.Google.com's documents contradicts the true crawler actions.