A Strategic Shift in Google's Search Results
In August 2026, Google began rolling out a major change to how search results are displayed. Instead of providing direct URLs, Google now redirects users via "google.com/goto" links. While still experimental for some users, this change is now widely visible for those browsing in private mode or while logged out.
Why This Change?
Google has always been at the forefront of protecting its search data against abusive scraping. By using "goto" links, Google complicates the task for crawlers and scrapers that collect URLs in bulk to build their own indexes or for SEO analysis. Previously, scrapers could easily extract URLs from search results by simply parsing the HTML. Now, each link requires an additional request to Google to uncover the actual destination.
How Does It Work?
When you click on a search result, Google redirects via a "google.com/goto?url=..." link. This URL parameter uses Google-specific encoding, meaning it cannot be simply decoded offline. The real URL is hidden in the HTTP response header, requiring an additional request to discover it without following the redirect.
Implications for Businesses and Developers
This strategic move has significant implications for businesses that rely on indexing Google search data. For example, SEO tools and platforms that analyze search results to provide insights must now adapt their systems to handle this new layer of complexity.
Companies like Autom have already responded by adjusting their pipelines to accommodate this change. This illustrates the need for industry players to remain agile and ready to adapt their technologies in response to Google's rapid changes.
The Increased Cost of Scraping
In addition to introducing "goto" links, Google has also removed the ability to view 100 results per page (&num=100) and strengthened its protection tools like BotGuard and SearchGuard. These measures make naive SERP scraping more costly and slower, sending a clear signal to companies attempting to bypass these protections.
A Trend to Watch
The shift to "goto" could be a sign of a broader trend where tech giants seek to further tighten control over access to their data. For developers and technical teams, this means staying informed about changes and continuing to innovate to maintain access to critical data.
Conclusion
Ultimately, the removal of direct URLs in Google's search results is another example of how major tech companies are adapting to protect their resources. For businesses, this means continual adaptation and the need for more sophisticated solutions to navigate this ever-evolving environment.
Let's discuss your project in 15 minutes.