Why SEO Crawlers Get Blamed After Every Migration

The predictable blame pattern: why SEO crawlers get accused after every migration A classic scenario: the migration goes live at 14:00. At 18:00 you start your validation crawl. At 20:00 the site slows down, logs show your crawler, and suddenly you’re the suspected cause. This never happens on stable infrastructure. It happens after big technical […]

Get more detailed Google Search Console data using the new BigQuery export

Google introduced a game-changing feature for Google Search Console in 2023: the ability to export data directly to BigQuery. When we activated the export feature, we uncovered a wealth of additional URL and keyword data that was previously unavailable in standard Search Console reports. With this BigQuery export feature, you can dig deeper into your […]

JavaScript Crawling Study: Rendered vs. Non-Rendered HTML

We crawled over 200 domains, including all URLs linked from their homepages and the homepages themselves, and examined the differences between the rendered and non-rendered HTML on every page. You can find a summary of the results and some detailed examples in this post. At the end of the article, you can also access the […]

The Truth About Service Workers and Google Search

When we tested our Progressive Web App in Google Search Console, we encountered something that puzzled us: our service worker registration was failing with a simple “Rejected” error. No explanation, no details—just rejection. This led us down a research rabbit hole that uncovered a deliberate architectural decision by Google that every PWA developer needs to […]

JavaScript Crawling Study: Rendered HTML vs. Original Source Code

We crawled over 200 domains including all URLs linked from the homepage and examined the differences between the rendered HTML and the original source code. The results and some examples can be found in this article. Differences between the two HTML versions can play a role in indexing, especially for larger websites, and should therefore […]