AI Crawlers & JavaScript Rendering

Comprehensive JavaScript Rendering Analysis & Bot Behavior Patterns
The Bot Dilemma – When Bot Protection Becomes Customer Rejection

In 2025, bots account for the majority of global web traffic. The real challenge lies in stopping abuse without disrupting authentic user experiences.
Get more detailed Google Search Console data using the new BigQuery export

Google introduced a game-changing feature for Google Search Console in 2023: the ability to export data directly to BigQuery. When we activated the export feature, we uncovered a wealth of additional URL and keyword data that was previously unavailable in standard Search Console reports. With this BigQuery export feature, you can dig deeper into your […]
The complete website migration SEO checklist for 2023

Based on our experience from a big number of website relaunches, we have compiled this website relaunch SEO checklist with lots of details and a free PDF version.
JavaScript Crawling Study: Rendered vs. Non-Rendered HTML

We crawled over 200 domains, including all URLs linked from their homepages and the homepages themselves, and examined the differences between the rendered and non-rendered HTML on every page. You can find a summary of the results and some detailed examples in this post. At the end of the article, you can also access the […]
Service Worker – What SEOs Need to Know

What are “service workers” and how do they work? A service worker is a Javascript process that runs in the browser background. The service worker runs in the background and acts as a kind of proxy between the website and the Internet and can intercept and manipulate network requests. Service workers have (almost) “only” influence […]
JavaScript-Crawling-Studie: Gerendertes HTML vs. Original-Quelltext
Wir haben über 200 Domains inklusive aller auf der Startseite verlinkten URLs gecrawlt und die Unterschiede zwischen dem gerenderten HTML und dem Original-Quelltext untersucht. Die Ergebnisse und einige Beispiele findet ihr in diesem Beitrag. Unterschiede zwischen den beiden HTML-Versionen können, gerade bei größeren Webseiten, eine Rolle bei der Indexierung spielen und sollten daher bei der […]
Machine learning for SEO – How to predict rankings with machine learning

Learn how we trained a machine learning algorithm to find keywords with high ranking potential by predicting positions after on-page optimisations.
How to make SEO a priority within your website relaunch project

If you are involved in planning a website relaunch in your organisation, this article will help you make SEO a priority in the website relaunch project.