llms.txt MonitoringYour llms.txt is online, and searchVIU keeps an eye on it.

searchVIU checks your llms.txt every day and reports changes and dead links. With log file analysis, you also see which AI bots fetch it.

Request a demo
llms.txt day to day

An llms.txt is quick to create and quick to go out of date.

The llms.txt summarizes for language models which content on your website matters. Like any file, it can go missing after a deployment or point to old URLs. Whether an AI service fetches it is only visible in your server logs.

What it looks like

# Example Shop
> Outdoor gear for hiking and camping

## Guides
- [Waterproofing a rain jacket](https://www.example-shop.com/guides/waterproofing/)
- [Pitching a tent](https://www.example-shop.com/guides/pitching-a-tent/)

What searchVIU checks

  • Every daythe /llms.txt and the /llms-full.txt
  • Reachablestatus code and content of the file
  • Unchangedevery new version compared with the old one
  • Valid linksevery linked page responds without errors
  • Blocked linkslinked pages that your robots.txt blocks for AI bots
  • Fetchedfetches per bot, with the log file analysis add-on
File in view

searchVIU reports every change and every dead link.

Every day, searchVIU checks whether your llms.txt and llms-full.txt are reachable and compares every new version with the old one. searchVIU also follows the links in them. If one points to a page that no longer exists or that your robots.txt blocks for AI bots, you get an alert. Like all alerts, it goes out by email, Slack, Teams or webhook.

llms.txtexample-shop.com · change found
## Guides
- [Waterproofing a rain jacket](https://www.example-shop.com/guides/waterproofing/)+ - [Pitching a tent](https://www.example-shop.com/guides/pitching-tent/)
Status 2001 new link leads to a 404 page
Fetches in the logs

The logs show who fetches your llms.txt.

With the log file analysis add-on, searchVIU counts every fetch of your llms.txt, per bot. Fetches of files under .well-known and of MCP endpoints come on top. That way you see whether AI services fetch the file at all.

    More about AI log file analysis
    llms.txt in the logsexample-shop.com · last 7 days
    • GPTBot/llms.txt
      21 fetches
    • ClaudeBot/llms.txt
      12 fetches
    • PerplexityBot/llms.txt
      5 fetches
    Context

    The llms.txt is one building block, and technical SEO remains the foundation.

    AI answers need pages that AI bots are allowed to fetch and can read. searchVIU checks this in the same project as your llms.txt, with robots.txt, crawl and logs.

    Go to AI crawler monitoring
    After the daily check

    The llms.txt is reachable and is being read.

    • ReachableStatus 200
    • All links validno 404 page linked
    • Fetches stableGPTBot and ClaudeBot
    Today · llms.txt unchanged

    Frequently asked questions about llms.txt monitoring

    What is an llms.txt?

    A proposal for a Markdown file in the root directory of your website. It gives language models and AI agents a compact overview of the most important content. It is not an official standard so far.

    Does an llms.txt make any difference?

    That depends on whether AI services fetch it. This is exactly what the logs show you. Whether it affects rankings or mentions in AI answers is an open question.

    What else does searchVIU check for AI agents besides the llms.txt?

    The WebMCP Audit shows whether the forms on your website are described for AI agents. Go to Agent Readiness & WebMCP Audit

    How much does llms.txt monitoring cost?

    Checking the file is part of SEO Monitoring, from €399 per month with 50,000 URLs included. The fetches in the logs are shown by log file analysis, an add-on to SEO Monitoring from €199 per month. You can find all prices on the pricing page. Go to pricing

    Demo

    Let's talk about your website.

    In the demo, Michael shows you how searchVIU works. We use your website and a demo project for this.

    1. Request in three short steps
    2. Quick alignment on crawler access, NDA and Search Console
    3. Demo with your website and the demo project
    4. Start planned and supported together
    1. Website
    2. Needs
    3. Contact

    Which website is it about?