What Is llms.txt — and Does It Actually Do Anything?
The most argued-about 40 lines in SEO. An honest look at what llms.txt does, what it doesn't, and why it's still worth ten minutes — after the fundamentals.
llms.txt is the most argued-about 40 lines of text in SEO right now. It's a simple markdown file at yourdomain.com/llms.txt that hands AI systems a curated map of your site — what you do, which pages matter, where the good stuff is. Proponents call it "robots.txt for the AI era." Skeptics call it a cargo cult. Here's the honest picture, because we'd rather you trust us than hype.
What it is, exactly
A plain-text/markdown file listing your site's purpose and key pages with short descriptions. The idea, proposed in late 2024, is that AI models have small context windows and messy HTML is expensive to parse — so give them a clean, prioritized index instead. It takes about ten minutes to create and carries zero risk. Ours lives at localwebadvisor.com/llms.txt.
The uncomfortable truth about adoption
A 2026 study of 300,000 domains found adoption sitting around 10% — after eighteen months of industry noise. More damning: server-log analyses covering hundreds of millions of AI bot visits found the major crawlers — GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot — almost never request the file. Google has said outright it doesn't use llms.txt and doesn't plan to. No major AI provider has publicly committed to honoring it in production search.
So does it work as a magic AI-visibility switch? No. Anyone selling llms.txt as guaranteed AI rankings is selling snake oil.
So why have one at all?
Three real reasons.
1. The cost-benefit is absurdly lopsided. Ten minutes, no downside, and if any major platform starts honoring it — which several are quietly experimenting with — early adopters inherit the advantage. It's a cheap lottery ticket on a plausible future.
2. AI coding and agent tools DO read it. Developer-facing companies like Stripe, Vercel, Cloudflare, and Anthropic ship llms.txt because AI assistants that build things (and increasingly, agents that browse and act for users) use it as a routing layer. As agentic browsing grows, a machine-readable site summary stops being decorative.
3. It forces clarity. Writing one makes you decide, in plain sentences, what your business does and which ten pages prove it. Most local business websites fail that exercise — and fixing it improves the pages themselves, which is what AI systems actually read today.
What actually moves AI visibility (today)
The evidence is boring and consistent: AI assistants cite pages that are crawlable, fast, structured, and answer-first. Concretely — allow the AI search crawlers in robots.txt, add LocalBusiness/FAQPage schema, open key pages with a direct answer to a real question, and keep your business facts identical everywhere. llms.txt is the garnish, not the meal. (Full playbook: AI search optimization guide.)
Should your business bother?
Our take: yes — after the fundamentals, never instead of them. If your schema, crawler access, and answer-first content are in place, spend the ten minutes. Our AI Visibility Checker tests for llms.txt alongside the seven signals that matter more, so you can see your whole AI-readiness picture — including whether the file is even your weakest link — before you touch anything.