I had one of those conversations on 7 January 2026. The kind where you're explaining something you've spent months researching and implementing, and the other person keeps circling back to the same misconception.
The topic? AI discovery files and why they're different from SEO.
The misconception? That AI visibility works exactly like search engine rankings. That it's all about topical authority, backlinks, and "ranking higher" than competitors.
After we'd gone round in circles, I did what any frustrated person does: asked ChatGPT to settle it. The answer was brilliant. Honestly, it explained what I'd been trying to say far better than I managed in the conversation.
The Misconception
Every time I explained that AI discovery files help AI systems understand your business accurately, the response was "yeah but what about rankings?"
When I mentioned that Google, OpenAI, Anthropic, and Cloudflare are all implementing llms.txt on their own sites, the question was "but everyone knows who they are, why would they need it?"
Classic SEO thinking applied to a different problem. After twenty years of training ourselves to think in terms of rankings, backlinks, and domain authority, that mental model is deeply ingrained. But AI doesn't work that way.
There's no position one, two, three in a ChatGPT answer. There's mentioned or not mentioned. Described accurately or described incorrectly. Recommended with confidence or excluded due to uncertainty. And now that ChatGPT shows ads from the very first prompt, that distinction matters even more.
What ChatGPT Actually Said
I typed this into ChatGPT at 9:56 PM:
"How useful are AI discovery files in getting mentioned on AI like ChatGPT, Claude, Perplexity, or Gemini? How useful is it for a brand that's not particularly well known yet?"
The response started strong: "Short answer? Yes, they help. No, they're not magic. And yes again, they matter more if you're not well known yet."
Then it got interesting:
"AI discovery files don't rank you. They don't 'optimise' content. They don't force ChatGPT to love you. They don't override reality. What they do is far more boring... and far more powerful. They remove uncertainty."
"They remove uncertainty." That's the entire game right there.
ChatGPT went on: "LLMs are cautious beasts. If they're not sure who you are, what you do, where you operate, or whether you're a good fit for a query, they hesitate. And hesitation usually means you don't get mentioned at all."
It's not about having the most backlinks or the highest domain authority. It's about removing the AI's uncertainty about whether it can safely mention you.
Why This Changes Everything
The conversation turned to what happens "when everyone has AI discovery files, just like everyone has a sitemap today." That comparison is more apt than they realised; we've traced the pattern from robots.txt to sitemaps to AI discovery files in detail. But the questioner was asking the wrong question.
Sitemaps help search engines crawl your site. They're infrastructure. Once everyone has them, they become table stakes.
AI discovery files are about accuracy, not access. When everyone has them, AI stops making incorrect guesses about businesses it doesn't understand. That's a win for everyone.
ChatGPT nailed it: "Discovery files won't make you famous. They won't replace marketing. They won't fix a messy site. But they dramatically improve your odds of being understood, and in AI systems, being understood is step one of being mentioned."
Then came the line I've been trying to articulate for months:
"SEO helps you get found. AI discovery files help you get trusted. And trust is what gets you into the answer."
When I read that back, it crystallised something I'd been struggling to put into words. After running a hosting company since 2001, I've watched SEO evolve through every major shift: keyword stuffing to content quality, desktop to mobile-first, links to user signals. Each time the industry had to rewire its thinking. This is another one of those moments, and it might be the biggest yet.
SEO is about visibility. AI discovery files are about credibility. You can rank number one for every keyword in your niche and still get excluded from AI answers because the AI doesn't trust that it understands you correctly.
Real-World Evidence
After launching our AI Visibility Checker, we tested over 100 sites. The pattern was clear: sites with proper discovery files got mentioned more accurately and more often in AI responses than sites with strong SEO but no discovery files.
The 43% reduction in AI crawler violations for sites with discovery files tells a similar story. AI systems treat these sites differently.
And think about it from the AI's perspective. If you're ChatGPT and you need to recommend a WordPress host in the UK, would you prefer to scrape a 300KB homepage and guess? Or read a 2KB llms.txt file that tells you exactly what the company does, who they serve, and what makes them different?
Fortune 500 Companies Are Already Doing This
This isn't early-adopter speculation. Anthropic (makers of Claude), Stripe, Cloudflare, Perplexity, Zapier, and dozens more have implemented llms.txt. Google itself briefly added llms.txt to their Search Central documentation before removing it.
These companies don't need AI visibility. Everyone already knows who they are. They're implementing discovery files because they want AI to represent them accurately. That's the tell. It's not about getting found. It's about getting described correctly.
For smaller businesses that AI doesn't know well, the benefit is even greater. If you're wondering why ChatGPT can't find your website, the answer often comes down to this: there's nothing telling AI who you are in a format it can easily process.
What This Means for You
Stop thinking about AI discovery files as "AI SEO." They're not. SEO and AI visibility are two different channels solving two different problems.
SEO gets you into Google results for humans. AI discovery files get you into AI-generated answers. You need both, and they work differently.
Start with the free AI Visibility Checker to see what AI currently understands about your business. Then check our Version 2 upgrade that reads your files the way ChatGPT would.
If you're on our WordPress hosting, the infrastructure is already optimised for AI crawlers. You just need the discovery files on top. Our step-by-step guide walks through creating them, or the professional service handles everything for £295.
Generate AI Discovery Files from your dashboard
Using WordPress? Install the plugin and create all 10 files in minutes. No coding, no configuration files to edit manually.
Get the Plugin →Frequently Asked Questions
What's the difference between AI discovery files and SEO?
SEO helps you rank in search results for human users. AI discovery files help AI systems like ChatGPT and Claude understand your business accurately so they can mention you with confidence. SEO is about visibility. AI discovery files are about credibility and trust.
What are the essential AI discovery files?
Ten files: llms.txt (primary AI guidance), llm.txt (compatibility variant redirecting to llms.txt), llms.html (human-readable version with Schema.org), ai.txt (usage permissions), ai.json (machine-readable interaction guidance), identity.json (canonical business identity), brand.txt (brand representation), faq-ai.txt (structured Q&A), developer-ai.txt (technical context), and robots-ai.txt (AI-specific directives).
Why do AI discovery files focus on credibility rather than visibility?
AI systems are cautious. If they're not confident they understand a business correctly, they don't mention it. Discovery files remove that uncertainty by providing consistent, structured information. It's about giving AI enough confidence to include you, not about ranking higher than competitors.
How do AI discovery files remove uncertainty for AI systems?
They provide consistent business identity (name, location, services) in a format AI can quickly parse. Without them, AI has to guess from scattered website content, which often leads to inaccurate or incomplete descriptions. Consistent structured data gives AI confidence to recommend you.
Do AI discovery files matter more for small businesses?
Yes. Large brands are already well-represented in AI training data. Smaller businesses that AI doesn't know well benefit more because discovery files are often the only structured information AI has about them. The less well-known you are, the more discovery files help.
Why are Fortune 500 companies implementing AI discovery files?
Not for visibility (they're already well-known) but for accuracy. They want AI to represent their businesses correctly: right services, right pricing approach, right brand positioning. Even household names want control over how AI describes them.
Do I still need SEO if I have AI discovery files?
Yes. They solve different problems. SEO gets you into Google results for human searchers. AI discovery files get you into AI-generated recommendations. You need both channels, and they work independently of each other.
What happens when every business has AI discovery files?
AI stops making incorrect guesses about businesses. It's not a zero-sum ranking game. When everyone has discovery files, AI answers become more accurate for everyone. The businesses with the best, most consistent files will still get recommended more often for relevant queries.
Check What AI Understands About Your Business
The free AI Visibility Checker reads your files the way ChatGPT would. See if AI trusts your business enough to recommend it.
Run the Free CheckerPublished: · Last reviewed: · Written by: Mark McNeece, Founder & Managing Director, 365i
Editorially reviewed by: Mark McNeece on · Our editorial standards
