Articles about "AI discovery files"

llms.txt is a Markdown file that tells AI systems what your site is about. Here's the real spec format (v2), what it can and can't do, and how to implement it.

robots.txt tells crawlers where NOT to go. llms.txt tells AI systems what your site IS. Opposite jobs — here's what each file does and how to use both.

ai-catalog.json explained: the open ARD specification for declaring your APIs, MCP servers, and agents to AI registries. What goes in the file, where to host it, how it fits with llms.txt — and whether you should publish one yet.

identity.json is a small file that declares your site's identity to AI search. But does Bing actually read it? Here's what the evidence really says in 2026.