What llms.txt does
llms.txt is an emerging convention for giving AI systems a concise map of the best pages on your site. It does not replace robots.txt, sitemaps, or normal SEO. Treat it as an editorial shortlist for machines.
What to include
- Your homepage and product overview
- Top guides by topic cluster
- Canonical policy generators
- Comparison pages with balanced facts
- Contact and editorial ownership details
What to avoid
Do not stuff every URL into the file, expose private pages, or make unsupported legal claims. If a page is not useful enough for a human researcher, it should not be promoted to an AI crawler either.