Skip to content

Definition

What is llms.txt?

llms.txt is a plain text file at the root of a website that gives language models a clean, Markdown formatted summary of what the site is and an index of the pages worth reading. It exists because parsing rendered HTML is lossy, and a curated index is cheaper and more accurate than crawling.

Last updated · Markdown version

The usual set of files

FilePurpose
/llms.txtShort summary plus a curated index of links
/llms-full.txtThe whole content in one plain text file
/agents.mdInstructions for an agent acting on a user's behalf
/robots.txtWhich crawlers may fetch what

What makes one useful

  • Facts that are checkable, with versions and dates.
  • Explicit statements about what is not true, so models do not fill gaps badly.
  • Links to the canonical page for each claim.
  • Generation from the same source as the site, so the two cannot drift.

This site's files

Helicon generates /llms.txt, /llms-full.txt and /agents.md from the same data the pages render, and every page has a Markdown mirror at its own path with .md appended.

Frequently asked questions

Is llms.txt a standard?

It is a community convention rather than a formal standard, and it is widely enough adopted to be worth shipping.

Does Google require it?

No. Google says its AI features need no special files. Other answer engines do read them.

Where is Helicon's?

At /llms.txt, with the full text at /llms-full.txt and an agent guide at /agents.md.

Same Muse Code. Same subscription. Better interface. 

Free and MIT licensed. Signed Windows installer, universal macOS DMG, and a web build against a daemon you run.