How to use it
- Give your site a name and a one-sentence summary.
- Add sections of links, such as Docs, Guides and Pricing, each with a few words about what's there. Paste a list of URLs to add many at once.
- Copy or download
llms.txtand put it at the root of your site, so it's athttps://your-site/llms.txt.
What llms.txt is for
llms.txt is a Markdown file that tells AI assistants what a site is and where its most useful pages are, in a form they read easily. When ChatGPT, Claude or a coding agent is asked about your product, a short list of the right pages beats crawling menus, cookie banners and scripts.
The format is small:
# Name
> One-sentence summary.
Optional notes in Markdown.
## Docs
- [Getting started](https://example.com/docs/start.md): install and first steps
## Optional
- [Changelog](https://example.com/changelog): what changed in each release
Links in a section named Optional are the ones an assistant can skip when it's short of room.
Tips
- Link to Markdown versions of your pages where you have them (
page.md): they're smaller and cleaner to read than HTML. - Use full
https://URLs. The file is often read away from your site. - Keep it short. A few dozen good links help more than every page you have; the sitemap is for completeness.
- Some sites also publish
llms-full.txt: all their docs in one Markdown file. Lobsite's own links to one.
Frequently asked questions
Do AI assistants read llms.txt?
It's a proposal, not a standard, and support varies. Coding agents and tools that fetch docs use it, and it costs one small file to offer. It doesn't replace robots.txt, which controls crawling.
Where do I put it?
At the root of your site, next to robots.txt. On Lobsite, put llms.txt at the top of the folder you deploy.
Should I list every page?
No. List the pages that answer the questions people ask about your product: what it is, how to start, the reference, pricing. Put the rest under Optional, or leave it out.
Is anything sent to a server?
No. The file is written in your browser.