llms.txt guides
Plain explanations of llms.txt, llms-full.txt and robots.txt, sourced from the proposal and the crawler operators’ own documentation, and updated when they change.
Start here
New to the file? These four cover what it is, how to make one, and the rules it follows.
- What is llms.txt?
Definition, an example, its origin and its limits.
- How to create an llms.txt file
Seven steps from choosing pages to publishing.
- The llms.txt format
Every element of the format and its rules.
- llms.txt V2: what changed
What the August 2026 revision changed.
Go further
Examples, the mistakes to avoid, and how the file fits with everything else at your domain root.
- llms.txt examples
Five complete files: SaaS, docs, shop, agency, personal.
- llms.txt best practices
Writing rules, common mistakes and a checklist.
- Do I need an llms.txt file?
Which sites benefit, which do not, and a quick test.
- llms.txt vs robots.txt vs sitemap.xml
How the three root files differ.
- llms.txt vs AGENTS.md
A website file versus a repository file for coding agents.
- What is llms-full.txt?
The full-text companion file: when to publish it, and its limits.
- llms.txt vs llms-full.txt
Side by side, and why the index usually wins.
- Does llms.txt help SEO?
No ranking effect, and what drives AI visibility.
- llms.txt news
Dated, sourced llms.txt news: V2, Google, studies, security.
Set it up on your platform
Where the file goes, and the platform quirks that trip people up.
- Adding llms.txt to WordPress
Upload it, generate it with code, or use an SEO plugin; then verify.
- Adding llms.txt to Shopify
Template and redirect, a proxy, or Hydrogen.
- Adding llms.txt to Next.js
A static file or a route handler.
- Adding llms.txt to Squarespace
The built-in 7.1 setting and what to paste in.
- llms.txt on Wix
The file Wix makes: edit, reset or hide it.
Fix and maintain
When the file is not found or not read, and how to keep it current as your site changes.
- llms.txt not working? Find the cause
Fixes for a missing, HTML or stale llms.txt.
- How to keep llms.txt up to date
When and how to refresh an llms.txt.
XML sitemaps
What a sitemap is, how to submit one, and which of its tags search engines still read.
- What is an XML sitemap?
What a sitemap holds, its limits, and when you need one.
- How to submit a sitemap to Google
Search Console, Bing, robots.txt and the Sitemaps report.
- Sitemap lastmod, priority and changefreq
Only an accurate lastmod is used; priority is ignored.
robots.txt
Tested examples for the robots.txt rules people need most.
- robots.txt examples
Tested examples: allow all, disallow all, AI crawlers, sitemap.
Tools
Everything here is free, with no account.
- Free llms.txt Generator
Build an llms.txt from a website, sitemap or URL list.
- Free llms-full.txt Generator
Build llms-full.txt from a site, in full or summary mode.
- llms.txt Validator
Check an llms.txt by URL, upload or paste.
- robots.txt Generator
Build robots.txt with AI crawler presets.
- robots.txt Tester
Is a URL allowed for a crawler? Shows the deciding rule.
- Free XML Sitemap Generator
Crawls a site and writes sitemap.xml with only indexable pages.
- XML Sitemap Validator
Checks a sitemap or sitemap index, with line numbers.