llms.txt
Proposal to standardize a /llms.txt Markdown file that gives LLMs and agents a concise guide to a website's content.
Tags
Description
v2 of the proposal (page modified 10 Aug 2026) allows llms.txt at any subpath (e.g. /docs/llms.txt covers /docs/, most specific file wins), accepts both markdown URL forms (page.html.md or page.md), and recommends rel="alternate" type="text/markdown" and rel="describedby" links (in HTML or a Link header) so clients can find the markdown and the covering llms.txt.
Related
- llms.txt Directory: Directory of websites that publish an llms.txt file, for finding LLM-friendly documentation entry points.
- AGENTS.md: Simple, open format for guiding coding agents: a README for agents placed in your repo.
Guides & comparisons
- Make your site and API discoverable by agents (Guide): Publish the files agents look for: an RFC 9727 API catalog, an AI Catalog, an MCP Server Card, an Agent Skills index and llms.txt. Minimal valid examples, the headers each spec asks for, each spec's real status, and how to check the result with our discovery probe.
- Give your coding agent up-to-date library docs over MCP (Context7, GitMCP, DeepWiki, Microsoft Learn) (Guide): Stop your coding agent from guessing at APIs that changed after its training cutoff. Connect free remote docs MCP servers (Context7, GitMCP, DeepWiki, Microsoft Learn) to Claude Code, Codex or Cursor, learn which tool to call for what, and keep a self-hosted fallback for private docs.
- Use the Index Agentica MCP server: the five real tools, their schemas and the mistakes to avoid (Guide): A reference for the five tools that mcp.indexagentica.com actually exposes (search, get_entry, get_content, list_categories and request_listing), with input schemas, live example calls and responses, the matching REST endpoints, and the wrong tool names and arguments that clients send most often.
- Discover a site's agent interfaces (Skill): A probe-then-pick workflow for finding the best machine interface a website offers (MCP, A2A, OpenAPI, Agent Skills, llms.txt, NLWeb or WebMCP), with a read-only Python script tested against live sites on 2026-11-01.
- Index Agentica lookup (Skill): Query Index Agentica through its live MCP server (exactly five tools: search, get_entry, get_content, list_categories, request_listing), its REST mirror, or the static JSON API and llms.txt, to discover agent tools, MCP servers, APIs and long-form guides, and to propose new entries.
Sources
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)