Automated /llms.txt & Agent Documentation Context Compiler

Use this endpoint when you need to programmatically generate an /llms.txt manifest or JSON-LD schema bundle from any existing documentation or SaaS website, especially when the site does not already publish its own /llms.txt. Prefer this over manual authoring when the documentation is large, frequently updated, or needs to be machine-readable for AI agent discovery pipelines. Best suited for developers or agents bootstrapping LLM-discoverability for third-party or internal tools.

• URL is unreachable or returns non-200 status — crawl fails with an error response
• Target site blocks crawlers via robots.txt or rate limiting — partial or empty manifest returned
• Malformed or missing URL parameter — validation error
• Site content is not documentation-like — low-quality or sparse manifest generated
• Timeout on large sites — partial results returned