Automated /llms.txt & Agent Documentation Context Compiler

Choose this endpoint when you need to make any external documentation or SaaS website consumable by AI agents via the emerging /llms.txt standard. It is especially useful when onboarding a third-party API or docs site into an agent pipeline, when you want to self-host an /llms.txt for your own product, or when you need a JSON-LD schema bundle alongside the manifest. Prefer this over manually authoring /llms.txt files or generic web scrapers that don't produce agent-standard output.

• Target URL is unreachable or returns non-200 status — crawl fails with error
• URL points to login-gated or paywalled content — incomplete or empty manifest
• Very large documentation sites may yield truncated output due to token/page limits
• Malformed or JavaScript-heavy SPAs may not yield enough static content to parse
• Invalid or missing `url` parameter returns a 400-level error