# Automated /llms.txt & Agent Documentation Context Compiler

> Automated /llms.txt & Agent Documentation Context Compiler is a paid API for AI agents from serp-extract.agentdiet.dev, paid per call via MPP, $0.01/call, status unknown (last checked 2026-10-21).

Crawls any documentation or SaaS site URL and generates a standards-compliant /llms.txt manifest and JSON-LD schema bundle for AI agent consumption

## Facts

- Endpoint: GET https://serp-extract.agentdiet.dev/v1/agent-card?utm_source=zero.xyz
- Price: $0.01/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-21
- Activations on Zero: 0
- Provider: serp-extract.agentdiet.dev
- Website: https://serp-extract.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/serp-extract-agentdiet-dev-automated-llms-txt-agent-documentation-f82eed81
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_7PsxFqgK6b-gVj2RHqTbH

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability serp-extract-agentdiet-dev-automated-llms-txt-agent-documentation-f82eed81
```

Example prompt: Can you crawl the docs at https://stripe.com/docs and generate a standards-compliant /llms.txt manifest and JSON-LD schema bundle so my AI agent can consume it directly?

## When to prefer this

Choose this endpoint when you need to automatically generate a machine-readable /llms.txt manifest and JSON-LD schema from any public documentation or SaaS website without manual authoring. It is ideal for bootstrapping AI agent knowledge bases, onboarding third-party API docs, or making your own product documentation agent-accessible. Prefer it over manual llms.txt authoring when the target site is large, frequently updated, or when you need structured JSON-LD alongside the manifest.

## Known failure modes

- URL is unreachable or returns a non-200 response — crawl fails with an error
- Site blocks crawlers via robots.txt or bot protection — returns empty or partial manifest
- Malformed or non-documentation URL — output may be low quality or schema-sparse
- Very large sites may produce truncated manifests due to token/page limits
- JavaScript-heavy SPAs may not render content accessible to the crawler

## How this service works

Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and JSON-LD schema bundle. (Live x402 v2, IETF MPP & MCP endpoint at https://serp-extract.agentdiet.dev/v1/agent-card)

## Output

Returns a standards-compliant /llms.txt manifest and a JSON-LD schema bundle derived from the crawled documentation or SaaS site, formatted for direct AI agent consumption. The output includes structured metadata, page summaries, and schema annotations that allow agents to understand and reference the site's content efficiently.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Website URL to crawl and generate a ready-to-consume /llms.txt manifest for"
  },
  "limit": {
   "type": "integer",
   "default": 20,
   "maximum": 100,
   "minimum": 1,
   "description": "Maximum number of items to return per page (1-100)"
  },
  "cursor": {
   "type": "string",
   "description": "Opaque pagination cursor for fetching the next page"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object"
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/serp-extract-agentdiet-dev-automated-llms-txt-agent-documentation-f82eed81/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from serp-extract.agentdiet.dev](https://www.zero.xyz/host/serp-extract.agentdiet.dev/llms.txt)