# SiteCheck llms.txt Reader

> SiteCheck llms.txt Reader is a paid API for AI agents from api.sitecheck-api.workers.dev, paid per call via x402, $0.002/call, status unknown (last checked 2026-10-28).

Fetches and parses the llms.txt (and llms-full.txt) file from a given website, returning structured AI-readable documentation metadata including title, summary, and section links.

## Facts

- Endpoint: GET https://api.sitecheck-api.workers.dev/api/llms-txt?utm_source=zero.xyz
- Price: $0.002/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-28
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/sitecheck-llms-txt-reader-6aa93b01
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_1V6WAqZ-KOa3GtEY6GIZX

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability sitecheck-llms-txt-reader-6aa93b01
```

Example prompt: Can you fetch and parse the llms.txt file from https://developers.cloudflare.com so I can see what documentation sections and links they expose for AI agents?

## When to prefer this

Use this endpoint when you need to programmatically discover and consume AI-readable documentation from a website that follows the llms.txt standard. Prefer it over general web scraping when the goal is specifically to index or navigate a site's structured AI documentation sections, or when building a retrieval pipeline that needs canonical doc links organized by topic.

## Known failure modes

- Site does not have an llms.txt file — exists field returns false
- Invalid or unreachable URL — network error or timeout
- URL missing https:// scheme — query param validation failure
- Site returns llms.txt but it is malformed or unparseable — partial or empty sections
- Rate limiting or Cloudflare Worker errors — HTTP 429 or 5xx

## How this service works

Whether a site publishes /llms.txt and /llms-full.txt: the parsed llms.txt (title, summary, sections with their links) and the size of llms-full.txt. Reads the site itself, through the same URL guard and size cap as the page tools.

## Output

Returns a JSON object containing the target site URL, the source URLs where llms.txt and/or llms-full.txt were found, and a structured llmsTxt object with: existence flag, byte size, title, summary, and an array of named sections each containing titled links with URLs and optional notes.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "Site address, https://…"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "site": "https://developers.cloudflare.com",
  "source": "https://developers.cloudflare.com/llms.txt, https://developers.cloudflare.com/llms-full.txt",
  "llmsTxt": {
   "bytes": 16925,
   "title": "Cloudflare Developer Documentation",
   "exists": true,
   "summary": "Each product below links to its own llms.txt, which contains a full index of that product's documentation pages and is the recommended way to explore a specific product's content.",
   "sections": [
    {
     "name": "Application performance",
     "links": [
      {
       "url": "https://developers.cloudflare.com/argo-smart-routing/llms.txt",
       "note": "Route web traffic across the fastest, most reliable network paths",
       "title": "Argo Smart Routing"
      },
      {
       "url": "https://developers.cloudflare.com/automatic-platform-optimization/llms.txt",
       "note": "Improve WordPress site performance by serving it from Cloudflare's global network",
       "title": "Automatic Platform Optimization"
      },
      {
       "url": "https://developers.cloudflare.com/cache/llms.txt",
       "note": "Make websites faster by caching content across our global server network",
       "title": "Cache / CDN"
      }
     ]
    },
    {
     "name": "Application security",
     "links": [
      {
       "url": "https://developers.cloudflare.com/api-shield/llms.txt",
       "note": "Identify and address your API vulnerabilities",
       "title": "API Shield"
      },
      {
       "url": "https://developers.cloudflare.com/bots/llms.txt",
       "note": "Protect your domain from bad bot traffic",
       "title": "Bots"
      },
      {
       "url": "https://developers.cloudflare.com/cloudflare-challenges/llms.txt",
       "note": "Verify visitors are not bots with lightweight challenges",
       "title": "Challenges"
      }
     ]
    },
    {
     "name": "Cloudflare One",
     "links": [
      {
       "url": "https://developers.cloudflare.com/mesh/llms.txt",
       "note": "Connect services and devices with post-quantum encrypted mesh networking",
       "title": "Cloudflare Mesh"
      },
      {
       "url": "https://developers.cloudflare.com/cloudflare-network-firewall/llms.txt",
       "note": "Protect your enterprise network with advanced firewall-as-a-service protection",
       "title": "Cloudflare Network Firewall"
      },
      {
       "url": "https://developers.cloudflare.com/cloudflare-one/llms.txt",
       "note": "Replace legacy
… (truncated)
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/sitecheck-llms-txt-reader-6aa93b01/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.sitecheck-api.workers.dev](https://www.zero.xyz/host/api.sitecheck-api.workers.dev/llms.txt)
