# LLMs.txt Auditor

> LLMs.txt Auditor is a paid API for AI agents from api.timzinin.com, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-14).

Checks a domain for the presence of llms.txt and robots.txt AI crawler directives, reporting which AI bots are allowed or blocked

## Facts

- Endpoint: POST https://api.timzinin.com/api/llms-txt-auditor
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/llms-txt-auditor-31492ea0
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_prxGNmxZJDADU6aE38qBl

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability llms-txt-auditor-31492ea0 -d '<json body>'
```

Example prompt: Can you check whether openai.com has an llms.txt file and which AI crawlers — like GPTBot, ClaudeBot, and PerplexityBot — it allows or blocks?

## When to prefer this

Use this endpoint when you need to quickly determine AI crawler access policy for a specific domain without manually fetching and parsing robots.txt or llms.txt yourself. Ideal for agents that need to validate whether a site permits AI scraping before attempting it, for dataset curation pipelines that must respect publisher permissions, or for monitoring whether a domain's AI crawler policy has changed. At $0.01 per call it is cost-effective for per-domain spot checks.

## Known failure modes

- Domain not found or unreachable — found:false with empty crawler data
- Network timeout fetching robots.txt or llms.txt — may return partial or stale results
- Invalid domain format in input — likely returns an error or empty result
- Domain exists but has no robots.txt and no llms.txt — all crawlers reported as allowed by default
- Rate limiting or firewall on target domain may cause scrape failure

## How this service works

Pay-per-call data & tool APIs

## Output

A JSON object containing: whether llms.txt and llms-full.txt exist and their byte sizes, a per-crawler verdict (allowed/blocked) for major AI bots including GPTBot, ClaudeBot, ChatGPT-User, Amazonbot, Bytespider, PerplexityBot, Google-Extended, CCBot, and anthropic-ai, a human-readable summary, the canonical domain URL, and the timestamp of when the data was scraped. Also includes run time in milliseconds and payment settlement confirmation.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "items": {
   "type": "array",
   "maxItems": 100
  },
  "maxConcurrency": {
   "type": "integer",
   "maximum": 50,
   "minimum": 1
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "meta": {
   "run_ms": 1200,
   "settled": true,
   "item_count": 1
  },
  "results": [
   {
    "found": true,
    "input": "nytimes.com",
    "domain": "https://nytimes.com",
    "summary": "no llms.txt, blocks 8/9: GPTBot, ChatGPT-User, ClaudeBot, anthropic-ai, Google-Extended, PerplexityBot, CCBot, Bytespider.",
    "scrapedAt": "2026-07-26T13:20:22.136Z",
    "aiCrawlers": {
     "CCBot": "blocked",
     "GPTBot": "blocked",
     "Amazonbot": "allowed",
     "ClaudeBot": "blocked",
     "Bytespider": "blocked",
     "ChatGPT-User": "blocked",
     "anthropic-ai": "blocked",
     "PerplexityBot": "blocked",
     "Google-Extended": "blocked"
    },
    "hasLlmsTxt": false,
    "llmsTxtBytes": 0,
    "hasLlmsFullTxt": false
   }
  ]
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/llms-txt-auditor-31492ea0/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.timzinin.com](https://www.zero.xyz/host/api.timzinin.com/llms.txt)