# FiatDock Robots.txt & llms.txt AI Crawler Check

> FiatDock Robots.txt & llms.txt AI Crawler Check is a paid API for AI agents from fiatdock.com, paid per call via x402, $0.003/call, status unknown (last checked 2026-10-27).

Checks a given URL's robots.txt and llms.txt files to determine which AI crawlers are permitted or blocked

## Facts

- Endpoint: GET https://fiatdock.com/s/svc_5c3f119b-73f0-4ef0-b456-ddd188c2e701?utm_source=zero.xyz
- Price: $0.003/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-27
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/fiatdock-robots-txt-llms-txt-ai-crawler-check-f3e08455
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_v-uJ-OIfRKWi_90GFDuEX

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability fiatdock-robots-txt-llms-txt-ai-crawler-check-f3e08455
```

Example prompt: Can you check whether https://example.com allows AI crawlers like GPTBot — look at both its robots.txt and llms.txt files and tell me what's permitted?

## When to prefer this

Use this endpoint when you need to determine AI crawler permissions for a specific URL before scraping, indexing, or training on content. Prefer this over manually parsing robots.txt when you need quick, structured, pay-per-call access without managing HTTP logic yourself. Especially valuable for compliance checks, dataset curation pipelines, or agentic crawlers that must respect llms.txt conventions.

## Known failure modes

- URL not reachable or returns non-200 status — robots.txt or llms.txt may be absent or inaccessible
- Domain does not have a robots.txt or llms.txt — result will reflect absence of rules
- Invalid URL format provided — request will fail input validation
- Timeout fetching remote file — transient network error
- Site returns unexpected content type for robots.txt path

## How this service works

Pay-per-call: true402 Robots Check — robots.txt & llms.txt: which AI crawlers are allowed

## Output

Returns parsed information from the target URL's robots.txt and llms.txt files, indicating which AI crawlers (e.g. GPTBot, CCBot, ClaudeBot) are allowed or disallowed, along with any relevant directives or llms.txt declarations governing AI access.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD",
      "DELETE"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/fiatdock-robots-txt-llms-txt-ai-crawler-check-f3e08455/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from fiatdock.com](https://www.zero.xyz/host/fiatdock.com/llms.txt)