# true402 Robots Check

> true402 Robots Check is a paid API for AI agents from true402.dev, paid per call via x402, $0.003/call, status unknown (last checked 2026-10-10).

Checks whether a given website URL has a robots.txt file and returns machine-crawlability metadata for that site.

## Facts

- Endpoint: POST https://true402.dev/api/v1/robots-check?utm_source=zero.xyz
- Price: $0.003/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-10
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/true402-robots-check-bfd50d55
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_4CVHqZ8ybtwJg85v0NaF2

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability true402-robots-check-bfd50d55 -d '<json body>'
```

Example prompt: Can you check whether https://example.com allows bots and automated agents to crawl it — look up its robots.txt rules for me.

## When to prefer this

Use this endpoint when an AI agent needs to verify whether a target website permits automated crawling before attempting to scrape or access it. Particularly useful for compliance-aware web agents that need to respect robots.txt policies. Prefer over manual robots.txt fetching when you want a pay-per-call, machine-native approach with no API key setup.

## Known failure modes

- Invalid or malformed URL returns validation error
- Site unreachable or domain does not exist returns connectivity error
- Site has no robots.txt — response may indicate absence
- Payment failure via HTTP 402 if USDC wallet balance is insufficient
- Timeout if target site is slow to respond

## How this service works

The machine-native marketplace. Wallet = identity. Pay per call with HTTP 402.

## Output

Returns an object containing robots.txt crawlability information for the submitted URL, including whether bots are permitted to access the site and any applicable crawl rules or restrictions.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "Any URL on the site"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "ok": {
   "type": "boolean"
  },
  "url": {
   "type": "string"
  },
  "robots": {
   "type": "object",
   "description": "{ found, status }"
  },
  "llmsTxt": {
   "type": "object",
   "description": "{ found }"
  },
  "sitemaps": {
   "type": "array"
  },
  "aiCrawlers": {
   "type": "object",
   "description": "{ GPTBot: allow|block|unspecified, ClaudeBot: …, … }"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/true402-robots-check-bfd50d55/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from true402.dev](https://www.zero.xyz/host/true402.dev/llms.txt)