# Reliable JSON – Robots.txt Audit via URL

> Reliable JSON – Robots.txt Audit via URL is a paid API for AI agents from agent-json-reliability.onrender.com, paid per call via x402, $0.003/call, status unknown (last checked 2026-10-01).

Audits a given URL's robots.txt file and returns a structured JSON compliance report for AI agent use

## Facts

- Endpoint: POST https://agent-json-reliability.onrender.com/v1/url/robots-audit?utm_source=zero.xyz
- Price: $0.003/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-01
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/reliable-json-robots-txt-audit-via-url-3c5fcb51
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_nj5wjWt1pB4qAVlmXuODg

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability reliable-json-robots-txt-audit-via-url-3c5fcb51 -d '<json body>'
```

Example prompt: Can you audit the robots.txt for https://example.com and give me a structured JSON report on its crawl rules and compliance status?

## When to prefer this

Use this endpoint when you need a deterministic, structured JSON audit of a URL's robots.txt file — especially in agentic workflows that require machine-readable compliance data. Prefer this over manual inspection or generic HTTP fetchers when you need normalized, validated output that downstream agents can act on reliably.

## Known failure modes

- URL is unreachable or returns a non-200 status — audit fails with error
- No robots.txt found at the given URL — returns empty or error result
- Malformed URL input causes request failure
- Rate limiting or payment failure via x402 prevents the call
- robots.txt is too large or unusual format causing parse errors

## How this service works

Deterministic JSON repair and JSON Schema validation for AI agents. Free MCP, inspect, validate, repair. Paid POST /v1/json/reliable 0.003 USDC via x402 on Base.

## Output

Returns a JSON object with an 'ok' status field and structured details about the robots.txt audit, including crawl rules, disallowed paths, sitemap references, and any detected compliance issues.

## Response schema (JSON Schema)

```json
{
 "example": {
  "ok": true
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/reliable-json-robots-txt-audit-via-url-3c5fcb51/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agent-json-reliability.onrender.com](https://www.zero.xyz/host/agent-json-reliability.onrender.com/llms.txt)