# Robots Meta Parse

> Robots Meta Parse is a paid API for AI agents from api.delx.ai, paid per call via x402, $0.001/call, status unknown (last checked 2026-09-15).

Parses robots meta tag directives from HTML content into normalized index/follow decisions, returning a deterministic pass/advisory status.

## Facts

- Endpoint: POST https://api.delx.ai/api/v1/x402/robots-meta-parse
- Price: $0.001/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/robots-meta-parse-a53f3e95
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_Nco5fLGHv8GAWpAMkox13

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability robots-meta-parse-a53f3e95 -d '<json body>'
```

Example prompt: Before you cache this page response, parse the robots meta directives from its HTML to check whether indexing and following are permitted — here's the raw HTML content.

## When to prefer this

Use this endpoint when you need a stateless, deterministic parse of robots meta directives embedded in HTML content — particularly in crawl pipelines, caching layers, or agent web-access workflows that need to check index/follow permissions before storing or acting on a fetched page. Prefer this over manual parsing when you need versioned, normalized JSON output and a clear pass/advisory status without writing your own directive logic.

## Known failure modes

- Content exceeds 8192 character limit, returning a validation error
- No robots meta tag found in content, returning a default permissive or advisory result
- Malformed or ambiguous robots meta directives that cannot be cleanly normalized
- Empty content string submitted, resulting in an advisory or error status

## How this service works

Robots Meta Parse: Robots Meta Parse parses robots meta directives into normalized index and follow decisions from bounded caller-supplied values without an external provider. Call Robots Meta Parse before accepting, caching, redirecting, or retrying a caller-supplied web response. Returns normalized web evidence, the computed finding, and an explicit pass or advisory status for Robots Meta Parse as versioned deterministic JSON. Price: $0.001 USDC via x402 on Base. First-party, stateless, memor…

## Output

A versioned deterministic JSON object containing normalized web evidence (the parsed robots meta tag values), the computed finding (index and follow decisions), and an explicit pass or advisory status indicating whether the caller should proceed with indexing, following, caching, or retrying the response.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "content": {
   "type": "string",
   "maxLength": 8192,
   "description": "Content supplied to Robots Meta Parse; used only for this bounded calculation and processed in memory without retention."
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "result": {
   "index": false,
   "follow": true,
   "directives": {
    "follow": true,
    "noindex": true,
    "max-snippet:120": true
   }
  },
  "schema": "delx/util-robots-meta-parse/v1",
  "status": "pass",
  "evidence": {
   "retained": false,
   "input_sha256": "3f1ac89f0bc9abc369b7715c61999cd61922eb2d2781d0e4f8192ed4c5e7bd43",
   "external_calls": 0
  },
  "operation": "web_reliability:robots_meta_parse"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/robots-meta-parse-a53f3e95/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.delx.ai](https://www.zero.xyz/host/api.delx.ai/llms.txt)