# Delx Commerce — robots.txt Path Budget Parser

> Delx Commerce — robots.txt Path Budget Parser is a paid API for AI agents from commerce.delx.ai, paid per call via x402, $0.001/call, status unknown (last checked 2026-10-02).

Parses a robots.txt body and returns a structured summary of allowed/disallowed path counts and sitemap URLs

## Facts

- Endpoint: POST https://commerce.delx.ai/api/v1/x402/robots-path-budget?utm_source=zero.xyz
- Price: $0.001/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-02
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/delx-commerce-robots-txt-path-budget-parser-2b8c3712
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_c5ttHHa_Mj0o_6_L1QY6M

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability delx-commerce-robots-txt-path-budget-parser-2b8c3712 -d '<json body>'
```

Example prompt: Parse this robots.txt content and tell me how many paths are allowed vs disallowed, and list any sitemaps it references: 'User-agent: * Disallow: /private/ Allow: / Sitemap: https://example.com/sitemap.xml'

## When to prefer this

Choose this endpoint when you need a fast, structured parse of a robots.txt body into counts and sitemaps without building your own parser. Ideal for automated web crawling pipelines, SEO audits, or any agent that needs to programmatically understand a site's crawl budget. At $0.001 USDC per call with no signup, it's suited for lightweight, pay-as-you-go usage inside agentic workflows.

## Known failure modes

- Empty or missing 'robots' field returns an error or zero counts
- Malformed robots.txt with non-standard directives may produce inaccurate counts
- Very large robots.txt bodies may cause parsing timeouts
- Non-UTF-8 encoded input may cause parsing failures
- Payment failure via x402 protocol prevents the call from being processed

## How this service works

Pay-per-result APIs for agents. No signup. Exact price. Verifiable delivery. USDC on Base + Solana via x402.

## Output

Returns a JSON object with a schema identifier ('delx/util-robots-path-budget/v1'), the count of allowed paths (allow_n), the count of disallowed paths (disallow_n), and an array of sitemap URLs found in the robots.txt body.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "robots": {
   "type": "string",
   "description": "robots.txt body text"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "schema": "delx/util-robots-path-budget/v1",
  "allow_n": 1,
  "sitemaps": [
   "https://ex.com/sitemap.xml"
  ],
  "disallow_n": 1
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/delx-commerce-robots-txt-path-budget-parser-2b8c3712/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from commerce.delx.ai](https://www.zero.xyz/host/commerce.delx.ai/llms.txt)