# AgentX402 Site Crawler

> AgentX402 Site Crawler is a paid API for AI agents from api.agentx402.ai, paid per call via x402, $0.004/call, status unknown (last checked 2026-09-14).

Crawls a website up to a specified page budget and returns clean markdown content for every page plus a manifest, settling payment upfront via x402 with credits refunded for unused pages.

## Facts

- Endpoint: POST https://api.agentx402.ai/v1/scout/crawl
- Price: $0.004/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/agentx402-site-crawler-c73379e4
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_k-LSKVHzZnz8rbv4PhiK9

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agentx402-site-crawler-c73379e4 -d '<json body>'
```

Example prompt: Crawl the AgentX402 docs site starting at https://agentx402.ai and fetch up to 50 pages, giving me each page's content as clean markdown along with a manifest of what was found.

## When to prefer this

Choose this endpoint when you need to crawl an entire site or large section of a site (multiple pages) and want results as clean markdown without managing authentication, SDKs, or API keys. It is ideal for agentic workflows that require bulk web content — documentation sites, blogs, research archives — paid seamlessly via x402 with no pre-registration. Prefer it over single-URL scrapers when you need a full multi-page crawl with a manifest of discovered pages.

## Known failure modes

- Target URL unreachable or returns non-200 responses — crawl may return partial results or fail
- Page budget exhausted before full site is covered — only pages within budget are returned
- Payment authorization insufficient for the requested max_pages budget — crawl rejected upfront
- Dynamic JavaScript-heavy pages may not render correctly, resulting in incomplete markdown
- Rate limiting or bot detection by the target site may interrupt the crawl mid-way

## How this service works

Agent-native site crawler over x402 — send a URL and a page budget, get back clean markdown for every page plus a manifest: no signup, no API key, no SDK. Settles the WHOLE max_pages budget UPFRONT, quoted as max_pages × price (a crawl outruns the ~10-min payment authorization, so it cannot pay per page); unused pages are REFUNDED AS CREDITS on completion. Crawl $0.004/page; prepay $1 = 10,000 credits at 20% off. Docs: https://agentx402.ai

## Output

A structured response containing clean markdown text for each crawled page plus a manifest listing all discovered URLs. Payment is settled upfront for the full max_pages budget; any pages not crawled result in credits refunded to the caller's account upon completion.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method",
    "bodyType",
    "body"
   ],
   "properties": {
    "body": {
     "properties": {}
    },
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "POST",
      "PUT",
      "PATCH"
     ],
     "type": "string"
    },
    "bodyType": {
     "enum": [
      "json",
      "form-data",
      "text"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "properties": {
      "max_pages": {
       "type": "number"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agentx402-site-crawler-c73379e4/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.agentx402.ai](https://www.zero.xyz/host/api.agentx402.ai/llms.txt)