# Crawl Sitemap Fetcher

> Crawl Sitemap Fetcher is a paid API for AI agents from crawol.vercel.app, paid per call via x402, $0.02/call, status unknown (last checked 2026-09-15).

Fetches and returns the sitemap for a given domain URL, enabling AI agents to discover the structure and pages of a website.

## Facts

- Endpoint: POST https://crawol.vercel.app/api/sitemap
- Price: $0.02/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/crawl-sitemap-fetcher-527a537d
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_jI6rsbyxfS19o4jjxZ_t-

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability crawl-sitemap-fetcher-527a537d -d '<json body>'
```

Example prompt: Can you fetch the sitemap for example.com so I can see all the pages and sections that exist on that site?

## When to prefer this

Use this endpoint when you need to discover the URL structure or page inventory of a domain without authentication or subscription setup, paying only $0.02 USDC per call via x402. Ideal for AI agents that need a quick, pay-per-use sitemap lookup without committing to a crawl service contract.

## Known failure modes

- Domain has no sitemap.xml or robots.txt sitemap reference — returns empty or failed data
- Invalid or malformed URL input — may return error or empty result
- Domain is unreachable or blocked — request may time out or return failure
- Payment of $0.02 USDC not fulfilled via x402 — 402 Payment Required response blocks the request
- Private or password-protected domains return no accessible sitemap data

## How this service works

Web scraping and search for AI agents. No auth, no subscriptions. Pay per request in USDC via x402.

## Output

Returns a JSON object with a success boolean and a data object containing sitemap information — typically the discovered URLs and page structure for the given domain.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "Domain URL"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/crawl-sitemap-fetcher-527a537d/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from crawol.vercel.app](https://www.zero.xyz/host/crawol.vercel.app/llms.txt)