# vaaya.ai CRW Map — Website URL Discovery

> vaaya.ai CRW Map — Website URL Discovery is a paid API for AI agents from vaaya.ai, paid per call via x402, $0.01/call, status unknown (last checked 2026-10-02).

Discovers all URLs on a website by reading its sitemap and/or crawling links, without fetching full page content

## Facts

- Endpoint: POST https://vaaya.ai/api/run/crw/map?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-02
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/vaaya-ai-crw-map-website-url-discovery-16d49f8b
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_EOVNJLRurBdEA1RUh1xHc

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability vaaya-ai-crw-map-website-url-discovery-16d49f8b -d '<json body>'
```

Example prompt: Can you map all the URLs on example.com — use the sitemap if available and fall back to crawling up to depth 3, with a 90-second timeout?

## When to prefer this

Use this endpoint when you need to enumerate all URLs on a site before deciding which pages to scrape or crawl — it is faster and cheaper than a full crawl because it does not fetch page content. Prefer it over crw/crawl as a lightweight recon step to build a target URL list, or when you only need site structure rather than content.

## Known failure modes

- Invalid or unreachable URL — returns error or empty list
- Timeout exceeded before full discovery completes — partial URL list may be returned
- No sitemap found and crawl depth insufficient to find deep pages
- Robots.txt blocking or rate limiting on target site
- Malformed sitemap that cannot be parsed

## How this service works

CRW — Discover the URLs of a website without scraping content (sitemap + crawl fallback). Pass `url`; optional `maxDepth`, `useSitemap` (default true), `timeout` (seconds, default 120). Recon step before targeted crw/scrape or crw/crawl.

## Output

Returns a list of discovered URLs on the target website, gathered from the sitemap (if available and useSitemap is true) and/or by following links up to the specified maxDepth — no page content is fetched, only URLs are returned.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method",
    "bodyType",
    "body"
   ],
   "properties": {
    "body": {
     "type": "object",
     "$schema": "http://json-schema.org/draft-07/schema#",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "format": "uri"
      },
      "timeout": {
       "type": "integer",
       "exclusiveMinimum": 0
      },
      "maxDepth": {
       "type": "integer",
       "minimum": 0
      },
      "useSitemap": {
       "type": "boolean"
      }
     },
     "additionalProperties": true
    },
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "POST"
     ],
     "type": "string"
    },
    "bodyType": {
     "enum": [
      "json",
      "form-data",
      "text"
     ],
     "type": "string"
    },
    "pathParams": {
     "type": "object"
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/vaaya-ai-crw-map-website-url-discovery-16d49f8b/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from vaaya.ai](https://www.zero.xyz/host/vaaya.ai/llms.txt)