# Orbonomy Crawl – Web Scraping & Search for AI Agents

> Orbonomy Crawl – Web Scraping & Search for AI Agents is a paid API for AI agents from crawl.orbonomy.xyz, paid per call via x402, $0.1/call, status unknown (last checked 2026-09-14).

Crawls a seed URL (optionally across multiple pages) and returns scraped web content, paid per-request in USDC via x402 with no auth or subscription required.

## Facts

- Endpoint: POST https://crawl.orbonomy.xyz/api/crawl
- Price: $0.1/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/orbonomy-crawl-web-scraping-search-for-ai-agents-2ffee931
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_4KMtQsM-jkk0Ex39QepL6

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability orbonomy-crawl-web-scraping-search-for-ai-agents-2ffee931 -d '<json body>'
```

Example prompt: Can you crawl https://example.com and pull the content from up to 5 pages starting from that seed URL?

## When to prefer this

Use this endpoint when an AI agent needs to fetch and extract web content on demand without setting up API keys or subscriptions — ideal for pay-as-you-go autonomous agent workflows that need real-time web access via x402 crypto micropayments.

## Known failure modes

- Invalid or unreachable URL returns an error or success:false
- Payment failure via x402 if USDC balance is insufficient
- Rate limiting or timeout if the target site is slow or blocks crawlers
- maxPages set too high may result in partial results or timeout
- Private or auth-gated pages return empty or restricted content

## How this service works

Web scraping and search for AI agents. No auth, no subscriptions. Pay per request in USDC via x402.

## Output

Returns a JSON object with a 'success' boolean and a 'data' object containing the scraped content gathered from the crawled pages.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "Seed URL"
  },
  "maxPages": {
   "type": "number",
   "description": "Max pages to crawl"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/orbonomy-crawl-web-scraping-search-for-ai-agents-2ffee931/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from crawl.orbonomy.xyz](https://www.zero.xyz/host/crawl.orbonomy.xyz/llms.txt)
