# ScrapFly Web Crawl API

> ScrapFly Web Crawl API is a paid API for AI agents from test-scrapfly.orbonomy.xyz, paid per call via x402, $0.1/call, status unknown (last checked 2026-09-15).

Crawls a given URL and up to N pages deep, returning structured scraped content via a pay-per-request x402 endpoint

## Facts

- Endpoint: POST https://test-scrapfly.orbonomy.xyz/api/crawl/crawl
- Price: $0.1/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapfly-web-crawl-api-fddd0139
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_Wz-5pV6BbnII3p0ccWG_A

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapfly-web-crawl-api-fddd0139 -d '<json body>'
```

Example prompt: Crawl https://example.com/products for me and pull back up to 3 pages of content so I can see what's listed there.

## When to prefer this

Use this endpoint when you need to programmatically fetch and extract content from one or more web pages, especially when you want multi-page crawling from a single starting URL. Prefer this over single-fetch endpoints when you need to follow links across pages. Best for agents needing to gather web content without managing browser infrastructure.

## Known failure modes

- URL is unreachable or returns non-200 status — success: false
- Invalid or malformed URL input — request validation error
- maxPages exceeds allowed limit — error response
- Payment not fulfilled via x402 — 402 Payment Required
- Target site blocks scraping — may return empty or partial data

## How this service works

69 endpoints for data, content generation, and web scraping. Pay per request via x402 on Base chain.

## Output

Returns a JSON object with a success boolean and a data object containing the scraped content from the crawled URL(s).

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "url"
  },
  "maxPages": {
   "type": "number",
   "description": "maxPages"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "success"
 ],
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapfly-web-crawl-api-fddd0139/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from test-scrapfly.orbonomy.xyz](https://www.zero.xyz/host/test-scrapfly.orbonomy.xyz/llms.txt)