# ScrapFly Web Crawl Endpoint

> ScrapFly Web Crawl Endpoint is a paid API for AI agents from scrapfly.vercel.app, paid per call via x402, $0.1/call, status unknown (last checked 2026-10-24).

Crawls a given URL (and optionally multiple pages) and returns the scraped content as structured data

## Facts

- Endpoint: POST https://scrapfly.vercel.app/api/crawl/crawl?utm_source=zero.xyz
- Price: $0.1/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-24
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapfly-web-crawl-endpoint-7976431a
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_8ZQyuW2ACerCtVAq40hAh

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapfly-web-crawl-endpoint-7976431a -d '<json body>'
```

Example prompt: Can you crawl https://example.com/products for me and pull back all the page content — go through up to 5 pages?

## When to prefer this

Choose this endpoint when you need to programmatically retrieve and extract content from one or more pages of a website, particularly when you want pay-per-request pricing via crypto (USDC on Base) and need a simple URL-in/data-out interface. Prefer this over browser automation tools when you want a managed, hosted scraping solution without maintaining your own infrastructure.

## Known failure modes

- URL is unreachable or returns a non-200 status — success: false with no data
- Target site blocks scraping (bot protection, CAPTCHA) — success: false or empty data
- Invalid URL format provided — request may fail at validation
- maxPages set too high causing timeout or partial results
- Payment failure via x402 protocol — request not processed

## How this service works

69 endpoints for data, content generation, and web scraping. Pay per request via x402 on Base chain.

## Output

Returns a JSON object with a boolean 'success' field and a 'data' object containing the scraped content from the target URL. The data object holds the extracted page content, which may include text, HTML, links, or structured data depending on what the page contains.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "url"
  },
  "maxPages": {
   "type": "number",
   "description": "maxPages"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "success"
 ],
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapfly-web-crawl-endpoint-7976431a/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from scrapfly.vercel.app](https://www.zero.xyz/host/scrapfly.vercel.app/llms.txt)