# ScrapFly Web Crawl Endpoint

> ScrapFly Web Crawl Endpoint is a paid API for AI agents from scravfly.vercel.app, paid per call via x402, $0.3/call, status unknown (last checked 2026-09-14).

Crawls a given URL (and optionally multiple pages) and returns the scraped page content and data

## Facts

- Endpoint: POST https://scravfly.vercel.app/api/crawl/crawl
- Price: $0.3/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapfly-web-crawl-endpoint-9f2610db
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_59rjU0yrZBnIdi2kU7uGY

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapfly-web-crawl-endpoint-9f2610db -d '<json body>'
```

Example prompt: Can you crawl https://example.com/products and scrape up to 5 pages of content so I can see what products they list?

## When to prefer this

Choose this endpoint when you need to programmatically crawl and extract content from one or more pages of a website, especially when you need multi-page crawling (via maxPages) via a pay-per-request model on Base chain. Suitable for agents that need fresh web content without maintaining their own scraping infrastructure.

## Known failure modes

- Invalid or unreachable URL returns success: false
- Rate limiting or bot detection on target site may result in empty or blocked data
- maxPages exceeding available pages returns whatever pages are accessible
- Network timeouts for slow-loading sites
- Malformed URL input results in error response

## How this service works

69 endpoints for data, content generation, and web scraping. Pay per request via x402 on Base chain.

## Output

Returns a JSON object with a 'success' boolean and a 'data' object containing the scraped page content and structured data from the crawled URL(s).

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "url"
  },
  "maxPages": {
   "type": "number",
   "description": "maxPages"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "success"
 ],
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapfly-web-crawl-endpoint-9f2610db/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from scravfly.vercel.app](https://www.zero.xyz/host/scravfly.vercel.app/llms.txt)