# ScrapFly Broken URL Crawler

> ScrapFly Broken URL Crawler is a paid API for AI agents from test-scrapfly.orbonomy.xyz, paid per call via x402, $0.02/call, status unknown (last checked 2026-10-20).

Crawls a given URL and follows up to a specified number of links, returning structured crawl data including detection of broken or inaccessible pages

## Facts

- Endpoint: POST https://test-scrapfly.orbonomy.xyz/api/crawl/broken?utm_source=zero.xyz
- Price: $0.02/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-20
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapfly-broken-url-crawler-c89483b6
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_odhiQR2lCUpculOQAFcMx

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapfly-broken-url-crawler-c89483b6 -d '<json body>'
```

Example prompt: Can you crawl https://example.com for me using ScrapFly and follow up to 10 links to find any broken or inaccessible pages?

## When to prefer this

Use this endpoint when you need to crawl a specific URL and detect broken or problematic links within a bounded link depth, paid per-request via x402 on Base chain. Prefer this over general scraping endpoints when the goal is link validation or broken page detection rather than pure content extraction.

## Known failure modes

- Invalid or malformed URL returns success:false
- URL is unreachable or returns non-2xx status
- maxLinks set to 0 or negative causes no links to be followed
- Target site blocks scraping bots, returning empty or error data
- Payment insufficient or x402 transaction fails on Base chain
- Timeout if target URL takes too long to respond

## How this service works

69 endpoints for data, content generation, and web scraping. Pay per request via x402 on Base chain.

## Output

Returns a JSON object with a 'success' boolean indicating whether the crawl succeeded, and a 'data' object containing structured crawl results such as link status, page content, or broken link information discovered during the crawl.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "url"
  },
  "maxLinks": {
   "type": "number",
   "description": "maxLinks"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "success"
 ],
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapfly-broken-url-crawler-c89483b6/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from test-scrapfly.orbonomy.xyz](https://www.zero.xyz/host/test-scrapfly.orbonomy.xyz/llms.txt)