# x402.orth.sh ScrapeGraphAI Website Crawler

> x402.orth.sh ScrapeGraphAI Website Crawler is a paid API for AI agents from x402.orth.sh, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-14).

Crawls a website starting from a seed URL, following links up to a configurable depth and page count, returning multi-format scraped content.

## Facts

- Endpoint: POST https://x402.orth.sh/scrapegraphai/api/crawl
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/x402-orth-sh-scrapegraphai-website-crawler-3c23ad6e
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_QmCyLrcaP5N_yP2VqMyE0

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability x402-orth-sh-scrapegraphai-website-crawler-3c23ad6e -d '<json body>'
```

Example prompt: Crawl https://docs.example.com starting from the homepage, go up to 3 levels deep, scrape at most 200 pages, only follow internal links, and return the content in markdown format.

## When to prefer this

Choose this endpoint when you need to crawl multiple pages of a website by following links from a seed URL, rather than scraping a single known URL. Ideal for documentation sites, knowledge bases, or any multi-page content collection task where you don't know all URLs in advance. Use the LLM-driven extraction sibling endpoint instead if you need AI-structured output from a single known URL.

## Known failure modes

- Seed URL is unreachable or returns non-200 status — crawl fails with an error
- maxPages exceeds 1000 — validation error returned
- maxDepth set too high causing timeout on large sites
- External links followed unexpectedly if allowExternal is true, leading to large crawl scope
- excludePatterns/includePatterns misconfigured leading to missed or excess pages
- Payment of $0.01 USDC not provided or rejected — 402 error returned

## How this service works

Start a website crawl from a seed URL with configurable depth and page limits.

## Output

Returns scraped content from all discovered and crawled pages within the configured depth and page limits, in the requested output formats (e.g. markdown, HTML, JSON), subject to include/exclude URL pattern filters.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "url": {
   "type": "string",
   "description": "Seed URL to crawl"
  },
  "formats": {
   "type": "array",
   "description": "Output formats"
  },
  "maxDepth": {
   "type": "number",
   "description": "Max crawl depth (default 2)"
  },
  "maxPages": {
   "type": "number",
   "description": "Max pages (1-1000, default 50)"
  },
  "fetchConfig": {
   "type": "object",
   "description": "Fetch options"
  },
  "contentTypes": {
   "type": "array",
   "description": "Allowed content types"
  },
  "allowExternal": {
   "type": "boolean",
   "description": "Follow external links (default false)"
  },
  "excludePatterns": {
   "type": "array",
   "description": "URL patterns to exclude"
  },
  "includePatterns": {
   "type": "array",
   "description": "URL patterns to include"
  },
  "maxLinksPerPage": {
   "type": "number",
   "description": "Max links per page (default 10)"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/x402-orth-sh-scrapegraphai-website-crawler-3c23ad6e/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from x402.orth.sh](https://www.zero.xyz/host/x402.orth.sh/llms.txt)