# x402-deployer Web Scraper

> x402-deployer Web Scraper is a paid API for AI agents from x402-deployer.x402-deployer.workers.dev, paid per call via x402, $0.04/call, status unknown (last checked 2026-09-15).

Scrapes a webpage and returns its title, description, metadata, headings, links, and body content as text, HTML, or markdown using Cheerio (no headless browser).

## Facts

- Endpoint: POST https://x402-deployer.x402-deployer.workers.dev/scrape
- Price: $0.04/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 1
- Tags: x402
- Canonical page: https://www.zero.xyz/c/x402-deployer-x402-deployer-workers-dev-56f71c1a
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_hAHU0XIVQPidV_88YO7B4

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability x402-deployer-x402-deployer-workers-dev-56f71c1a -d '<json body>'
```

Example prompt: Scrape https://example.com/blog/my-article for me and give me the title, meta description, OpenGraph tags, all headings, and the body content as clean markdown, plus any outbound links.

## When to prefer this

Use this endpoint when you need fast, cheap extraction of metadata and content from static or SSR-rendered pages. Prefer this over a headless browser solution (like website-screenshot) when you don't need JavaScript execution — it's significantly faster and more cost-effective. Best for SEO metadata extraction, content summarization pipelines, link analysis, and markdown conversion of standard HTML pages.

## Known failure modes

- URL is unreachable or returns non-200 status — error response with HTTP status code
- JavaScript-heavy SPA content not rendered — returns empty or partial content since no headless browser is used
- Invalid or malformed URL input — validation error returned
- Rate limiting or bot-blocking by target site — may return incomplete or blocked response
- Timeout on slow-loading pages — partial or error response

## How this service works

Scrape any webpage. Pulls title, description, canonical URL, OpenGraph + Twitter card metadata, headings, and outbound links from a single URL. Server-side rendering. Body content rendered as text / raw HTML / clean markdown. Optional link extraction. Cheerio-based, no headless browser — fast and cheap, ideal for static pages and SSR sites. Alias of scrape-website. For JS-heavy SPAs that need a real browser, see website-screenshot.

## Output

Returns structured data including page title, meta description, canonical URL, OpenGraph and Twitter card metadata, heading hierarchy, outbound links, and body content in the requested format (plain text, raw HTML, or clean markdown).

## Example request

```json
{
 "input": {
  "body": {
   "url": "https://example.com",
   "format": "markdown",
   "include_links": true
  },
  "type": "http",
  "method": "POST",
  "bodyType": "json"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/x402-deployer-x402-deployer-workers-dev-56f71c1a/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from x402-deployer.x402-deployer.workers.dev](https://www.zero.xyz/host/x402-deployer.x402-deployer.workers.dev/llms.txt)
