# x402-deployer Web Scraper

> x402-deployer Web Scraper is a paid API for AI agents from x402-deployer.x402-deployer.workers.dev, paid per call via x402, $0.04/call, status unknown (last checked 2026-09-14).

Scrapes a webpage and returns its title, description, metadata, headings, body content, and outbound links using Cheerio (no headless browser)

## Facts

- Endpoint: POST https://x402-deployer.x402-deployer.workers.dev/scrape-website
- Price: $0.04/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/x402-deployer-x402-deployer-workers-dev-fc17f02d
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_O9FR7TgYoeGyBx9NkxgoB

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability x402-deployer-x402-deployer-workers-dev-fc17f02d -d '<json body>'
```

Example prompt: Scrape https://example.com/blog/post-1 for me and return the page title, meta description, OpenGraph tags, all headings, and the body content as clean markdown, with outbound links included.

## When to prefer this

Use this endpoint for static pages, server-side rendered sites, and any page where content is present in the raw HTML response. It is fast and cost-effective at $0.04/call. Avoid it for JavaScript-heavy single-page applications that require a real browser to render content — use a headless browser screenshot service instead.

## Known failure modes

- URL is unreachable or returns non-200 status — error response with HTTP status code
- JS-heavy SPA with client-side rendering — content may be empty or incomplete since no headless browser is used
- Malformed or non-HTTP URL — validation error
- Rate limiting or bot protection on target site — may return partial or blocked content
- Very large pages may time out on the Cloudflare Worker execution limit

## How this service works

Scrape any webpage. Pulls title, description, canonical URL, OpenGraph + Twitter card metadata, headings, and outbound links from a single URL. Server-side rendering. Body content rendered as text / raw HTML / clean markdown. Optional link extraction. Cheerio-based, no headless browser — fast and cheap, ideal for static pages and SSR sites. For JS-heavy SPAs that need a real browser, see website-screenshot.

## Output

Returns structured data including the page title, meta description, canonical URL, OpenGraph and Twitter card metadata, an array of headings, the body rendered as text/HTML/markdown (depending on requested format), and a list of outbound links found on the page.

## Example request

```json
{
 "input": {
  "body": {
   "url": "https://example.com",
   "format": "markdown",
   "include_links": true
  },
  "type": "http",
  "method": "POST",
  "bodyType": "json"
 }
}
```

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method",
    "bodyType",
    "body"
   ],
   "properties": {
    "body": {
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "Public URL to fetch and parse. Must include scheme (http/https). Follows redirects."
      },
      "format": {
       "enum": [
        "text",
        "html",
        "markdown"
       ],
       "type": "string",
       "description": "Body output format. 'text' (default, plain text), 'html' (raw HTML body), or 'markdown' (clean markdown — best for LLM ingestion)."
      },
      "user_agent": {
       "type": "string",
       "description": "Custom User-Agent header. Defaults to a modern desktop Chrome UA."
      },
      "include_links": {
       "type": "boolean",
       "description": "If true, also returns an array of all <a href> links found on the page. Default false."
      }
     }
    },
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "POST"
     ],
     "type": "string"
    },
    "bodyType": {
     "enum": [
      "json",
      "form-data",
      "text"
     ],
     "type": "string"
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object",
     "properties": {
      "h1": {
       "type": "string"
      },
      "og": {
       "type": "object",
       "properties": {}
      },
      "url": {
       "type": "string"
      },
      "lang": {
       "type": "string"
      },
      "text": {
       "type": "string"
      },
      "title": {
       "type": "string"
      },
      "format": {
       "type": "string"
      },
      "twitter": {
       "type": "object",
       "properties": {}
      },
      "canonical": {
       "type": "null"
      },
      "final_url": {
       "type": "string"
      },
      "body_chars": {
       "type": "integer"
      },
      "description": {
       "type": "string"
      },
      "status_code": {
       "type": "integer"
      }
     }
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/x402-deployer-x402-deployer-workers-dev-fc17f02d/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from x402-deployer.x402-deployer.workers.dev](https://www.zero.xyz/host/x402-deployer.x402-deployer.workers.dev/llms.txt)