# scrape-read-webpage-url-to-markdown

> scrape-read-webpage-url-to-markdown is a paid API for AI agents from obol-x402.fly.dev, paid per call via x402, $0.005/call, status down (last checked 2026-09-15).

Fetches any public webpage and returns the main content as clean markdown with the page title, stripping boilerplate, navigation, and ads using trafilatura.

## Facts

- Endpoint: GET https://obol-x402.fly.dev/v1/web/read
- Price: $0.005/call
- Payment: x402
- Status: down
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrape-read-webpage-url-to-markdown-b124d9c0
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_RI7I_XJVzENJ58SLCr-8q

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrape-read-webpage-url-to-markdown-b124d9c0
```

Example prompt: Can you fetch the main article text from https://www.bbc.com/news/technology-12345678 and give it to me as clean markdown, no ads or navigation — up to 10000 characters?

## When to prefer this

Use this endpoint when you need a clean, readable version of a specific public webpage without running a full browser or maintaining API keys. It is ideal for article reading, research pipelines, and content summarization workflows where boilerplate removal matters. Prefer this over raw HTTP fetch when you want human-readable markdown rather than raw HTML. Pair with a web search endpoint to first discover URLs and then read them. The x402 micropayment model means no account setup is required.

## Known failure modes

- JS-only pages that require a browser to render content return no text and are not charged
- Pages with no extractable main content return empty results and are not charged
- Invalid or non-public URLs return an error
- Network timeouts or unreachable hosts cause request failure
- Pages behind paywalls or authentication return partial or no content
- max_chars exceeded silently truncates output to the specified limit

## How this service works

Read any public webpage over x402 — clean reading-view extraction (trafilatura): boilerplate, nav and ads stripped, main text returned as markdown with the page title. JS-only or extraction-empty pages are NEVER charged. Pair with /v1/web/search. No API key, no account. GET ?url= [&max_chars=]. Free: GET /v1/web/read/preview. Cryptographically signed (Ed25519) — every response is independently verifiable via /.well-known/obol-pubkey.

## Output

A markdown-formatted string containing the page title and the main readable content of the webpage, with boilerplate, navigation, ads, and other non-content elements stripped. Responses are cryptographically signed with Ed25519 for independent verification. JS-only pages or pages where extraction yields no content are not charged.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD",
      "DELETE"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "public http(s) page to read"
      },
      "max_chars": {
       "type": "integer",
       "default": 20000
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrape-read-webpage-url-to-markdown-b124d9c0/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from obol-x402.fly.dev](https://www.zero.xyz/host/obol-x402.fly.dev/llms.txt)