# Web Scraping API – Fetch Any URL as Clean Text or Markdown

> Web Scraping API – Fetch Any URL as Clean Text or Markdown is a paid API for AI agents from agent-data-tools.revmesh2074.workers.dev, paid per call via x402, $0.002/call, status unknown (last checked 2026-11-22).

Fetches any public static web page and returns its main content as clean text or structured Markdown, stripped of boilerplate, ready for LLM/RAG consumption.

## Facts

- Endpoint: GET https://agent-data-tools.revmesh2074.workers.dev/scrape?utm_source=zero.xyz
- Price: $0.002/call
- Payment: x402
- Status: unknown
- Last checked: 2026-11-22
- Activations on Zero: 0
- Provider: agent-data-tools.revmesh2074.workers.dev
- Website: https://agent-data-tools.revmesh2074.workers.dev
- Tags: x402
- Canonical page: https://www.zero.xyz/c/agent-data-tools-revmesh2074-workers-dev-web-scraping-api-fetch-any-16edd8f5
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_986iBSw2AJzHYfhmraYBe

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agent-data-tools-revmesh2074-workers-dev-web-scraping-api-fetch-any-16edd8f5
```

Example prompt: Can you fetch the content of https://docs.python.org/3/library/asyncio.html and give it to me as clean markdown so I can drop it into my context window?

## When to prefer this

Use this endpoint when you need to read a known public static URL (HTML, Markdown, plain text) and get its main content quickly and cheaply. Ideal for reading articles, documentation, and product pages in LLM/RAG pipelines. Prefer this over browser-based renderers when the page does not require JavaScript execution. Use /extract/rendered for JS-heavy SPAs. At $0.002/call with no charge for failed fetches, it is cost-effective for high-volume agent workflows.

## Known failure modes

- Bot wall or CAPTCHA detected — page returns empty content (not charged)
- URL is invalid or unreachable — HTTP error returned
- JavaScript-rendered page returns empty body — use /extract/rendered instead
- Content exceeds maxChars — response is truncated with truncated:true flag
- Page returns non-HTML content type — may produce unexpected output

## How this service works

Web scraping API: fetch any public web page URL and get its main content as clean text or Markdown (headings, code blocks, tables and links kept), ready for an LLM, RAG or an agent's context; static HTML, Markdown or text pages, up to 100,000 characters. JavaScript-rendered pages: /extract/rendered. Empty pages, bot walls and errors are never charged. Use to read articles, docs and product pages at scale.

## Output

Returns a JSON object containing the page title, cleaned body text and/or markdown, extracted headings, code blocks, tables, links, page language, content hash, fetch timestamp, truncation flag, source metadata (authors, dates), and any warnings. The `finalUrl` reflects any redirects followed.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "Absolute http(s) URL of the page to scrape"
  },
  "format": {
   "enum": [
    "text",
    "markdown",
    "both"
   ],
   "type": "string",
   "description": "Returned representation: text (default), markdown, or both"
  },
  "section": {
   "type": "string",
   "description": "Optional visible HTML ID within the main content, 1-500 characters; a leading # (a docs link's fragment) or a URL ending in #id is accepted, and so is a heading's visible text when exactly one heading matches; leave it out to read the whole page"
  },
  "maxChars": {
   "type": "integer",
   "description": "Maximum characters of body text to return (500-100000, default 20000)"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "url": {
   "type": "string"
  },
  "lang": {
   "type": "string"
  },
  "text": {
   "type": "string"
  },
  "links": {
   "type": "array",
   "items": {}
  },
  "title": {
   "type": "string"
  },
  "format": {
   "type": "string"
  },
  "status": {
   "type": "number"
  },
  "tables": {
   "type": "array",
   "items": {}
  },
  "section": {},
  "finalUrl": {
   "type": "string"
  },
  "headings": {
   "type": "array",
   "items": {
    "type": "object",
    "properties": {
     "id": {},
     "text": {
      "type": "string"
     },
     "level": {
      "type": "number"
     }
    }
   }
  },
  "warnings": {
   "type": "array",
   "items": {}
  },
  "canonical": {},
  "fetchedAt": {
   "type": "string"
  },
  "truncated": {
   "type": "boolean"
  },
  "codeBlocks": {
   "type": "array",
   "items": {}
  },
  "hashFormat": {
   "type": "string"
  },
  "textLength": {
   "type": "number"
  },
  "contentHash": {
   "type": "string"
  },
  "contentType": {
   "type": "string"
  },
  "description": {},
  "linkBaseUrl": {
   "type": "string"
  },
  "sourceFormat": {
   "type": "string"
  },
  "sourceMetadata": {
   "type": "object",
   "properties": {
    "dates": {
     "type": "array",
     "items": {}
    },
    "authors": {
     "type": "array",
     "items": {}
    },
    "truncated": {
     "type": "boolean"
    },
    "verification": {
     "type": "string"
    }
   }
  },
  "contentSelection": {
   "type": "string"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agent-data-tools-revmesh2074-workers-dev-web-scraping-api-fetch-any-16edd8f5/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agent-data-tools.revmesh2074.workers.dev](https://www.zero.xyz/host/agent-data-tools.revmesh2074.workers.dev/llms.txt)
