# Agent Toolkit – URL Fetch / Web Scraper

> Agent Toolkit – URL Fetch / Web Scraper is a paid API for AI agents from agent-data.centorprat.workers.dev, paid per call via x402, $0.003/call, status unknown (last checked 2026-10-30).

Fetches any public URL and returns its content as text, markdown, base64-encoded binary, or raw HTML/JSON, including final redirect URL, status code, content type, and size.

## Facts

- Endpoint: GET https://agent-data.centorprat.workers.dev/web/fetch?utm_source=zero.xyz
- Price: $0.003/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-30
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/agent-toolkit-url-fetch-web-scraper-3f9a07b9
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_1XCpsaxt9Q8OK2t2rzz5U

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agent-toolkit-url-fetch-web-scraper-3f9a07b9
```

Example prompt: Can you fetch the content of https://example.com/report.pdf and give it to me as base64 so I can pass it to a multimodal model?

## When to prefer this

Choose this endpoint when you need to fetch and read the raw content of a single known URL — especially for feeding web content into LLM pipelines, converting pages to markdown for RAG, or retrieving binary files (PDFs, images) as base64. It is particularly useful when target sites block typical scrapers, since requests are routed through Cloudflare's edge network as a fallback. Prefer it over a search-and-scrape combined endpoint when you already know the exact URL you want.

## Known failure modes

- URL is not publicly accessible or requires authentication — returns an HTTP error status
- Content exceeds 5 MB limit — response is truncated or rejected
- Site actively blocks scraping even from Cloudflare edge — may return error or empty body
- Invalid or malformed URL — returns validation error
- Timeout on slow-loading pages — request may fail with timeout error

## How this service works

Pay-per-call data and tools for AI agents, $0.002-0.01 per call in USDC via x402 (Base, Polygon or Solana), no account or API key; MAX tiers ($0.05-0.25) run deeper jobs. Agent toolkit: web search, search + read top pages, any page as clean markdown with a prompt-injection check, which-x402-API-to-call recommender, seller check. Data: Google Maps places with contacts, YouTube video data and transcripts, job listings (Indeed, LinkedIn, 13 boards), Google Ads Transparency, TikTok comments, Pinterest, Airbnb, Redfin, AliExpress, app stores, live sports, website and SEO checks, Shopify store tech stacks, and onchain token / address risk checks.

## Output

Returns the fetched content as text, markdown, or base64 depending on the requested format and content type. Also includes the final URL after redirects, HTTP status code, content-type header, and content size in bytes. Up to 5 MB of content is supported. Error status responses are not billed.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD",
      "DELETE"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "Public http(s) URL"
      },
      "format": {
       "type": "string",
       "description": "auto (text for text types, base64 for binary) | text | base64 | markdown"
      },
      "max_bytes": {
       "type": "string",
       "description": "1000-5000000 (default 2000000)"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "url": "https://example.com",
  "status": 200,
  "content": "<!doctype html>...",
  "encoding": "text",
  "contentType": "text/html"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agent-toolkit-url-fetch-web-scraper-3f9a07b9/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agent-data.centorprat.workers.dev](https://www.zero.xyz/host/agent-data.centorprat.workers.dev/llms.txt)