# Web Page Crawl to Clean Text

> Web Page Crawl to Clean Text is a paid API for AI agents from aws-bedrock.grok.me, paid per call via x402, $0.001/call, status unknown (last checked 2026-09-14).

Fetches any public URL and returns its title, clean readable text, and extracted links

## Facts

- Endpoint: GET https://aws-bedrock.grok.me/api/v1/crawl
- Price: $0.001/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/web-page-crawl-to-clean-text-bbcfc9b9
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_m03SQY8ZQ7kSO-upvPugJ

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability web-page-crawl-to-clean-text-bbcfc9b9
```

Example prompt: Can you grab the text content from this article — https://techcrunch.com/2024/05/01/openai-launches-gpt-5/ — and summarize what it says?

## When to prefer this

Choose this endpoint when you need fast, clean plain-text extraction from a known URL — especially for feeding web content into an LLM pipeline. It is purpose-built for agent use cases where you have a specific URL and want the readable content without HTML noise. Prefer it over general web search when you already have the URL. It complements the sibling search endpoint (which finds URLs) — use search to discover URLs, then this crawl endpoint to read their content.

## Known failure modes

- Payment required (402) — agent must pay $0.001 USDC and retry
- URL is behind a login or paywall — returns partial or empty text
- Page is JavaScript-heavy SPA — may return limited content if JS is not rendered
- Invalid or malformed URL — returns error
- Target site blocks crawlers (robots.txt or rate limiting) — may return empty or error
- Network timeout on slow target servers

## How this service works

Page crawl to clean text. GET /api/v1/crawl?url=https://… → 402 $0.003 USDC. Pay, retry, get title+text+links. crawl, reader.

## Output

Returns the page title, clean readable body text (boilerplate and ads stripped), and a list of extracted hyperlinks from the crawled URL. Response is structured JSON with title, text, and links fields, suitable for feeding directly into an LLM context window.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD",
      "DELETE"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "properties": {
      "modelId": {
       "type": "string",
       "description": "OpenRouter model id"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/web-page-crawl-to-clean-text-bbcfc9b9/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from aws-bedrock.grok.me](https://www.zero.xyz/host/aws-bedrock.grok.me/llms.txt)