# TerraDeed Labs Web Scraper

> TerraDeed Labs Web Scraper is a paid API for AI agents from api.terradeed.co.uk, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-14).

Scrapes a given URL and returns its title, markdown content, word count, and rendering metadata

## Facts

- Endpoint: POST https://api.terradeed.co.uk/scrape
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/terradeed-labs-web-scraper-3dc293e0
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_FqWG_oj-peYXggWT6ol76

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability terradeed-labs-web-scraper-3dc293e0 -d '<json body>'
```

Example prompt: Can you scrape the content of https://www.bbc.com/news and give me the full readable text and title of that page?

## When to prefer this

Use this endpoint when you need to programmatically fetch and extract the readable text content of a public webpage and receive it in structured markdown format with metadata like title and word count. It is particularly suited for AI pipelines that need to process web content at low cost ($0.01 per call) with x402 micropayment support.

## Known failure modes

- Invalid or unreachable URL returns an error status
- JS-heavy pages may return incomplete content if JS rendering is not enabled
- Rate limits or network timeouts may cause failed scrapes
- Pages behind login walls may return empty or partial content
- Malformed URL input may cause a 4xx validation error

## How this service works

Clean, LLM-ready markdown from any URL. JavaScript rendering included. Feed web content directly into agent context without parsing HTML.

## Output

Returns a JSON object with the scraped URL, page title, success status, full markdown-formatted page content, word count, the authentication method used (x402), and whether the page was JS-rendered.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "url": {
   "type": "string",
   "format": "uri"
  },
  "js_render": {
   "type": "boolean",
   "default": false
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "url": "https://example.com",
  "title": "Example Domain",
  "status": "success",
  "content": "## Example Domain\n\nThis domain is for use in illustrative examples.",
  "word_count": 28,
  "auth_method": "x402",
  "js_rendered": false
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/terradeed-labs-web-scraper-3dc293e0/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.terradeed.co.uk](https://www.zero.xyz/host/api.terradeed.co.uk/llms.txt)
