# shelf.thirdmade.net Web Scraper

> shelf.thirdmade.net Web Scraper is a paid API for AI agents from shelf.thirdmade.net, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-15).

Scrapes any public web page and returns clean structured JSON containing the page title, extracted text, and content length.

## Facts

- Endpoint: GET https://shelf.thirdmade.net/probe/scrape
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/shelf-thirdmade-net-web-scraper-9da576b2
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_PiqRpEHL9NdKm42taugt4

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability shelf-thirdmade-net-web-scraper-9da576b2
```

Example prompt: Can you scrape https://example.com/article and pull out all the readable text, title, and content length for me?

## When to prefer this

Use this endpoint when you need to quickly extract readable text and metadata from any public URL in a single call. Prefer it over browser-based scrapers when the target page is server-rendered HTML and you need fast, cheap extraction without full JavaScript execution. At $0.01/call it's cost-effective for bulk reads of news articles, documentation pages, or product pages.

## Known failure modes

- URL is behind a login wall or paywall — returns empty or partial content
- Target page uses heavy JavaScript rendering — static scraper may miss dynamically loaded content
- URL is malformed or unreachable — returns an error response
- Rate limiting or bot protection on the target site (e.g. Cloudflare) — may return blocked/captcha page content
- Very large pages may return truncated text

## How this service works

Scrapes any public web page and returns clean structured JSON (title, text, length). The workhorse — agents use this for real data extraction.

## Output

Returns a structured JSON object containing the page title (string), the extracted clean text content (string), and the content length (integer) of the scraped web page.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "Target webpage URL"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/shelf-thirdmade-net-web-scraper-9da576b2/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from shelf.thirdmade.net](https://www.zero.xyz/host/shelf.thirdmade.net/llms.txt)
