# Tokenguard Web Crawl Endpoint

> Tokenguard Web Crawl Endpoint is a paid API for AI agents from eltociear-tokenguard.hf.space, paid per call via x402, $0.02/call, status unknown (last checked 2026-09-14).

Crawls one or more web pages and returns their content as structured markdown, titles, and word counts for AI agent consumption

## Facts

- Endpoint: POST https://eltociear-tokenguard.hf.space/web/crawl
- Price: $0.02/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/tokenguard-web-crawl-endpoint-0f34eb9b
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_8J0wTjeDDGxnTbBx40g58

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability tokenguard-web-crawl-endpoint-0f34eb9b -d '<json body>'
```

Example prompt: Can you crawl https://example.com/docs up to 5 pages deep and give me the full markdown content and titles of whatever you find?

## When to prefer this

Use this endpoint when you need to fetch and extract readable text content from one or more web pages as structured markdown, especially for documentation, articles, or reference sites. Prefer it over generic search when you already know the URL and need the full page body rather than a snippet.

## Known failure modes

- Target URL is unreachable or returns non-200 status — pages array may be empty or partial
- Crawl depth or page limit not respected if site blocks crawlers via robots.txt
- Markdown extraction fails on heavily JavaScript-rendered pages — returns empty or incomplete markdown
- Payment of $0.02 USDC not fulfilled — request rejected with payment-required error
- Rate limiting if too many concurrent crawl requests are made

## How this service works

Crawl a site from a start URL (same-domain, breadth-first) and return each page as clean Markdown

## Output

Returns a JSON object with an 'ok' count, a 'start_url', a 'pages_fetched' integer, and a 'pages' array where each entry contains the page URL, depth, title, markdown body, and word count.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "url": {
   "type": "string",
   "format": "uri",
   "description": "Start URL"
  },
  "max_pages": {
   "type": "integer",
   "description": "1-10 pages (default 5)"
  },
  "include_links": {
   "type": "boolean",
   "description": "Keep hyperlinks (default true)"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "ok": 5,
  "pages": [
   {
    "url": "https://example.com/docs",
    "depth": 0,
    "title": "Docs",
    "markdown": "# Docs…",
    "word_count": 800
   }
  ],
  "start_url": "https://example.com/docs",
  "pages_fetched": 5
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/tokenguard-web-crawl-endpoint-0f34eb9b/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from eltociear-tokenguard.hf.space](https://www.zero.xyz/host/eltociear-tokenguard.hf.space/llms.txt)