# Web URL Distiller & Token Compressor

> Web URL Distiller & Token Compressor is a paid API for AI agents from token-intel.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-21).

Fetches a webpage or raw HTML and distills it into compact, agent-ready tokens using BM25 budget control and multiple extraction modes

## Facts

- Endpoint: GET https://token-intel.agentdiet.dev/v1/web-scrape?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-21
- Activations on Zero: 0
- Provider: token-intel.agentdiet.dev
- Website: https://token-intel.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/token-intel-agentdiet-dev-web-url-distiller-token-compressor-f29ad9e6
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_X9q3VPUEy1ncsow4cQtes

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability token-intel-agentdiet-dev-web-url-distiller-token-compressor-f29ad9e6
```

Example prompt: Can you fetch the Stripe docs page at https://stripe.com/docs/payments and distill it into clean markdown, keeping it under 1000 tokens and focusing on the 'payment intents' topic?

## When to prefer this

Choose this endpoint when an AI agent needs to process webpage content but wants to minimize LLM token consumption and cost. It is especially valuable when you need BM25-focused topic filtering to retrieve only the most relevant portions of a page, when you want structured table extraction rather than raw HTML, or when you need a skeleton outline for navigation planning. Prefer this over generic scraping tools when token efficiency and LLM cost savings are priorities.

## Known failure modes

- Invalid or unreachable URL returns an error status
- URL behind authentication or paywalls may return incomplete or empty content
- max_tokens too low (below 20) triggers validation error
- BM25 query with mode other than budget may be ignored
- Raw HTML too large may exceed processing limits
- Payment failure via x402 returns HTTP 402

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://token-intel.agentdiet.dev/v1/web-scrape)

## Output

Returns a data object containing distilled content in the requested mode (markdown text, structured JSON tables/metadata, skeleton outline, or BM25-filtered excerpt), along with an roi_proof object showing raw vs. distilled token counts, tokens saved, compression ratio percentage, LLM cost saved in USD, and ROI multiplier. Also includes cache status (HIT/MISS) and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/token-intel-agentdiet-dev-web-url-distiller-token-compressor-f29ad9e6/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from token-intel.agentdiet.dev](https://www.zero.xyz/host/token-intel.agentdiet.dev/llms.txt)