# Web URL to Agent-Ready Token Distillation (BM25 Budget)

> Web URL to Agent-Ready Token Distillation (BM25 Budget) is a paid API for AI agents from mcp-security.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-21).

Fetches and compresses a webpage (or raw HTML) into compact, agent-ready tokens using configurable distillation modes including BM25-focused budget extraction.

## Facts

- Endpoint: GET https://mcp-security.agentdiet.dev/v1/paywall-clean-extract?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-21
- Activations on Zero: 0
- Provider: mcp-security.agentdiet.dev
- Website: https://mcp-security.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/mcp-security-agentdiet-dev-web-url-to-agent-ready-token-distillation-83ee58f5
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_43vrBIkIqziBtUNuP4WKe

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability mcp-security-agentdiet-dev-web-url-to-agent-ready-token-distillation-83ee58f5
```

Example prompt: Fetch and distill https://docs.stripe.com/payments/quickstart into compact Markdown, then give me a budget excerpt focused on 'payment intents' keeping it under 500 tokens.

## When to prefer this

Choose this endpoint when an agent needs to read and process web pages without blowing through its context window or LLM token budget. It is especially useful when you need BM25-focused relevance filtering (mode=budget) to extract only the parts of a page relevant to a specific query, or when you want structured tables/metadata (mode=structured) or a section outline (mode=skeleton) rather than raw HTML. Prefer it over generic web scrapers when token cost reduction and ROI proof are important.

## Known failure modes

- Invalid or unreachable URL returns an error status
- URL behind a hard paywall or bot-blocking may return incomplete content
- max_tokens set below 20 is rejected as invalid
- mode=budget without a query may return unfiltered budget excerpt
- Very large HTML payloads may hit processing limits
- Network timeouts for slow-loading pages

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://mcp-security.agentdiet.dev/v1/paywall-clean-extract)

## Output

Returns a JSON object containing the distilled content (Markdown, structured tables/metadata, skeleton outline, or BM25-scored budget excerpt), along with ROI proof metrics showing raw vs. distilled token counts, compression ratio, tokens saved, and estimated LLM cost saved. Also includes cache hit/miss status and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/mcp-security-agentdiet-dev-web-url-to-agent-ready-token-distillation-83ee58f5/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from mcp-security.agentdiet.dev](https://www.zero.xyz/host/mcp-security.agentdiet.dev/llms.txt)