# AgentDiet Web Distiller — Compact Token Extraction from URLs

> AgentDiet Web Distiller — Compact Token Extraction from URLs is a paid API for AI agents from mcp-compiler.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-21).

Fetches a webpage (or accepts raw HTML) and distills it into compact, agent-ready tokens using BM25 budget control and multiple extraction modes (markdown, structured, skeleton, or budget).

## Facts

- Endpoint: GET https://mcp-compiler.agentdiet.dev/v1/web-scrape?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-21
- Activations on Zero: 0
- Provider: mcp-compiler.agentdiet.dev
- Website: https://mcp-compiler.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/mcp-compiler-agentdiet-dev-agentdiet-web-distiller-compact-token-974c8a65
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_N0yLXr2ftGiiF6b3N1Xpo

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability mcp-compiler-agentdiet-dev-agentdiet-web-distiller-compact-token-974c8a65
```

Example prompt: Distill https://stripe.com/docs/api into compact markdown tokens, keeping it under 2000 tokens using budget mode focused on the query 'payment intents'.

## When to prefer this

Choose this endpoint when you need to feed web content to an LLM but want to minimize token consumption and cost. It is especially valuable when the target page is long and you only need a focused excerpt (use BM25 budget mode with a query), or when you want structured JSON tables/metadata rather than raw HTML. Prefer it over generic scraping tools when token compression ratios and LLM cost savings are a priority, or when you need the output in a directly agent-consumable format (markdown, skeleton outline, or structured JSON).

## Known failure modes

- URL is unreachable or returns a non-200 HTTP response — endpoint may return an error status
- HTML too large or malformed — distillation may truncate or fail
- mode=budget without a query or max_tokens — may default to full markdown without focusing
- Payment (x402) not completed — returns HTTP 402 requiring USDC payment before proceeding
- Invalid URL format — schema requires minLength 1 but malformed URLs may cause fetch errors
- Rate limiting or timeout on slow external pages — latency spike or timeout error

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://mcp-compiler.agentdiet.dev/v1/web-scrape)

## Output

Returns a distilled version of the target webpage in the requested mode (markdown, structured JSON tables/metadata, skeleton outline, or BM25-focused budget excerpt), along with an ROI proof object showing raw vs. distilled token counts, compression ratio, tokens saved, and estimated LLM cost saved in USD. Also includes cache status and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/mcp-compiler-agentdiet-dev-agentdiet-web-distiller-compact-token-974c8a65/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from mcp-compiler.agentdiet.dev](https://www.zero.xyz/host/mcp-compiler.agentdiet.dev/llms.txt)