# Web Content Distiller with BM25 Budget Control

> Web Content Distiller with BM25 Budget Control is a paid API for AI agents from email-verify.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-11-21).

Fetches and distills a URL or raw HTML into compressed Markdown, structured JSON, skeleton outline, or BM25-focused budget excerpt with token savings proof

## Facts

- Endpoint: POST https://email-verify.agentdiet.dev/v1/token-optimizer?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-11-21
- Activations on Zero: 0
- Provider: email-verify.agentdiet.dev
- Website: https://email-verify.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/email-verify-agentdiet-dev-web-content-distiller-with-bm25-budget-634aa3ea
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_gCEJcbllUAbnxE_DGdJE6

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability email-verify-agentdiet-dev-web-content-distiller-with-bm25-budget-634aa3ea -d '<json body>'
```

Example prompt: Grab the content from https://stripe.com/docs/api and distill it down to 500 tokens in budget mode, focusing the BM25 query on 'payment intents', so I can feed just the relevant parts to my LLM without blowing my context window.

## When to prefer this

Choose this endpoint when you need to compress web content before passing it to an LLM to reduce token usage and cost. It is especially valuable when working with large documentation pages, news articles, or HTML dumps where only a portion is relevant to a query (use budget+BM25 mode). Prefer it over raw scraping when you need clean, LLM-ready output rather than raw HTML. The built-in ROI proof makes it easy to audit token savings across agent runs.

## Known failure modes

- URL is unreachable or returns non-200 status — endpoint may return an error status
- HTML payload is empty or malformed — distillation may produce minimal output
- max_tokens set too low (below 20) — rejected by schema validation
- BM25 query not provided when mode=budget — may fall back to default behavior
- Payment not attached or insufficient — HTTP 402 returned blocking execution
- URL is a non-HTML resource (PDF, image) — distillation quality may degrade
- Rate limiting or timeout on target URL fetch — slow or failed response

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://email-verify.agentdiet.dev/v1/token-optimizer)

## Output

Returns a JSON object with a 'data' field containing the distilled content (Markdown text, structured JSON tables, skeleton outline, or BM25-focused excerpt depending on mode), plus an 'roi_proof' object showing raw_tokens, distilled_tokens, tokens_saved, compression_ratio_pct, roi_multiplier, and llm_cost_saved_usd. Also includes optional cache hit/miss status and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/email-verify-agentdiet-dev-web-content-distiller-with-bm25-budget-634aa3ea/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from email-verify.agentdiet.dev](https://www.zero.xyz/host/email-verify.agentdiet.dev/llms.txt)
