# Web Content Distiller with BM25 Budget Control

> Web Content Distiller with BM25 Budget Control is a paid API for AI agents from cve-intel.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-23).

Fetches and distills a URL or raw HTML into compact Markdown, structured JSON, a skeleton outline, or a BM25-ranked token-budget excerpt

## Facts

- Endpoint: POST https://cve-intel.agentdiet.dev/v1/context-bloat-eliminator?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-23
- Activations on Zero: 0
- Provider: cve-intel.agentdiet.dev
- Website: https://cve-intel.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/cve-intel-agentdiet-dev-web-content-distiller-with-bm25-budget-control-99c9bc6e
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_p7S3cqKUmZupcRxv0Ev5n

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability cve-intel-agentdiet-dev-web-content-distiller-with-bm25-budget-control-99c9bc6e -d '<json body>'
```

Example prompt: Fetch the page at https://stripe.com/docs/api/charges and distill it using budget mode with the query 'charge creation parameters' and a max of 500 tokens, so I can fit the relevant section into my prompt without blowing my context window.

## When to prefer this

Choose this endpoint when you need to reduce token consumption before passing web content to an LLM, especially when the source page is large or noisy. It is ideal when you have a specific focus query (BM25 mode) and a hard token budget ceiling, or when you need structured JSON tables extracted from HTML rather than raw text. Prefer it over generic scrapers when ROI tracking (tokens saved, cost saved) is important, or when you need consistent Markdown output from arbitrary URLs at low cost ($0.001/call).

## Known failure modes

- URL unreachable or returns non-200 status — endpoint may return an error status
- HTML payload is empty or malformed — distillation may produce empty or degraded output
- mode=budget used without a query field — BM25 ranking cannot proceed without a focus query
- max_tokens set below meaningful content threshold (minimum 20) — may produce truncated or empty excerpts
- Rate limiting or payment failure (HTTP 402) if USDC balance is insufficient
- Idempotency-Key collision if the same key is reused for a different request

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://cve-intel.agentdiet.dev/v1/context-bloat-eliminator)

## Output

Returns a 'data' object containing the distilled content in the requested format (Markdown text, structured JSON tables/metadata, skeleton outline, or BM25-ranked excerpt), plus an 'roi_proof' object showing raw token count, distilled token count, tokens saved, compression ratio percentage, estimated LLM cost saved in USD, and ROI multiplier. Also includes optional cache status (HIT/MISS) and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/cve-intel-agentdiet-dev-web-content-distiller-with-bm25-budget-control-99c9bc6e/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from cve-intel.agentdiet.dev](https://www.zero.xyz/host/cve-intel.agentdiet.dev/llms.txt)