# Web URL & HTML Distiller with BM25 Budget Control

> Web URL & HTML Distiller with BM25 Budget Control is a paid API for AI agents from alpha-stream.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-11-21).

Fetches and distills a URL or raw HTML into compact, token-efficient markdown, structured JSON, skeleton outlines, or BM25-focused budget excerpts with token savings proof.

## Facts

- Endpoint: POST https://alpha-stream.agentdiet.dev/v1/token-optimizer?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-11-21
- Activations on Zero: 0
- Provider: alpha-stream.agentdiet.dev
- Website: https://alpha-stream.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/alpha-stream-agentdiet-dev-web-url-html-distiller-with-bm25-budget-0f84f009
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_J6iJSpNPHtrLy8ysEusjU

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability alpha-stream-agentdiet-dev-web-url-html-distiller-with-bm25-budget-0f84f009 -d '<json body>'
```

Example prompt: Distill this URL https://stripe.com/docs/payments into clean markdown, but keep it under 2000 tokens and focus the BM25 budget on 'payment intents' so I don't blow up my context window.

## When to prefer this

Choose this endpoint when an AI agent needs to ingest web content while staying within strict token budgets — especially useful when feeding documentation, articles, or live pages into LLM prompts where cost and context length matter. Prefer it over raw web scraping when you need clean, compressed, LLM-ready output with built-in ROI measurement. The BM25 budget mode makes it uniquely suited when you want only the most query-relevant passages from a page, not the entire content.

## Known failure modes

- URL unreachable or returns non-200 — fetch failure with error status
- HTML too large or malformed — parser error or empty distillation
- max_tokens set below minimum of 20 — validation error
- query not provided when mode=budget — missing required field error
- Payment not included — HTTP 402 payment required response
- Invalid mode enum value — schema validation error

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://alpha-stream.agentdiet.dev/v1/token-optimizer)

## Output

Returns a JSON object containing the distilled content (markdown, structured tables/metadata, skeleton, or BM25 excerpt depending on mode), an ROI proof object showing raw token count, distilled token count, tokens saved, compression ratio percentage, and estimated LLM cost saved in USD, plus cache hit/miss status and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/alpha-stream-agentdiet-dev-web-url-html-distiller-with-bm25-budget-0f84f009/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from alpha-stream.agentdiet.dev](https://www.zero.xyz/host/alpha-stream.agentdiet.dev/llms.txt)
