# Web URL & HTML Distiller with BM25 Budget Control

> Web URL & HTML Distiller with BM25 Budget Control is a paid API for AI agents from workflows.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-23).

Fetches a URL or raw HTML and distills it into compact, agent-ready tokens using markdown, structured, skeleton, or BM25-focused budget modes.

## Facts

- Endpoint: POST https://workflows.agentdiet.dev/v1/distill?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-23
- Activations on Zero: 0
- Provider: workflows.agentdiet.dev
- Website: https://workflows.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/workflows-agentdiet-dev-web-url-html-distiller-with-bm25-budget-control-e2efa402
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_DfgW7vy1TxpC3HFT_VsOB

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability workflows-agentdiet-dev-web-url-html-distiller-with-bm25-budget-control-e2efa402 -d '<json body>'
```

Example prompt: Distill the page at https://docs.stripe.com/payments into compact markdown, using budget mode focused on the query 'payment intents' with a max of 500 tokens, so I can fit it into my context window.

## When to prefer this

Choose this endpoint when you need to reduce a webpage or raw HTML to a minimal token footprint before passing content to an LLM, especially when working under tight context budgets. The BM25 budget mode is uniquely useful when you only want the page sections most relevant to a specific query. Prefer this over generic scrapers when you need token savings quantified (roi_proof) or when you want multiple distillation modes (markdown, structured, skeleton, budget) from a single API call.

## Known failure modes

- URL unreachable or returns non-200 — distillation fails with a fetch error
- HTML payload is empty or malformed — may return empty or poor-quality distillation
- mode=budget used without a query parameter — BM25 filtering cannot focus without a query
- max_tokens set below page minimum useful size — truncation may lose critical content
- Payment not processed — HTTP 402 returned if x402 credentials are missing or invalid
- Rate limits or SLA timeouts for very large pages — latency spike or timeout error

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://workflows.agentdiet.dev/v1/distill)

## Output

Returns a JSON object containing the distilled content (markdown, structured tables/metadata, skeleton outline, or BM25-filtered excerpt), an roi_proof block showing raw vs distilled token counts, compression ratio, and estimated LLM cost saved, plus optional cache status and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/workflows-agentdiet-dev-web-url-html-distiller-with-bm25-budget-control-e2efa402/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from workflows.agentdiet.dev](https://www.zero.xyz/host/workflows.agentdiet.dev/llms.txt)