# AgentDiet Web Distiller with BM25 Budget Control

> AgentDiet Web Distiller with BM25 Budget Control is a paid API for AI agents from defi-yield.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-23).

Fetches and distills a URL or raw HTML payload into compressed Markdown, structured JSON, skeleton outline, or BM25-focused token-budgeted excerpts for LLM cost savings

## Facts

- Endpoint: POST https://defi-yield.agentdiet.dev/api/diet?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-23
- Activations on Zero: 0
- Provider: defi-yield.agentdiet.dev
- Website: https://defi-yield.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/defi-yield-agentdiet-dev-agentdiet-web-distiller-with-bm25-budget-039a01c8
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_T6RrRVaVDPxSK7dS_1EZ7

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability defi-yield-agentdiet-dev-agentdiet-web-distiller-with-bm25-budget-039a01c8 -d '<json body>'
```

Example prompt: Fetch https://stripe.com/docs/payments and distill it into budget mode focused on 'payment intents' with a max of 500 tokens, so I can send just the relevant content to my LLM without blowing my context window.

## When to prefer this

Choose this endpoint when you need to feed webpage content into an LLM but want to minimize token usage and cost. It is especially valuable when working with long documentation pages, competitive intelligence, or any scenario where raw HTML would overwhelm the context window. The BM25 budget mode is uniquely suited for query-focused extraction with a hard token ceiling, which no generic scraper provides. Prefer this over raw fetch-and-parse pipelines when LLM cost efficiency and structured output are priorities.

## Known failure modes

- URL unreachable or returns non-200 — fetch fails with error status
- HTML too large or malformed — distillation may return partial content
- max_tokens set below minimum of 20 — validation error
- mode=budget used without a query parameter — may fall back to default behavior
- Payment failure via x402 — endpoint returns 402 Payment Required
- Invalid URL format — schema validation error on the url field

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://defi-yield.agentdiet.dev/api/diet)

## Output

Returns a distilled content payload (Markdown, structured JSON, skeleton, or BM25 excerpt), accompanied by an roi_proof object showing raw vs distilled token counts, compression ratio percentage, tokens saved, and estimated LLM cost saved in USD. Also includes cache status (HIT/MISS) and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/defi-yield-agentdiet-dev-agentdiet-web-distiller-with-bm25-budget-039a01c8/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from defi-yield.agentdiet.dev](https://www.zero.xyz/host/defi-yield.agentdiet.dev/llms.txt)