# RAG Diet – URL/HTML Distillation with BM25 Budget Control

> RAG Diet – URL/HTML Distillation with BM25 Budget Control is a paid API for AI agents from email-verify.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-11-21).

Fetches and distills a URL or raw HTML payload into compressed Markdown, structured JSON, skeleton outline, or a BM25-ranked token-budgeted excerpt optimized for LLM consumption.

## Facts

- Endpoint: POST https://email-verify.agentdiet.dev/v1/rag-diet?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-11-21
- Activations on Zero: 0
- Provider: email-verify.agentdiet.dev
- Website: https://email-verify.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/email-verify-agentdiet-dev-rag-diet-url-html-distillation-with-bm25-4134afca
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_WXiYoAFdmXkp_urj96ylQ

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability email-verify-agentdiet-dev-rag-diet-url-html-distillation-with-bm25-4134afca -d '<json body>'
```

Example prompt: Distill https://stripe.com/docs/payments into clean markdown, and if that's too long, use budget mode with the query 'payment intents' and a max of 2000 tokens so it fits in my LLM context window.

## When to prefer this

Choose this endpoint when you need to compress web content or raw HTML to fit within LLM token budgets, especially when you need ROI metrics on token savings. It is ideal for RAG pipelines where you want BM25-ranked relevance filtering against a specific query rather than naively truncating text. Prefer it over generic scrapers when you need multiple output modes (markdown, structured, skeleton) from a single service with built-in cost accounting.

## Known failure modes

- URL is unreachable or returns a non-200 status — endpoint may return an error status
- HTML payload is empty or malformed — distillation returns minimal or no content
- max_tokens set too low (below 20) — rejected by schema validation
- query field missing when mode=budget — BM25 ranking cannot be applied
- Rate limiting or payment failure via x402 — HTTP 402 returned if payment is not resolved
- Cache miss on first call may add latency compared to subsequent cached calls

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://email-verify.agentdiet.dev/v1/rag-diet)

## Output

Returns a data object containing the distilled content (Markdown, structured JSON, skeleton, or BM25 excerpt), an roi_proof block with raw_tokens, distilled_tokens, tokens_saved, compression_ratio_pct, roi_multiplier, and llm_cost_saved_usd, plus optional cache status (HIT/MISS) and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/email-verify-agentdiet-dev-rag-diet-url-html-distillation-with-bm25-4134afca/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from email-verify.agentdiet.dev](https://www.zero.xyz/host/email-verify.agentdiet.dev/llms.txt)
