# Paywall-Clean-Extract: Web Distillation with BM25 Budget Control

> Paywall-Clean-Extract: Web Distillation with BM25 Budget Control is a paid API for AI agents from email-verify.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-11-21).

Fetches and distills a URL or raw HTML payload into clean Markdown, structured JSON, skeleton outline, or BM25-focused token-budget excerpt, with ROI proof of tokens saved.

## Facts

- Endpoint: POST https://email-verify.agentdiet.dev/v1/paywall-clean-extract?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-11-21
- Activations on Zero: 0
- Provider: email-verify.agentdiet.dev
- Website: https://email-verify.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/email-verify-agentdiet-dev-paywall-clean-extract-web-distillation-a35d2ca1
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap__gBAnm6rR-f0F-iM76l98

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability email-verify-agentdiet-dev-paywall-clean-extract-web-distillation-a35d2ca1 -d '<json body>'
```

Example prompt: Distill https://stripe.com/docs/payments/checkout into clean markdown using budget mode, focused on 'payment integration steps', and cap the output at 500 tokens so I can feed it to my LLM cheaply.

## When to prefer this

Choose this endpoint when you need to feed web content into an LLM but want to minimize token costs through intelligent compression. Especially valuable when using budget mode with a BM25 query to extract only the most relevant sections of a long page matching your topic. Prefer it over raw HTML fetching or generic scrapers when you need ROI proof of tokens saved, structured output modes (Markdown, JSON tables, skeleton), or when processing paywalled or noisy pages that need cleaning.

## Known failure modes

- URL unreachable or returns non-200 response — distillation cannot proceed
- Invalid or empty HTML string provided when using html parameter — returns error
- max_tokens set below minimum of 20 — validation error
- mode=budget used without a query parameter — BM25 focus query missing
- Payment via x402 fails or is insufficient — 402 response blocks execution
- Idempotency-Key reuse with different parameters — may return cached prior result unexpectedly

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://email-verify.agentdiet.dev/v1/paywall-clean-extract)

## Output

Returns a JSON object with a 'data' field containing the distilled content (Markdown string, structured JSON tables/metadata, skeleton outline, or BM25-focused excerpt depending on mode), plus an 'roi_proof' object showing raw_tokens, distilled_tokens, tokens_saved, compression_ratio_pct, roi_multiplier, and llm_cost_saved_usd. Also includes cache status (HIT/MISS), billing info, and an execution status string.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/email-verify-agentdiet-dev-paywall-clean-extract-web-distillation-a35d2ca1/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from email-verify.agentdiet.dev](https://www.zero.xyz/host/email-verify.agentdiet.dev/llms.txt)
