# Web URL Distillation & HTML Compression API

> Web URL Distillation & HTML Compression API is a paid API for AI agents from github-audit.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-21).

Fetches and compresses a web URL or raw HTML into compact agent-ready tokens using multiple distillation modes including BM25 budget-controlled extraction

## Facts

- Endpoint: GET https://github-audit.agentdiet.dev/v1/pdf-extract?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-21
- Activations on Zero: 0
- Provider: github-audit.agentdiet.dev
- Website: https://github-audit.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/github-audit-agentdiet-dev-web-url-distillation-html-compression-api-80b4fb6e
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_XA_bU2A2ZRkS-3vnm1OGq

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability github-audit-agentdiet-dev-web-url-distillation-html-compression-api-80b4fb6e
```

Example prompt: Can you fetch https://stripe.com/docs/payments and distill it into compact markdown — keep it under 1000 tokens and focus on payment intents?

## When to prefer this

Choose this endpoint when you need to pass web page content to an LLM but want to minimize token usage and cost. It is especially useful for agent pipelines that repeatedly fetch documentation, news, or data pages where full HTML would be too large. Prefer this over raw fetch + parse when you need built-in BM25 relevance filtering, structured table extraction, or a strict token budget ceiling. It is better than generic scrapers when compression ratio and LLM cost savings need to be measured and reported.

## Known failure modes

- URL is unreachable or returns non-200 — endpoint may return an error status
- HTML too large or malformed — may produce incomplete distillation
- mode=budget requires both query and max_tokens — missing either may degrade output
- Payment not processed (402) — call fails if x402 micropayment not settled
- Rate limiting or timeout on slow target URLs
- Builtin URL aliases like builtin://stripe-docs may be outdated

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://github-audit.agentdiet.dev/v1/pdf-extract)

## Output

Returns a distilled version of the web page in the requested format: clean Markdown, structured JSON with tables and metadata, a skeleton outline, or a BM25-ranked budget excerpt. Also includes ROI proof fields showing raw vs distilled token counts, compression ratio, estimated LLM cost saved, and caching metadata.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/github-audit-agentdiet-dev-web-url-distillation-html-compression-api-80b4fb6e/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from github-audit.agentdiet.dev](https://www.zero.xyz/host/github-audit.agentdiet.dev/llms.txt)