# Web URL to Markdown Distiller with BM25 Budget Control

> Web URL to Markdown Distiller with BM25 Budget Control is a paid API for AI agents from shopify-spy.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-21).

Fetches and distills any web URL or raw HTML into compact, agent-ready Markdown or structured output with optional BM25-ranked token budgeting

## Facts

- Endpoint: GET https://shopify-spy.agentdiet.dev/v1/url-to-markdown?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-21
- Activations on Zero: 0
- Provider: shopify-spy.agentdiet.dev
- Website: https://shopify-spy.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/shopify-spy-agentdiet-dev-web-url-to-markdown-distiller-with-bm25-651d151f
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_UYXI-DDygZeoqBfgcA9pq

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability shopify-spy-agentdiet-dev-web-url-to-markdown-distiller-with-bm25-651d151f
```

Example prompt: Fetch https://stripe.com/docs/payments and distill it into compact markdown using budget mode focused on the query 'payment intents', keeping it under 2000 tokens.

## When to prefer this

Choose this endpoint when you need to fetch and compress web content specifically to fit within an LLM context window, especially when token budgeting is critical. It excels over generic scrapers when you want BM25-ranked, query-focused excerpts rather than full page dumps. Prefer it when you need ROI telemetry (tokens saved, cost saved) or when you need multiple output modes (markdown, structured tables, skeleton, budget excerpt) from a single endpoint with per-call micropayment pricing via x402.

## Known failure modes

- Invalid or unreachable URL returns an error status
- HTML fetch timeout for slow or blocked websites
- mode=budget without a query or max_tokens may return unfiltered output
- Token budget set too low may result in empty or heavily truncated output
- Paywalled or bot-protected pages may return incomplete content
- Payment/x402 authorization failure if USDC balance is insufficient

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://shopify-spy.agentdiet.dev/v1/url-to-markdown)

## Output

Returns a JSON object containing the distilled content (Markdown, structured JSON, skeleton outline, or BM25-ranked excerpt depending on mode), a cache status object indicating HIT or MISS, billing details, and an ROI proof object showing raw token count, distilled token count, tokens saved, compression ratio percentage, and estimated LLM cost saved in USD.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/shopify-spy-agentdiet-dev-web-url-to-markdown-distiller-with-bm25-651d151f/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from shopify-spy.agentdiet.dev](https://www.zero.xyz/host/shopify-spy.agentdiet.dev/llms.txt)