# Semantic HTML Pruner with BM25 Budget Control

> Semantic HTML Pruner with BM25 Budget Control is a paid API for AI agents from whale-momentum.agentdiet.dev, paid per call via MPP, $0.001/call, status unknown (last checked 2026-10-23).

Fetches and distills a URL or raw HTML into clean Markdown, structured JSON, skeleton outline, or a BM25-ranked token-budget excerpt for AI agents

## Facts

- Endpoint: POST https://whale-momentum.agentdiet.dev/v1/semantic-html-pruner?utm_source=zero.xyz
- Price: $0.001/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-23
- Activations on Zero: 0
- Provider: whale-momentum.agentdiet.dev
- Website: https://whale-momentum.agentdiet.dev
- Canonical page: https://www.zero.xyz/c/whale-momentum-agentdiet-dev-semantic-html-pruner-with-bm25-budget-459a4404
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_h_FE9t4XDKUbWyZonEm2o

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability whale-momentum-agentdiet-dev-semantic-html-pruner-with-bm25-budget-459a4404 -d '<json body>'
```

Example prompt: Fetch the page at https://stripe.com/docs/payments and distill it into clean Markdown, keeping only the content relevant to 'payment intents', with a strict budget of 2000 tokens.

## When to prefer this

Choose this endpoint when an AI agent needs to consume web page content without exceeding LLM token limits — especially when BM25-ranked relevance filtering is needed to focus on a specific query topic. Prefer it over generic scrapers when compression ratio and cost savings need to be measurable, or when you need structured output modes (Markdown, JSON tables, skeleton) rather than raw HTML. Particularly valuable for agentic pipelines that process many pages and need ROI-provable token reduction.

## Known failure modes

- Invalid or unreachable URL returns an error status
- mode=budget without a query or max_tokens may return unfiltered output
- Raw HTML that is too large may exceed processing limits
- Payment failure via x402 returns HTTP 402 before processing
- Paywalled or JavaScript-rendered pages may yield incomplete distillation
- max_tokens set too low (below 20) is rejected by schema validation

## How this service works

Distill a URL or raw HTML payload with BM25 budget control (Live x402 v2, IETF MPP & MCP endpoint at https://whale-momentum.agentdiet.dev/v1/semantic-html-pruner)

## Output

Returns a JSON object containing the distilled content (Markdown text, structured JSON tables/metadata, skeleton outline, or BM25-ranked excerpt depending on mode), a status field, an roi_proof block showing raw vs distilled token counts, compression ratio, and estimated LLM cost saved, plus optional cache hit/miss metadata and billing details.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "minLength": 1,
   "description": "Target webpage URL to fetch and distill (or builtin://stripe-docs)"
  },
  "html": {
   "type": "string",
   "description": "Optional raw HTML string to distill directly without fetching"
  },
  "mode": {
   "enum": [
    "markdown",
    "structured",
    "skeleton",
    "budget"
   ],
   "type": "string",
   "default": "markdown",
   "description": "Distillation mode"
  },
  "query": {
   "type": "string",
   "description": "BM25 focus query when mode=budget"
  },
  "max_tokens": {
   "type": "integer",
   "minimum": 20,
   "description": "Strict token budget ceiling when mode=budget"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "status",
  "roi_proof",
  "data"
 ],
 "properties": {
  "data": {
   "type": "object",
   "description": "Distilled Markdown, structured JSON tables/metadata, skeleton outline, or BM25 budget excerpt."
  },
  "cache": {
   "type": "object",
   "properties": {
    "status": {
     "enum": [
      "HIT",
      "MISS"
     ],
     "type": "string"
    },
    "cache_key": {
     "type": "string"
    },
    "latency_ms": {
     "type": "number"
    }
   }
  },
  "status": {
   "type": "string",
   "description": "Execution status ('ok')"
  },
  "billing": {
   "type": "object",
   "properties": {
    "agent_id": {
     "type": "string"
    },
    "payment_method": {
     "type": "string"
    },
    "fee_charged_usd": {
     "type": "number"
    }
   }
  },
  "roi_proof": {
   "type": "object",
   "properties": {
    "raw_tokens": {
     "type": "integer"
    },
    "tokens_saved": {
     "type": "integer"
    },
    "roi_multiplier": {
     "type": "number"
    },
    "distilled_tokens": {
     "type": "integer"
    },
    "llm_cost_saved_usd": {
     "type": "number"
    },
    "compression_ratio_pct": {
     "type": "number"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/whale-momentum-agentdiet-dev-semantic-html-pruner-with-bm25-budget-459a4404/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from whale-momentum.agentdiet.dev](https://www.zero.xyz/host/whale-momentum.agentdiet.dev/llms.txt)