# Bytemine Batch URL Scraper

> Bytemine Batch URL Scraper is a paid API for AI agents from x402.orthogonal.com, paid per call via x402, $0.03/call, status unknown (last checked 2026-09-13).

Scrapes up to 100 URLs in parallel and returns markdown content, metadata, and tech stack information for each URL.

## Facts

- Endpoint: POST https://x402.orthogonal.com/bytemine/crawl/batch
- Price: $0.03/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-13
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/bytemine-batch-url-scraper-b3042769
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_w9BOkvysoljAZzFI32N4N

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability bytemine-batch-url-scraper-b3042769 -d '<json body>'
```

Example prompt: Scrape these 5 URLs for me in parallel and give me the markdown content, page metadata, and tech stack for each: https://example.com, https://acme.com, https://widget.io, https://startup.co, https://demo.app

## When to prefer this

Choose this endpoint when you need to scrape more than one URL at a time and want parallel execution rather than sequential single-URL calls. It is ideal for batch research workflows, bulk content ingestion, lead enrichment pipelines, or any scenario where you have a list of 2–100 URLs and need markdown content plus metadata and tech stack all in one call. Prefer it over single-URL scrapers when throughput and parallelism matter and you want to minimize total latency across many pages.

## Known failure modes

- Individual URLs may fail to load (timeout, 403, DNS failure) while others succeed — check per-URL status
- Exceeding 100 URLs in the batch returns an error
- Dynamic JavaScript-heavy pages may return incomplete markdown if not fully rendered
- Rate limits or credit exhaustion may reject the entire batch request
- Malformed URLs in the array cause per-URL or full-batch errors

## How this service works

Scrape up to 100 URLs in parallel. Returns markdown, metadata, and tech stack per URL. 1 credit per URL.

## Output

For each submitted URL, the endpoint returns the page rendered as markdown, page-level metadata (title, description, etc.), and detected tech stack information. Results are returned per-URL in a structured response covering all URLs submitted in the batch (up to 100).

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "urls": {
   "type": "array",
   "description": "Array of URLs to scrape (max 100)"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/bytemine-batch-url-scraper-b3042769/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from x402.orthogonal.com](https://www.zero.xyz/host/x402.orthogonal.com/llms.txt)