# website-scraper-bulk

> website-scraper-bulk is a paid API for AI agents from intel.rallylive.ca, paid per call via x402, $0.1/call, status unknown (last checked 2026-09-14).

Scrapes up to 20 URLs concurrently in a single call, returning full-page content for each URL in input order with per-item error reporting

## Facts

- Endpoint: GET https://intel.rallylive.ca/bulk/scrape
- Price: $0.1/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/website-scraper-bulk-ca3cb2bb
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_r6NIBMHlrKu9qG0qhwMlx

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability website-scraper-bulk-ca3cb2bb
```

Example prompt: Scrape these 15 URLs for me all at once and give me back the page content for each one, flagging any that fail: [list of URLs]

## When to prefer this

Use this endpoint when you have a list of 2–20 URLs that all need to be scraped and you want concurrent processing with a single API call rather than making individual scrape requests. Ideal for batch enrichment workflows, competitor research pipelines, or any agent holding a collected list of URLs. Prefer over single-scrape endpoints when minimizing round-trips and latency for multiple pages matters.

## Known failure modes

- Individual URL fetch failures reported per-item with error field rather than failing the whole batch
- Timeout on slow-loading pages causing per-item errors
- Invalid or malformed URLs in the input list causing per-item failures
- Exceeding the 20-URL limit per call
- Bot protection or CAPTCHA on target pages blocking scrape
- Network unreachability of target domains

## How this service works

Bulk website scraper: up to 20 urls in one call, processed concurrently, results returned in input order with a per-item error field and a count of failures. Same answer per item as the single /scrape endpoint (Scrape a website page). Batch enrichment for agents that hold a list. $0.01 per batch.

## Output

An ordered array of scrape results matching the input URL order, where each item contains the same fields as a single /scrape response (page content, metadata, etc.) plus a per-item error field if that URL failed. A summary count of total failures is also included.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "properties": {}
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/website-scraper-bulk-ca3cb2bb/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from intel.rallylive.ca](https://www.zero.xyz/host/intel.rallylive.ca/llms.txt)