# Olostep Web Page Scraper

> Olostep Web Page Scraper is a paid API for AI agents from x402.orth.sh, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-13).

Initiates a web page scrape via Olostep, returning page content in configurable formats (markdown, HTML, JSON, links, images, etc.) with optional actions, transformers, and LLM extraction

## Facts

- Endpoint: POST https://x402.orth.sh/olostep/v1/scrapes
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-13
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/olostep-web-page-scraper-7b766785
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_lKOZREbzBV118HkG5b8MD

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability olostep-web-page-scraper-7b766785 -d '<json body>'
```

Example prompt: Scrape the URL https://example.com/article and give me the content in markdown format, loaded from a US residential proxy, with ads removed using the postlight transformer.

## When to prefer this

Choose this endpoint when you need flexible, feature-rich web scraping with options for residential proxies by country, ad-stripping transformers, LLM-based structured extraction, screen size emulation, and multiple output formats. It is backed by Olostep and is ideal for agents that need more than raw HTML — e.g. clean markdown, structured JSON, or link lists — from a single page. Prefer sibling crawl endpoints if you need to traverse multiple pages.

## Known failure modes

- URL is unreachable or returns non-200 status
- Unsupported country code provided for residential proxy
- Page requires JavaScript execution beyond configured actions
- LLM extraction schema does not match page content structure
- Payment fails or insufficient USDC balance for x402 transaction
- Rate limiting or bot detection by target website

## How this service works

Initiate a web page scrape

## Output

Returns the scraped page content in one or more requested formats (markdown, HTML, JSON, links, images, etc.), along with any structured data from parsers or LLM extraction, and page metadata.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "parser": {
   "type": "object",
   "properties": {
    "id": {
     "type": "string"
    }
   },
   "description": "When defining json as a format, you can use this parameter to specify the parser to use. Parsers are useful to extract structured content from web pages. Olostep has a few parsers built in for most common web pages, and you can also create your own parsers."
  },
  "actions": {
   "type": "object",
   "properties": {
    "type": {
     "type": "string"
    },
    "milliseconds": {
     "type": "number"
    }
   },
   "description": "Actions to perform on the page before getting the content."
  },
  "country": {
   "type": "string",
   "description": "Residential country to load the request from. Supported values are: * US (United States) * CA (Canada) * IT (Italy) * IN (India) * GB (England) * JP (Japan) * MX (Mexico) * AU (Australia) * ID (Indonesia) * UA (UAE) * RU (Russia) * RANDOM Some operations, like scraping Google Search and Google News, support all countries."
  },
  "formats": {
   "type": "array",
   "items": {
    "type": "string"
   },
   "description": "Formats in which you want the content."
  },
  "metadata": {
   "type": "object",
   "description": "User-defined metadata. Not supported yet"
  },
  "llm_extract": {
   "type": "object",
   "properties": {
    "schema": {
     "type": "object"
    }
   }
  },
  "screen_size": {
   "type": "object",
   "properties": {
    "screen_type": {
     "type": "string"
    },
    "screen_width": {
     "type": "number"
    },
    "screen_height": {
     "type": "number"
    }
   },
   "description": "Configuration for screen size. Preset dimensions are available through screen_type: desktop (1920x1080), mobile (414x896), or default (768x1024)."
  },
  "transformer": {
   "type": "string",
   "description": "Specify the HTML transformer to use, if any. Postlight's Mercury Parser library is used to remove ads and other unwanted content from the scraped content. Available options: `postlight`, `none`"
  },
  "links_on_page": {
   "type": "object",
   "properties": {
    "exclude_links": {
     "type": "array",
     "items": {
      "type": "string"
     }
    },
    "include_links": {
     "type": "array",
     "items": {
      "type": "string"
     }
    },
    "absolute_links": {
     "type": "boolean"
    },
    "query_to_order_links_by": {
     "type": "string"
    }
   },
   "description": "With this option, you can get all the links present on t
… (truncated)
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/olostep-web-page-scraper-7b766785/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from x402.orth.sh](https://www.zero.xyz/host/x402.orth.sh/llms.txt)