# Rasterly Web Crawl — URL to Markdown/JSON

> Rasterly Web Crawl — URL to Markdown/JSON is a paid API for AI agents from rasterly-x402-production.up.railway.app, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-15).

Crawls a seed URL and returns up to N pages as clean Markdown or structured JSON, payable per-call via x402/USDC

## Facts

- Endpoint: GET https://rasterly-x402-production.up.railway.app/v1/crawl
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/rasterly-web-crawl-url-to-markdown-json-86e59ac8
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_2GM-9ZmJcEwsdSFniVjRl

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability rasterly-web-crawl-url-to-markdown-json-86e59ac8
```

Example prompt: Crawl https://docs.stripe.com and return the content of up to 5 pages as markdown so I can feed it into my LLM.

## When to prefer this

Choose this endpoint when an AI agent needs to ingest live web content — especially multi-page documentation, articles, or product sites — as clean LLM-ready Markdown or structured JSON, without setting up API keys or accounts. It is especially well-suited for pay-per-call autonomous agent workflows using the x402 protocol where dynamic, one-off crawls are needed. Prefer alternatives if you need full JavaScript rendering, screenshot/PDF output, or bulk batch crawling of thousands of URLs.

## Known failure modes

- Seed URL unreachable or returns non-200 status — crawl returns empty pages array
- URL blocked by robots.txt or bot-detection — pages may be missing or have incomplete content
- Invalid or malformed URL in the url query param — likely returns 4xx error
- limit param set too high — crawl may time out or return partial results
- x402 payment rejected or insufficient USDC balance — request blocked before crawl begins

## How this service works

The web-rendering layer for AI agents, sold per-call over the x402 payment protocol. Turn any URL into a screenshot, a PDF, or clean LLM-ready Markdown. No API keys, no accounts.

## Output

A JSON object containing the seed URL, a count of crawled pages, and an array of page objects each with the page URL, title, and full Markdown content of the rendered page.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "properties": {
      "url": {
       "type": "string",
       "description": "Seed URL (encoded)"
      },
      "limit": {
       "type": "number",
       "description": "Max pages to crawl (default 10)"
      },
      "format": {
       "enum": [
        "json",
        "markdown"
       ],
       "type": "string",
       "description": "Output format (default json)"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "seed": "https://docs.stripe.com",
  "count": 2,
  "pages": [
   {
    "url": "https://docs.stripe.com",
    "title": "Stripe Docs",
    "markdown": "# Stripe Docs\n..."
   },
   {
    "url": "https://docs.stripe.com/payments",
    "title": "Payments",
    "markdown": "# Payments\n..."
   }
  ]
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/rasterly-web-crawl-url-to-markdown-json-86e59ac8/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from rasterly-x402-production.up.railway.app](https://www.zero.xyz/host/rasterly-x402-production.up.railway.app/llms.txt)