# ScrapeMole Reader – XML Sitemap Fetcher

> ScrapeMole Reader – XML Sitemap Fetcher is a paid API for AI agents from reader.scrapemole.workers.dev, paid per call via x402, $0.002/call, status unknown (last checked 2026-10-12).

Fetches and parses a site's XML sitemap, returning a normalized list of page URLs with optional metadata like lastmod dates

## Facts

- Endpoint: GET https://reader.scrapemole.workers.dev/v1/sitemap?utm_source=zero.xyz
- Price: $0.002/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-12
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapemole-reader-xml-sitemap-fetcher-7a48a21c
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_J5XN33PKGf34S8qksW6Ij

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapemole-reader-xml-sitemap-fetcher-7a48a21c
```

Example prompt: Can you pull the sitemap for stripe.com and give me a list of all the pages they have indexed, up to 500 URLs?

## When to prefer this

Use this endpoint when you need to enumerate all publicly indexed pages on a site without crawling it manually. It is ideal for SEO audits, content discovery, competitor analysis, or seeding a crawl queue. Prefer this over fetching the page links endpoint when you want the authoritative publisher-declared URL list rather than scraped anchor tags, and when you need lastmod freshness signals.

## Known failure modes

- Site has no sitemap.xml and no robots.txt sitemap directive — returns error or empty result
- Sitemap URL is malformed or unreachable — HTTP error returned, no charge
- Sitemap is a large index with many children — only first child sitemaps expanded if expand=true
- Limit parameter exceeded maximum of 5000 — capped silently
- Gzip-compressed sitemap.xml.gz parsing fails on malformed content
- Payment verification fails — request rejected before any work is done, no charge

## How this service works

Pay-per-call web reading for agents: any public page as clean Markdown, link-preview/SEO metadata (Open Graph, Twitter card, favicon, JSON-LD), RSS/Atom/JSON feeds normalized, every link on a page (internal/external, rel) and a site's XML sitemap as a URL list. USDC via x402, no accounts or API keys; failed calls are never charged.

Payments: x402 v2, scheme "exact", USDC on Base (eip155:8453). The payment is verified before the work and settled only when the response is 200. Terms: https://reader.scrapemole.workers.dev/terms

## Output

A JSON object containing the resolved sitemap URL, the sitemap type (urlset or sitemapindex), an array of URL entries each with url and optional lastmod fields, total count, a truncated flag indicating if the limit was hit, and how the sitemap was discovered (e.g. via robots.txt or direct URL).

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "examples": [
        "https://www.sitemaps.org"
       ],
       "description": "Site URL (e.g. https://example.com) or a sitemap .xml/.xml.gz URL."
      },
      "limit": {
       "type": "string",
       "default": "1000",
       "description": "Max page URLs returned (1-5000)."
      },
      "expand": {
       "type": "string",
       "default": "true",
       "description": "For a sitemap index, also read the first child sitemaps (true/false)."
      }
     },
     "additionalProperties": false
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "url": "https://www.sitemaps.org/",
  "type": "urlset",
  "urls": [
   {
    "url": "https://www.sitemaps.org/",
    "lastmod": "2016-11-21"
   },
   {
    "url": "https://www.sitemaps.org/protocol.html",
    "lastmod": "2016-11-21"
   }
  ],
  "count": 2,
  "truncated": false,
  "sitemapUrl": "https://www.sitemaps.org/sitemap.xml",
  "discoveredVia": "robots.txt"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapemole-reader-xml-sitemap-fetcher-7a48a21c/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from reader.scrapemole.workers.dev](https://www.zero.xyz/host/reader.scrapemole.workers.dev/llms.txt)