# Sitemap URL Extractor

> Sitemap URL Extractor is a paid API for AI agents from tools.adamhaleworks.workers.dev, paid per call via x402, $0.004/call, status unknown (last checked 2026-10-16).

Crawls a website or sitemap file and returns all sitemap URLs with metadata in JSON or CSV format

## Facts

- Endpoint: GET https://tools.adamhaleworks.workers.dev/x402/v1/sitemap-urls?utm_source=zero.xyz
- Price: $0.004/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-16
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/sitemap-url-extractor-622e4135
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_ifSqWvUetXbSnHyqZIFp4

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability sitemap-url-extractor-622e4135
```

Example prompt: Can you pull all the sitemap URLs for github.blog and give them to me as JSON, including their last-modified dates?

## When to prefer this

Use this endpoint when you need to programmatically discover all indexed pages on a website via its sitemap, especially for SEO audits, content inventories, or web scraping prep. It handles sitemap index files, nested sitemaps, and robots.txt discovery automatically, making it superior to manually fetching and parsing individual sitemap XML files. It also supports CSV output for spreadsheet-ready exports.

## Known failure modes

- Domain has no sitemap or robots.txt entry — returns empty or minimal result
- Sitemap is malformed XML — parsing may fail or return partial results
- Site blocks crawl bots — may return empty results
- URL cap reached — capped flag set to true, not all URLs returned
- Invalid URL input — request may error or return no results

## How this service works

Guides and free-to-run Apify actors for bulk tech stack lookup, sitemap URL export to CSV, TED and UK Find a Tender search, and RSS-to-JSON feed monitoring.

## Output

Returns a JSON (or CSV) object containing the target site domain, a list of all discovered URLs each with its URL string, last-modified timestamp, and source sitemap filename, plus metadata about the sitemap files found (URL, kind, child count), whether the result was capped at the limit, how the sitemaps were sourced (e.g. robots.txt), and a total URL count.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "A domain (sitemaps found via robots.txt or common paths) or the URL of one sitemap file."
      },
      "format": {
       "enum": [
        "json",
        "csv"
       ],
       "type": "string",
       "description": "json (default) or csv."
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "site": "https://github.blog",
  "urls": [
   {
    "url": "https://github.blog/latest/",
    "lastmod": "2026-10-08T18:13:52+00:00",
    "sitemap": "https://github.blog/post-sitemap.xml"
   }
  ],
  "files": [
   {
    "url": "https://github.blog/sitemap_index.xml",
    "kind": "index",
    "urls": 0,
    "children": 17
   }
  ],
  "capped": true,
  "source": "robots.txt",
  "totalUrls": 5000
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/sitemap-url-extractor-622e4135/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from tools.adamhaleworks.workers.dev](https://www.zero.xyz/host/tools.adamhaleworks.workers.dev/llms.txt)