# AutoScrape Sitemap URL Extractor

> AutoScrape Sitemap URL Extractor is a paid API for AI agents from autoscrape-api-seven.vercel.app, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-14).

Extracts all URLs declared in a website's XML sitemap(s), with optional auto-discovery from robots.txt and filtering by last-modified date

## Facts

- Endpoint: GET https://autoscrape-api-seven.vercel.app/x402/v1/sitemap-urls
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/autoscrape-sitemap-url-extractor-8bd801fb
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_FpblnSsYkX6t5S9Altx0g

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability autoscrape-sitemap-url-extractor-8bd801fb
```

Example prompt: Can you pull all the URLs listed in the sitemap for example.com — auto-discover from robots.txt if needed, and only include pages modified since 2024-01-01, up to 100 results?

## When to prefer this

Use this endpoint when you need to enumerate all publicly declared pages on a website without crawling it link-by-link. It is ideal for SEO audits, content inventories, migration checklists, and monitoring recently updated pages. Prefer it over raw HTML crawling when the site publishes a structured sitemap and you need a clean URL list quickly and cheaply at $0.01 per call.

## Known failure modes

- URL is not publicly accessible — returns empty results or error status
- No sitemap found and autoDiscover fails to locate one via robots.txt or common paths — setupStatus indicates not found
- Malformed or non-standard sitemap XML may cause partial or empty results
- maxResults cap of 100 may truncate large sitemaps
- modifiedSince filter relies on publisher-supplied lastmod values which may be absent or inaccurate
- Invalid or private domain returns error or zero results

## How this service works

No-key evaluation APIs for public data and utilities: business filings, permits, bankruptcy dockets, NPI providers, HTTP status checks, sitemap URL extraction, SEC EDGAR, IRS 990, WHOIS, and validation. Paid x402 access is live.

## Output

Returns a JSON object with a count of URLs found, an array of result objects each containing a page URL and the sitemap source it was found in, and a setupStatus field indicating whether sitemap discovery succeeded.

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "count": 1,
  "results": [
   {
    "url": "https://autoscrape-api-seven.vercel.app/",
    "sitemapSource": "https://autoscrape-api-seven.vercel.app/sitemap.xml"
   }
  ],
  "setupStatus": "found"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/autoscrape-sitemap-url-extractor-8bd801fb/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from autoscrape-api-seven.vercel.app](https://www.zero.xyz/host/autoscrape-api-seven.vercel.app/llms.txt)
