# agentsvc.io Site Map Fetcher

> agentsvc.io Site Map Fetcher is a paid API for AI agents from agentsvc.io, paid per call via x402, $0.0025/call, status unknown (last checked 2026-10-10).

Retrieves a structured list of all URLs from a website's sitemap and robots.txt, returning indexed pages with their last-modified timestamps.

## Facts

- Endpoint: POST https://agentsvc.io/api/v1/proxy/site-map?utm_source=zero.xyz
- Price: $0.0025/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-10
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/agentsvc-io-site-map-fetcher-1f520e38
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_l0CZUxBZf4x5Rg1zc9wgw

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agentsvc-io-site-map-fetcher-1f520e38 -d '<json body>'
```

Example prompt: Can you fetch the full site map for stripe.com and give me a list of all its indexed URLs, up to 500?

## When to prefer this

Use this endpoint when you need a structured, fast inventory of all publicly indexed pages on a domain without full crawling. It's ideal for SEO analysis, content auditing, competitor research, or pre-crawl URL discovery. Prefer it over full web scraping when you only need the URL list (not page content) and the site has a sitemap.

## Known failure modes

- Site has no sitemap.xml — returns empty URL list or limited results from robots.txt only
- Invalid or unreachable URL — network error or timeout
- max_urls limit reached before full sitemap is parsed — partial results returned
- Sitemap is malformed XML — may return incomplete or zero URLs
- Rate limiting or blocking by target server — request may fail

## How this service works

86 APIs for AI agents: web scraping and crawling to Markdown, AI summaries, data extraction and cited answers, screenshots and PDF, PDF, OCR and document conversion, news, paper and developer search and more, paid per call with USDC on Base, Solana, Polygon or Arbitrum via x402. No account, no API key, free sample on every service.

## Output

Returns a JSON object containing the target site's canonical URL, an array of discovered URLs each with its source (sitemap or robots.txt), last-modified timestamp, the count of URLs found, the list of sitemap.xml files checked, whether robots.txt was found, and the timestamp of the check.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "url": {
   "type": "string",
   "description": "Site URL or domain"
  },
  "max_urls": {
   "type": "integer",
   "default": 200,
   "maximum": 1000,
   "minimum": 1
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "data": {
   "site": "https://agentsvc.io",
   "urls": [
    {
     "url": "https://agentsvc.io/",
     "source": "sitemap",
     "lastmod": "2026-10-06T14:17:50.554Z"
    },
    {
     "url": "https://agentsvc.io/services",
     "source": "sitemap",
     "lastmod": "2026-10-06T14:17:50.554Z"
    }
   ],
   "count": 3,
   "sitemaps": [
    "https://agentsvc.io/sitemap.xml"
   ],
   "checked_at": "2026-10-06T14:17:50.557Z",
   "from_sitemap": 3,
   "robots_txt_found": true
  },
  "success": true
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agentsvc-io-site-map-fetcher-1f520e38/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agentsvc.io](https://www.zero.xyz/host/agentsvc.io/llms.txt)