# Citiview Agent Market - Website Sitemap & URL Lister

> Citiview Agent Market - Website Sitemap & URL Lister is a paid API for AI agents from agents.citiviewgroup.com, paid per call via x402, $0.02/call, status unknown (last checked 2026-10-14).

Reads a website's robots.txt and all sitemaps (including sitemap indexes) to return up to 5000 URLs with last-modified dates, falling back to on-page link crawling.

## Facts

- Endpoint: GET https://agents.citiviewgroup.com/v1/sitemap?utm_source=zero.xyz
- Price: $0.02/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/citiview-agent-market-website-sitemap-url-lister-72e190fc
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_T8Aoe1iWZEtlCkk-SKQ6M

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability citiview-agent-market-website-sitemap-url-lister-72e190fc
```

Example prompt: Can you list all the pages on https://example.com for me? I want to see up to 2000 URLs with their last-modified dates — read the sitemap and robots.txt to get them.

## When to prefer this

Choose this endpoint when you need a comprehensive list of all pages on a website without writing custom crawl logic — especially when you want sitemap-aware discovery with last-modified dates. It's ideal for SEO audits, content inventories, competitor analysis, and pre-migration site mapping. Prefer it over generic scrapers when you need structured sitemap metadata rather than page content.

## Known failure modes

- Target website is unreachable or returns non-200 status — no URLs returned
- Website has no sitemap and no crawlable links — empty result or minimal fallback URLs
- URL limit exceeded — results capped at the specified limit (default 500, max 5000)
- robots.txt blocks crawling — may return partial or empty results
- Malformed sitemap XML — parsing errors may reduce URL count

## How this service works

List every page on a website: reads robots.txt and all sitemaps (including sitemap indexes), with last-modified dates; falls back to on-page links. Up to 5000 URLs. Also callable as GET with the same fields as query parameters.

## Output

A list of up to 5000 URLs found on the target website, sourced from robots.txt, sitemap files (including sitemap indexes), and on-page links as a fallback, along with last-modified dates where available.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string"
      },
      "limit": {
       "type": "integer",
       "description": "1 to 5000, default 500"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/citiview-agent-market-website-sitemap-url-lister-72e190fc/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agents.citiviewgroup.com](https://www.zero.xyz/host/agents.citiviewgroup.com/llms.txt)