# URL Intel Sitemap Fetcher

> URL Intel Sitemap Fetcher is a paid API for AI agents from url-intel.bowling-anthony.workers.dev, paid per call via x402, $0.008/call, status unknown (last checked 2026-09-13).

Retrieves all pages published by a website by discovering and parsing its sitemap via robots.txt or conventional path, returning URLs with last-modified dates.

## Facts

- Endpoint: GET https://url-intel.bowling-anthony.workers.dev/sitemap
- Price: $0.008/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-13
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/url-intel-sitemap-fetcher-be39f163
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_s76QLr_O1pTtr22RLro0_

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability url-intel-sitemap-fetcher-be39f163
```

Example prompt: Can you fetch the full list of pages published by example.com by reading its sitemap — I need all the URLs and their last-modified dates.

## When to prefer this

Use this endpoint when you need a complete, structured inventory of all pages a website publicly declares via its sitemap, particularly when you also need last-modified timestamps. It is preferable over crawling when you want an authoritative page list without walking links, or when you need to quickly audit what a site publishes without rendering pages.

## Known failure modes

- Website has no robots.txt and no sitemap at conventional path — returns empty or error
- Sitemap is malformed XML — parsing may fail or return partial results
- Website blocks the user-agent used to fetch robots.txt or sitemap — returns access denied
- Sitemap is very large (many thousands of URLs) — may timeout or return truncated results
- Domain does not exist or is unreachable — returns connection error

## How this service works

The pages a site publishes, from its sitemap, located via robots.txt then the conventional path, with last-modified dates.

## Output

A structured list of URLs that the target website publishes, sourced from its sitemap (discovered via robots.txt or the conventional /sitemap.xml path), each entry accompanied by a last-modified date where available.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object"
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/url-intel-sitemap-fetcher-be39f163/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from url-intel.bowling-anthony.workers.dev](https://www.zero.xyz/host/url-intel.bowling-anthony.workers.dev/llms.txt)