# Crawlspur X-Robots-Tag Checker for Sitemap

> Crawlspur X-Robots-Tag Checker for Sitemap is a paid API for AI agents from crawlspur.halowerk.com, paid per call via x402, $0.001/call, status unknown (last checked 2026-09-14).

Checks the X-Robots-Tag header value on a sitemap object for SEO crawlability analysis

## Facts

- Endpoint: POST https://crawlspur.halowerk.com/v1/pruef/crawlspur/x-robots/sitemap
- Price: $0.001/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/crawlspur-x-robots-tag-checker-for-sitemap-f8491b55
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_WHXsBz27UOcqW0z3q5AYe

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability crawlspur-x-robots-tag-checker-for-sitemap-f8491b55 -d '<json body>'
```

Example prompt: Can you check the X-Robots-Tag header on my sitemap at https://example.com/sitemap.xml and tell me what crawl directive it's returning?

## When to prefer this

Choose this endpoint when you need to specifically audit the X-Robots-Tag HTTP response header on a sitemap file, rather than meta-robots tags in HTML or robots.txt rules. It is ideal for technical SEO diagnostics where server-level crawl directives on the sitemap itself are suspected to be causing indexing issues.

## Known failure modes

- Invalid or inaccessible URL returns an error or empty result
- Sitemap URL returns non-200 HTTP status preventing header inspection
- Malformed input schema (e.g. missing 'ziel' field) returns validation error
- Network timeout if target URL is slow to respond
- X-Robots-Tag header absent on target, resulting in empty/null finding

## How this service works

Prüft am Objekt sitemap den Befund Wert des X-Robots-Tags.

## Output

Returns the X-Robots-Tag header value found on the specified sitemap object, indicating any crawl directives (e.g. noindex, nofollow, none) set at the HTTP header level that could affect search engine indexing of the sitemap.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "ziel": {
   "oneOf": [
    {
     "type": "string",
     "maxLength": 2048,
     "minLength": 1,
     "description": "Öffentliche HTTP(S)-Adresse; bei DNS-Befunden Domain oder öffentliche IP."
    },
    {
     "type": "object",
     "required": [
      "adresse"
     ],
     "properties": {
      "adresse": {
       "type": "string",
       "maxLength": 2048,
       "minLength": 1
      },
      "selektor": {
       "type": "string",
       "maxLength": 240,
       "minLength": 1,
       "description": "CSS-Selektor: genau ein Objekt, sonst erster Treffer des Objektfilters."
      },
      "vergleich": {
       "type": "string",
       "maxLength": 2048,
       "description": "Öffentliche Vergleichsadresse für Link-, Sitemap- oder Sprachbefunde."
      },
      "user_agent": {
       "type": "string",
       "pattern": "^[A-Za-z0-9_-]{1,80}$"
      },
      "dkim_selektor": {
       "type": "string",
       "pattern": "^[A-Za-z0-9_-]{1,63}$"
      }
     },
     "additionalProperties": false
    }
   ]
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/crawlspur-x-robots-tag-checker-for-sitemap-f8491b55/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from crawlspur.halowerk.com](https://www.zero.xyz/host/crawlspur.halowerk.com/llms.txt)