# Crawlspur Meta-Robots Check for Parameter URLs

> Crawlspur Meta-Robots Check for Parameter URLs is a paid API for AI agents from crawlspur.halowerk.com, paid per call via x402, $0.001/call, status unknown (last checked 2026-09-14).

Checks the meta-robots directive value for a given parameterized URL to assess its crawlability and indexability signals.

## Facts

- Endpoint: POST https://crawlspur.halowerk.com/v1/pruef/crawlspur/meta-robots/parameter-url
- Price: $0.001/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/crawlspur-meta-robots-check-for-parameter-urls-6bcdcde8
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_fOFimbL-kSGfyRUABLr83

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability crawlspur-meta-robots-check-for-parameter-urls-6bcdcde8 -d '<json body>'
```

Example prompt: Check the meta-robots directive on this parameterized URL for me: https://example.com/products?color=red&size=M — I want to know what value is set and whether it would prevent search engines from indexing it.

## When to prefer this

Choose this endpoint when you specifically need to audit or verify the meta-robots HTML tag value on URLs that contain query parameters (e.g. filter, sort, UTM, or pagination parameters), as part of a technical SEO audit or indexability investigation. It is distinct from robots.txt checks and X-Robots-Tag header checks, which are handled by sibling endpoints.

## Known failure modes

- URL is not publicly accessible or returns a non-200 HTTP status
- Meta-robots tag is absent from the page (no finding returned)
- URL exceeds 2048 character limit
- Target page blocks the crawler's user agent
- DNS resolution failure for the provided URL
- Malformed URL input causing validation error

## How this service works

Prüft am Objekt parameter-url den Befund Wert der Meta-Robots-Angabe.

## Output

Returns the value of the meta-robots directive found on the specified parameterized URL, indicating whether crawlers are instructed to index, noindex, follow, nofollow, or other combinations, along with any relevant finding details about the page's crawl status.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "ziel": {
   "oneOf": [
    {
     "type": "string",
     "maxLength": 2048,
     "minLength": 1,
     "description": "Öffentliche HTTP(S)-Adresse; bei DNS-Befunden Domain oder öffentliche IP."
    },
    {
     "type": "object",
     "required": [
      "adresse"
     ],
     "properties": {
      "adresse": {
       "type": "string",
       "maxLength": 2048,
       "minLength": 1
      },
      "selektor": {
       "type": "string",
       "maxLength": 240,
       "minLength": 1,
       "description": "CSS-Selektor: genau ein Objekt, sonst erster Treffer des Objektfilters."
      },
      "vergleich": {
       "type": "string",
       "maxLength": 2048,
       "description": "Öffentliche Vergleichsadresse für Link-, Sitemap- oder Sprachbefunde."
      },
      "user_agent": {
       "type": "string",
       "pattern": "^[A-Za-z0-9_-]{1,80}$"
      },
      "dkim_selektor": {
       "type": "string",
       "pattern": "^[A-Za-z0-9_-]{1,63}$"
      }
     },
     "additionalProperties": false
    }
   ]
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/crawlspur-meta-robots-check-for-parameter-urls-6bcdcde8/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from crawlspur.halowerk.com](https://www.zero.xyz/host/crawlspur.halowerk.com/llms.txt)