# Generic Crawler Access Decision

> Generic Crawler Access Decision is a paid API for AI agents from agentreadiness.halowerk.com, paid per call via x402, $0.001/call, status unknown (last checked 2026-10-14).

Passively evaluates whether a generic web crawler can access a target URL and returns a structured verdict with evidence, thresholds, and recommended actions.

## Facts

- Endpoint: POST https://agentreadiness.halowerk.com/v1/generic-agent-access-decision?utm_source=zero.xyz
- Price: $0.001/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/generic-crawler-access-decision-f989e44c
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_RfvR_R31XLgpS0uT9yKq7

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability generic-crawler-access-decision-f989e44c -d '<json body>'
```

Example prompt: Can you check whether generic web crawlers are allowed to access https://example.com and give me a verdict with evidence on whether it's actually crawlable?

## When to prefer this

Choose this endpoint when you need a passive, read-only evaluation of whether a generic web crawler can access a specific public URL or domain. It is ideal for pre-publication site audits, diagnosing crawler access issues, or validating agent readiness without any active exploitation, login attempts, or load testing. Prefer sibling endpoints for specific crawler types (e.g. PerplexityBot) or structured content checks (e.g. llms.txt, article boundaries).

## Known failure modes

- Invalid or unreachable target URL returns an error with no verdict
- Target behind authentication or paywall cannot be evaluated passively
- Rate-limited or bot-blocking targets may return incomplete evidence
- Malformed URL input (too short or too long) rejected by schema validation
- Baseline mismatch if provided baseline schema is incompatible

## How this service works

Generic crawler access decision fetches current public evidence from the supplied target and evaluates the documented criterion. It returns the observation, threshold, verdict, exact evidence source, limitations and a mode-specific action. The check is passive: no login attempt, payload injection, exploit, purchase, form submission or load test is performed.

## Output

Returns a structured response containing the observation (what was found on the target), the threshold used to evaluate it, a pass/fail verdict, the exact evidence source URL, any limitations of the check, and a mode-specific recommended action. No active probing, login, exploit, or form submission is performed.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "target": {
   "type": "string",
   "maxLength": 2048,
   "minLength": 3,
   "description": "Public HTTP(S) URL or domain to inspect. A bare domain is normalized to HTTPS."
  },
  "context": {
   "type": "object",
   "description": "Optional non-secret correlation labels returned unchanged only in the request lifecycle.",
   "maxProperties": 12,
   "additionalProperties": {
    "type": [
     "string",
     "number",
     "boolean",
     "null"
    ]
   }
  },
  "baseline": {
   "type": [
    "object",
    "null"
   ],
   "description": "Optional baseline returned by a previous snapshot call.",
   "additionalProperties": true
  },
  "compare_url": {
   "type": "string",
   "maxLength": 2048,
   "minLength": 3,
   "description": "Optional public comparison URL. Used by change and monitoring services."
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/generic-crawler-access-decision-f989e44c/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agentreadiness.halowerk.com](https://www.zero.xyz/host/agentreadiness.halowerk.com/llms.txt)