# CiteGate Robots Policy Analyzer

> CiteGate Robots Policy Analyzer is a paid API for AI agents from squeezeos-api.onrender.com, paid per call via x402, $0.01/call, status unknown (last checked 2026-10-25).

Fetches and parses a domain's live robots.txt to produce a structured AI-crawler policy table (training vs. answer crawlers) plus a ready-to-paste robots.txt snippet

## Facts

- Endpoint: GET https://squeezeos-api.onrender.com/citegate/robots-policy?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-25
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/citegate-robots-policy-analyzer-f9337ac2
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_O3koyIfmSQq18JuD5FjfV

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability citegate-robots-policy-analyzer-f9337ac2
```

Example prompt: Can you pull up the AI crawler policy for openai.com — specifically which crawlers are allowed for training versus answer generation, and give me a robots.txt snippet I could copy to enforce a similar policy?

## When to prefer this

Choose this endpoint when you need to programmatically inspect a domain's live robots.txt specifically for AI crawler policies — distinguishing training crawlers from answer/retrieval crawlers — and when you also need a ready-to-use robots.txt snippet. Prefer this over manual robots.txt inspection when you need structured, agent-consumable output or when comparing policies across domains at scale.

## Known failure modes

- Domain has no robots.txt — returns empty or default-allow policy
- Domain is unreachable or returns non-200 — fetch error
- Malformed robots.txt that cannot be parsed — partial or fallback result
- Invalid or unresolvable domain input — input validation error
- robots.txt exists but contains no AI-crawler-specific directives — minimal output

## How this service works

CiteGate robots policy — training-vs-answer AI crawler split table for any domain plus a ready-to-paste robots.txt snippet, $0.01 per accepted call

## Output

A structured JSON response containing a table breaking down which AI crawlers are permitted or disallowed, split by purpose (training vs. answer/retrieval), along with a ready-to-paste robots.txt snippet that reflects the domain's current policy.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input",
  "output"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method",
    "queryParams"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "type": "string",
     "const": "GET"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "domain"
     ],
     "properties": {
      "domain": {
       "type": "string",
       "description": "Domain or URL whose live robots.txt AI-crawler policy to report, e.g. example.com Search intents: robots.txt ai crawlers, ai crawler policy, gptbot robots, robots policy api."
      }
     },
     "additionalProperties": true
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type",
    "example"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "json"
    },
    "example": {
     "type": "object"
    }
   },
   "additionalProperties": false
  }
 },
 "additionalProperties": false
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/citegate-robots-policy-analyzer-f9337ac2/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from squeezeos-api.onrender.com](https://www.zero.xyz/host/squeezeos-api.onrender.com/llms.txt)