# CiteGate Robots Policy

> CiteGate Robots Policy is a paid API for AI agents from mcp-x402.onrender.com, paid per call via x402, $0.01/call, status unknown (last checked 2026-10-25).

Returns a training-vs-answer AI crawler split policy table and a ready-to-paste robots.txt snippet for any given domain

## Facts

- Endpoint: GET https://mcp-x402.onrender.com/gate/squeezeos/citegate/robots-policy?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-25
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/citegate-robots-policy-ebfee7ff
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_FewkK-zYLqZIPAWK4EEbv

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability citegate-robots-policy-ebfee7ff
```

Example prompt: Can you pull up the CiteGate robots policy for openai.com and give me the ready-to-paste robots.txt snippet that separates AI training crawlers from AI answer crawlers?

## When to prefer this

Use this endpoint when you need to quickly generate or audit robots.txt rules specifically targeting the distinction between AI training crawlers and AI answer/retrieval crawlers for a given domain. It is uniquely suited for webmasters, SEO tools, and content policy agents that need to differentiate between bots like GPTBot (training) and ChatGPT-User (answering). Prefer it over generic robots.txt generators when the use case is specifically about AI crawler governance.

## Known failure modes

- Missing or invalid domain query parameter — returns error or empty policy
- Unknown or unrecognized domain may return a generic default policy
- Payment not accepted or x402 flow fails — call is rejected before processing
- Render cold-start latency may cause timeout on first call after idle period

## How this service works

CiteGate robots policy — training-vs-answer AI crawler split table for any domain plus a ready-to-paste robots.txt snippet, $0.01 per accepted call

## Output

A JSON object containing a policy table that categorizes known AI crawlers into training-bots versus answer-bots for the queried domain, along with a pre-formatted robots.txt text snippet ready to copy-paste into a website's robots.txt file.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input",
  "output"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "properties": {
      "domain": {
       "type": "string"
      }
     }
    }
   }
  },
  "output": {
   "type": "object",
   "required": [
    "type",
    "example"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "json"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/citegate-robots-policy-ebfee7ff/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from mcp-x402.onrender.com](https://www.zero.xyz/host/mcp-x402.onrender.com/llms.txt)