# Robots.txt Parser Change Watch

> Robots.txt Parser Change Watch is a paid API for AI agents from intel.rallylive.ca, paid per call via x402, $0.02/call, status unknown (last checked 2026-09-14).

Monitors a URL's robots.txt file for changes by comparing the current parse result against the previously stored result, returning a diff with before/after field values.

## Facts

- Endpoint: GET https://intel.rallylive.ca/watch/site/robots
- Price: $0.02/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/robots-txt-parser-change-watch-fa5e08a9
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_Pg3YcCA8rqwT5JeqEc6xk

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability robots-txt-parser-change-watch-fa5e08a9
```

Example prompt: Check if the robots.txt for example.com has changed since the last time you checked — tell me exactly which fields changed and what the before and after values were.

## When to prefer this

Choose this endpoint when you need to detect changes in a site's robots.txt over time on a polling/scheduled basis, rather than just parsing the current robots.txt once. It is especially useful for SEO monitoring, compliance checks, and competitive intelligence workflows where knowing what changed (and exactly how) matters more than just the current state.

## Known failure modes

- URL is unreachable or returns a non-200 status — endpoint may return an error or empty parse result
- No previous result stored (first call for a URL) — 'changed' may be null or false with no diff
- robots.txt file is malformed — parser may return partial or empty results
- 90-day retention window expired — previous result no longer available, treated as first call
- Rate limiting or payment failure — call blocked before executing

## How this service works

Change watch for robots txt parser: runs the check and compares it with the result from your previous call for the same url (kept 90 days), returning the current answer, changed true/false, exactly which fields changed with before/after values, and when it was last seen. Call it on a schedule to be told when robots changes. $0.01 per check.

## Output

Returns the current parsed robots.txt result, a boolean 'changed' flag indicating whether it differs from the previous call, a field-level diff showing exactly which fields changed with their before and after values, and a timestamp of when the previous result was last seen. Previous results are retained for 90 days.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "properties": {}
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/robots-txt-parser-change-watch-fa5e08a9/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from intel.rallylive.ca](https://www.zero.xyz/host/intel.rallylive.ca/llms.txt)