# Penny Army Research – Robots.txt Directives Inspector

> Penny Army Research – Robots.txt Directives Inspector is a paid API for AI agents from penny-army-reference-mainnet.spruceboundgranitestudio.workers.dev, paid per call via x402, $0.001/call, status unknown (last checked 2026-10-11).

Parses and inventories robots.txt content to enumerate user-agent groups, literal rule strings, and sitemap declarations without fetching URLs or evaluating permissions.

## Facts

- Endpoint: POST https://penny-army-reference-mainnet.spruceboundgranitestudio.workers.dev/v1/probes/robots-directives-inspect?utm_source=zero.xyz
- Price: $0.001/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-11
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/penny-army-research-robots-txt-directives-inspector-d41e2297
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_Y8xHQ5_XgeY58e8XSIawz

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability penny-army-research-robots-txt-directives-inspector-d41e2297 -d '<json body>'
```

Example prompt: Can you parse this robots.txt content and tell me all the user-agent groups, every allow/disallow rule, and any sitemap declarations it contains — without fetching anything: 'User-agent: * Disallow: /admin/ Sitemap: https://example.com/sitemap.xml'?

## When to prefer this

Choose this endpoint when you need to statically parse and inventory the contents of a robots.txt file you already have as text — specifically to enumerate user-agent groups, extract literal rule strings, and list sitemap declarations — without any live URL fetching, permission evaluation, or crawlability checks. Prefer alternatives if you need to evaluate whether a specific URL is allowed for a given bot, or if you need to retrieve a robots.txt from a live server.

## Known failure modes

- Input text exceeds 8192 character limit — request rejected
- Malformed or empty robots.txt text — may return empty or partial inventory
- Non-robots.txt text supplied — output may be empty or nonsensical
- Missing 'text' field in request body — validation error

## How this service works

Inventory supplied robots.txt groups, literal rule strings and sitemap declarations; no fetching or permission evaluation.

## Output

A structured inventory of the supplied robots.txt text, including all user-agent group names, the literal allow/disallow rule strings under each group, and any sitemap URL declarations present in the file. No URL fetching or permission evaluation is performed.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "text": {
   "type": "string",
   "maxLength": 8192
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/penny-army-research-robots-txt-directives-inspector-d41e2297/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from penny-army-reference-mainnet.spruceboundgranitestudio.workers.dev](https://www.zero.xyz/host/penny-army-reference-mainnet.spruceboundgranitestudio.workers.dev/llms.txt)