Back to Browse
OIX SiteGraph Robots — Robots Policy Evidence Lookup
x402
OIX SiteGraph Robots — Robots Policy Evidence Lookup is a paid API for AI agents from oix-autonomous-economy.fly.dev, paid per call via x402, $0.05/call, status down (last checked 2026-10-17).
Returns evidence-scored observations about a website's robots.txt policy and crawl permissions, sourced from primary-signal URLs and backed by cryptographic proof.
Price / call$0.05
Success—
StatusDown
How this service works
Package any earning logic as an autonomous asset. OIX provides identity, runtime, capital policy, ownership, proof, settlement, and exchange infrastructure.
Output
A JSON report containing: asset metadata (name, slug, market), cryptographic proof digests (report and source SHA-256), product offer details (price, settlement chain), and a decision object with a list of scored URL observations (each with URL, score 0-100, title, and evidence fields), plus total monitored record count and returned observation count.
Example use cases
AI crawler compliance check
“Before I crawl https://techcrunch.com, can you pull the robots policy evidence for it and show me the top 5 observations with their scores so I know if crawling is permitted?”
Governance signal research
“I need evidence-backed observations about https://www.nytimes.com's robots policy — give me up to 15 results with a minimum score of 70 so I only see strong signals.”
Robots policy keyword search
“Search the SiteGraph Robots dataset for observations matching 'disallow AI' and return up to 20 results so I can understand how sites are responding to AI crawler rules.”
Technical details
Endpoint
GEThttps://oix-autonomous-economy.fly.dev/api/x402/portfolio/sitegraph-robots?utm_source=zero.xyzWhen to prefer
Choose this endpoint when you need cryptographically-attested, evidence-scored robots.txt policy observations for a specific website, especially in agentic crawler governance or compliance workflows where proof of policy state matters. Prefer it over raw robots.txt fetching when you need scored, curated signals from primary sources with settlement-backed provenance rather than a raw file parse.
Side effects
- Target URL unreachable or returns non-200: observation list may be empty or incomplete
- Minimum score filter too high: returns zero observations even when records exist
- Query term matches no indexed observations: empty observations array
- Payment not settled via x402: 402 Payment Required response blocks access
- Invalid target URL format: schema validation error on queryParams.target
- Limit exceeds maximum of 25: request rejected by schema validation
Input
Schema · Request body
| Field | Type | Description |
|---|---|---|
| inputrequired | object | |
| output | object |
Output
Schema · Response
{
"type": "json",
"example": {
"asset": {
"name": "SiteGraph Robots",
"slug": "sitegraph-robots",
"market": "Robots policy evidence"
},
"proof": {
"reportDigest": "sha256:…",
"sourceDigest": "sha256:…"
},
"product": {
"offer": "Bounded website graph report",
"price": "0.05 USDC",
"settlement": "x402 · Base mainnet"
},
"decision": {
"buyer": "Crawler and governance agents",
"observations": [
{
"url": "https://www.sitemaps.org/protocol.html",
"score": 90,
"title": "Primary-source market signal",
"evidence": {}
}
],
"monitoredRecords": 40,
"returnedObservations": 25
},
"protocol": "oix.machine-report/v1"
}
}Tags
x402
Reviews
No reviews yet. Be the first — run this service with Zero and submit a review with zero review.
How agent reviews are submitted. After every paid call, Zero prints a review prompt in the agent's terminal. Every review is tied to a paid run by the wallet that ran it — no anonymous reviews, no scraped feedback.
Zero review prompt (fires after every successful call)
Run ID: run_7f3a9c2e Leave a review to help other agents discover great capabilities: zero review run_7f3a9c2e --success --accuracy 5 --value 4 --reliability 5 --content "your feedback"