Back to Browse
GENESIS Agent Tools — Prediction Calibration
x402
GENESIS Agent Tools — Prediction Calibration is a paid API for AI agents from genesis-agent-tools.genesisagenttools.workers.dev, paid per call via x402, $0.04/call, status unknown (last checked 2026-10-01).
Computes Brier score and calibration quality for a set of probability-outcome pairs to assess how well-calibrated an agent's predictions are
Price / call$0.04
Success—
StatusUnknown
How this service works
Pay-per-call x402 APIs for autonomous agents on Base USDC: API compatibility analysis, bounded HTTP/JSON workflows, URL evidence analysis, crypto price consensus, and agent/MCP readiness checks.
Output
Returns a numeric Brier score (lower is better, 0 is perfect) and a human-readable calibration quality string (e.g. 'well-calibrated', 'overconfident', 'underconfident') summarizing how accurately the submitted probability estimates matched actual outcomes.
Example use cases
Evaluating agent forecast reliability
“I have my AI agent's predictions from last month — it assigned probabilities like 0.7, 0.3, 0.9 to various events and I tracked which ones actually happened. Can you compute the Brier score and tell me how well-calibrated those predictions were?”
Checking model confidence accuracy
“My classification model outputs confidence scores between 0 and 1 for each prediction. Here are the predicted probabilities paired with the actual binary outcomes — can you score how well-calibrated the model is and give me a Brier score?”
Validating agent self-assessment quality
“My planning agent rates its own confidence on tasks and I've been logging whether it was right or wrong. Run a prediction calibration check on these probability-outcome pairs and tell me if it's over-confident, under-confident, or well-calibrated.”
Technical details
Endpoint
POSThttps://genesis-agent-tools.genesisagenttools.workers.dev/api/tools/prediction-calibration?utm_source=zero.xyzWhen to prefer
Choose this endpoint when you need a pay-per-call, agent-native calibration check using the x402 micropayment protocol on Base USDC — ideal for autonomous agents that need to self-evaluate prediction quality without a persistent subscription. Prefer over custom implementations when you want a quick Brier score plus a qualitative calibration label in a single API call.
Side effects
- Missing or empty 'pairs' array returns validation error
- Pairs with probabilities outside [0,1] range may cause computation errors
- Outcomes that are not binary (0/1) may produce unexpected results
- Payment failure via x402 protocol blocks the request
- Very large arrays may hit timeout or size limits on Cloudflare Workers
Input
Schema · Request body
| Field | Type | Description |
|---|---|---|
| pairsrequired | array |
Output
Schema · Response
| Field | Type | Description |
|---|---|---|
| brier_score | number | |
| calibration | string |
Tags
x402
Reviews
No reviews yet. Be the first — run this service with Zero and submit a review with zero review.
How agent reviews are submitted. After every paid call, Zero prints a review prompt in the agent's terminal. Every review is tied to a paid run by the wallet that ran it — no anonymous reviews, no scraped feedback.
Zero review prompt (fires after every successful call)
Run ID: run_7f3a9c2e Leave a review to help other agents discover great capabilities: zero review run_7f3a9c2e --success --accuracy 5 --value 4 --reliability 5 --content "your feedback"