# Jev Structured Evaluation

> Jev Structured Evaluation is a paid API for AI agents from jev-x402.vercel.app, paid per call via x402, $0.001/call, status healthy (last checked 2026-10-12, last successful call 2026-10-11).

Evaluates arbitrary content against typed questions (true/false, single-choice, or ordinal score) and returns calibrated probabilities and confidence scores for each answer.

## Facts

- Endpoint: POST https://jev-x402.vercel.app/jev?utm_source=zero.xyz
- Price: $0.001/call
- Payment: x402
- Status: healthy
- Last checked: 2026-10-12
- Last successful call: 2026-10-11
- Success rate: 100% of calls made through Zero
- Rating: 4.7 / 5 from 1 review
- Activations on Zero: 2
- Tags: x402
- Canonical page: https://www.zero.xyz/c/jev-structured-evaluation-0fef3fd4
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_ZktCVifDPpZdIn29LEh7H

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability jev-structured-evaluation-0fef3fd4 -d '<json body>'
```

Example prompt: Evaluate this support ticket using Jev's structured evaluation: check if it's urgent (true/false), classify the department as one of 'billing', 'technical', or 'general', and score the sentiment on a scale of 'negative', 'neutral', 'positive' — the ticket reads: 'My account was charged twice this month and I still can't log in, this is unacceptable.'

## When to prefer this

Choose this endpoint when you need fast, structured, machine-readable classification or evaluation over freeform text or JSON state — especially for routing, triage, policy checks, or quality scoring where calibrated probabilities matter more than prose explanations. It outperforms general LLM prompting for tasks requiring type-safe, multi-question evaluation in a single call with consistent output format.

## Known failure modes

- Invalid question type (not 'noul', 'choice', or 'score') returns a validation error
- Missing required 'instructions' or 'criteria' fields per question causes rejection
- Malformed or empty 'state' may produce low-confidence or error responses
- Payment not included or insufficient USDC triggers x402 payment-required response
- Model ID not found if a non-existent 'model' string is provided

## How this service works

Structured evaluation with TypeSafe's Jev (System One) model. Send any state plus typed questions — noul (true/false), choice (pick one), or score (ordinal scale) — and get back calibrated probabilities and confidence for each. Built for routing, classification, triage and policy checks where a fast, predictable, machine-readable answer beats prose.

## Output

Returns a structured JSON object keyed by question name, where each value contains the evaluated label, calibrated probability distribution over all possible answers, and a confidence score. Designed to be machine-readable for downstream routing, gating, or logging logic.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "model": {
   "type": "string",
   "description": "Jev model id. Defaults to 'jev-latest'."
  },
  "state": {
   "oneOf": [
    {
     "type": "string"
    },
    {
     "type": "object"
    }
   ],
   "description": "The content to evaluate. String, or a JSON object of fields."
  },
  "questions": {
   "type": "object",
   "description": "Map of question name -> typed question. Each has a 'type' of 'noul' (true/false), 'choice' (pick one) or 'score' (ordinal scale), an 'instructions' string, and 'criteria'.",
   "additionalProperties": {
    "type": "object",
    "required": [
     "type",
     "instructions",
     "criteria"
    ],
    "properties": {
     "type": {
      "enum": [
       "noul",
       "choice",
       "score"
      ],
      "type": "string"
     },
     "criteria": {
      "oneOf": [
       {
        "type": "object"
       },
       {
        "type": "array",
        "items": {
         "type": "string"
        }
       }
      ],
      "description": "Object of label -> meaning for 'noul'/'choice'; ordered array of labels for 'score'."
     },
     "instructions": {
      "type": "string"
     }
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/jev-structured-evaluation-0fef3fd4/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from jev-x402.vercel.app](https://www.zero.xyz/host/jev-x402.vercel.app/llms.txt)
