# Jev Structured Evaluation

> Jev Structured Evaluation is a paid API for AI agents from jev-x402-evil.vercel.app, paid per call via x402, $0.005/call, status unknown (last checked 2026-10-03).

Evaluates arbitrary content against typed questions (true/false, choice, or ordinal score) and returns calibrated probabilities and confidence scores for each answer.

## Facts

- Endpoint: POST https://jev-x402-evil.vercel.app/jev?utm_source=zero.xyz
- Price: $0.005/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-03
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/jev-structured-evaluation-84d9cd9b
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_fw_v_qWOPzXoDVdlk1lmP

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability jev-structured-evaluation-84d9cd9b -d '<json body>'
```

Example prompt: Use Jev to evaluate this support ticket — ask a noul question 'is_urgent' with instructions 'Is the customer reporting a service outage?' and criteria true/false, plus a choice question 'department' with options billing, technical, and general, then give me the calibrated probabilities for each.

## When to prefer this

Choose this endpoint when you need fast, machine-readable, structured classification or evaluation rather than prose — especially for routing, triage, policy checks, or any workflow where downstream code must branch on a typed answer. It is purpose-built for multi-question batched evaluation with calibrated probabilities, making it superior to general-purpose LLM calls when you need consistent, parseable output with confidence scores rather than free-form text.

## Known failure modes

- Invalid question type (must be noul, choice, or score) returns validation error
- Missing required fields (type, instructions, criteria) on any question causes rejection
- State object too large or malformed JSON causes parsing failure
- Unknown model ID falls back to jev-latest or errors if strict
- Empty questions map returns no evaluation results
- Payment failure or insufficient USDC balance blocks the call

## How this service works

Structured evaluation with TypeSafe's Jev (System One) model. Send any state plus typed questions — noul (true/false), choice (pick one), or score (ordinal scale) — and get back calibrated probabilities and confidence for each. Built for routing, classification, triage and policy checks where a fast, predictable, machine-readable answer beats prose.

## Output

Returns a structured map of question names to answers, each containing calibrated probability distributions over the possible labels (true/false for noul, the chosen label for choice, or the ordinal position for score), plus a confidence value indicating how certain the model is in its prediction.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "model": {
   "type": "string",
   "description": "Jev model id. Defaults to 'jev-latest'."
  },
  "state": {
   "oneOf": [
    {
     "type": "string"
    },
    {
     "type": "object"
    }
   ],
   "description": "The content to evaluate. String, or a JSON object of fields."
  },
  "questions": {
   "type": "object",
   "description": "Map of question name -> typed question. Each has a 'type' of 'noul' (true/false), 'choice' (pick one) or 'score' (ordinal scale), an 'instructions' string, and 'criteria'.",
   "additionalProperties": {
    "type": "object",
    "required": [
     "type",
     "instructions",
     "criteria"
    ],
    "properties": {
     "type": {
      "enum": [
       "noul",
       "choice",
       "score"
      ],
      "type": "string"
     },
     "criteria": {
      "oneOf": [
       {
        "type": "object"
       },
       {
        "type": "array",
        "items": {
         "type": "string"
        }
       }
      ],
      "description": "Object of label -> meaning for 'noul'/'choice'; ordered array of labels for 'score'."
     },
     "instructions": {
      "type": "string"
     }
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/jev-structured-evaluation-84d9cd9b/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from jev-x402-evil.vercel.app](https://www.zero.xyz/host/jev-x402-evil.vercel.app/llms.txt)