# Jev Structured Evaluation

> Jev Structured Evaluation is a paid API for AI agents from jev-systemone.vercel.app, paid per call via x402, $0.005/call, status unknown (last checked 2026-10-11).

Evaluates arbitrary content against typed questions (true/false, single-choice, or ordinal score) and returns calibrated probabilities and confidence scores for each answer.

## Facts

- Endpoint: POST https://jev-systemone.vercel.app/jev?utm_source=zero.xyz
- Price: $0.005/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-11
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/jev-structured-evaluation-eedeabea
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_HHSizHEPAcjNSXMAiNpDR

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability jev-structured-evaluation-eedeabea -d '<json body>'
```

Example prompt: Use Jev to evaluate this support ticket — ask a noul question 'is_urgent' (true if the user mentions data loss or system outage), a choice question 'department' with options 'billing', 'technical', 'general', and a score question 'severity' on a scale from 'low' to 'critical': 'My entire database is down and we're losing revenue every minute, please help immediately.'

## When to prefer this

Choose this endpoint when you need fast, machine-readable, probabilistic answers to structured questions about content — especially for routing, classification, triage, or policy checks where you need calibrated confidence rather than prose. It excels when you have multiple typed questions to evaluate simultaneously against the same state object. Prefer it over LLM free-text prompting when downstream logic needs deterministic label outputs with probabilities, and over rule-based classifiers when the criteria are nuanced enough to require semantic understanding.

## Known failure modes

- Missing required 'state' or 'questions' fields returns a validation error
- Invalid question type (not 'noul', 'choice', or 'score') causes a schema rejection
- Malformed 'criteria' object (e.g. array provided for noul/choice instead of label-map) returns a type error
- Model ID not recognized falls back to 'jev-latest' or returns a model-not-found error
- Payment not included or insufficient USDC triggers a 402 Payment Required response
- Very long state inputs may exceed context limits and return a truncation or overflow error

## How this service works

Structured evaluation with TypeSafe's Jev (System One) model. Send any state plus typed questions — noul (true/false), choice (pick one), or score (ordinal scale) — and get back calibrated probabilities and confidence for each. Built for routing, classification, triage and policy checks where a fast, predictable, machine-readable answer beats prose.

## Output

Returns a structured JSON object with one entry per question name, each containing calibrated probability distributions over the possible labels and an overall confidence value — enabling downstream logic to branch, route, or threshold without parsing free-form prose.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "model": {
   "type": "string",
   "description": "Jev model id. Defaults to 'jev-latest'."
  },
  "state": {
   "oneOf": [
    {
     "type": "string"
    },
    {
     "type": "object"
    }
   ],
   "description": "The content to evaluate. String, or a JSON object of fields."
  },
  "questions": {
   "type": "object",
   "description": "Map of question name -> typed question. Each has a 'type' of 'noul' (true/false), 'choice' (pick one) or 'score' (ordinal scale), an 'instructions' string, and 'criteria'.",
   "additionalProperties": {
    "type": "object",
    "required": [
     "type",
     "instructions",
     "criteria"
    ],
    "properties": {
     "type": {
      "enum": [
       "noul",
       "choice",
       "score"
      ],
      "type": "string"
     },
     "criteria": {
      "oneOf": [
       {
        "type": "object"
       },
       {
        "type": "array",
        "items": {
         "type": "string"
        }
       }
      ],
      "description": "Object of label -> meaning for 'noul'/'choice'; ordered array of labels for 'score'."
     },
     "instructions": {
      "type": "string"
     }
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/jev-structured-evaluation-eedeabea/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from jev-systemone.vercel.app](https://www.zero.xyz/host/jev-systemone.vercel.app/llms.txt)
