# Training Question Supplied-Group Evaluation

> Training Question Supplied-Group Evaluation is a paid API for AI agents from market.datapackvibe.com, paid per call via x402, $0.01/call, status unknown (last checked 2026-10-24).

Evaluates a classifier's performance on labeled training-question records segmented by group, returning per-group and overall accuracy metrics.

## Facts

- Endpoint: POST https://market.datapackvibe.com/x402/assistant-sector-ml-training-question-group-evaluation?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-24
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/training-question-supplied-group-evaluation-16853480
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_JOW-Oehb1kVW6ONrCWfFm

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability training-question-supplied-group-evaluation-16853480 -d '<json body>'
```

Example prompt: Evaluate my training question classifier's performance by group — here are up to 200 labeled records where each has an id, the text, a group tag, the actual label (concept, procedure, example, or assessment), and the predicted label. Give me a breakdown of accuracy and errors per group.

## When to prefer this

Choose this endpoint when you need a lightweight, per-group breakdown of classifier performance on training question data (concept/procedure/example/assessment labels) using a supplied labeled dataset of up to 200 records, without requiring a hosted model or foundation-model infrastructure. Ideal for rapid auditing of label quality, cohort-level bias detection, or benchmarking a naive-Bayes baseline cheaply at $0.01 per call.

## Known failure modes

- More than 200 records submitted — exceeds the bounded deliverable limit
- Records missing required fields (id, text, actual, predicted, group) — validation error
- Labels outside the allowed enum (concept, procedure, example, assessment) — schema rejection
- Empty records array — no evaluation possible
- Malformed JSON body — request rejected

## How this service works

Training question - Supplied-group evaluation: Supplied-group evaluation for Training question. Up to 200 supplied labelled text records. Local dataset tools, evaluation and small naive-Bayes baselines; no hosted model or foundation-model training. One of 25 profiles or calculations across 20 shared operations in this sector. 0.01 USDC includes one bounded supplied-group evaluation deliverable.

## Output

A structured evaluation report broken down by group, including per-group accuracy, confusion between the four classes (concept, procedure, example, assessment), and overall aggregate metrics across all supplied records (up to 200).

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "records": {
   "type": "array",
   "items": {
    "type": "object",
    "required": [
     "id",
     "text",
     "actual",
     "predicted",
     "group"
    ],
    "properties": {
     "id": {
      "type": "string",
      "default": "",
      "maxLength": 80,
      "minLength": 1
     },
     "text": {
      "type": "string",
      "default": "",
      "maxLength": 1000
     },
     "group": {
      "type": "string",
      "default": "",
      "maxLength": 80
     },
     "actual": {
      "enum": [
       "concept",
       "procedure",
       "example",
       "assessment"
      ],
      "type": "string"
     },
     "predicted": {
      "enum": [
       "concept",
       "procedure",
       "example",
       "assessment"
      ],
      "type": "string"
     }
    },
    "additionalProperties": false
   },
   "default": [
    {
     "id": "example-0-0",
     "text": "concept sample document number 0 for this supplied dataset.",
     "group": "a",
     "actual": "concept",
     "predicted": "concept"
    },
    {
     "id": "example-0-1",
     "text": "concept sample document number 1 for this supplied dataset.",
     "group": "b",
     "actual": "concept",
     "predicted": "concept"
    },
    {
     "id": "example-0-2",
     "text": "concept sample document number 2 for this supplied dataset.",
     "group": "a",
     "actual": "concept",
     "predicted": "concept"
    },
    {
     "id": "example-1-0",
     "text": "procedure sample document number 0 for this supplied dataset.",
     "group": "a",
     "actual": "procedure",
     "predicted": "procedure"
    },
    {
     "id": "example-1-1",
     "text": "procedure sample document number 1 for this supplied dataset.",
     "group": "b",
     "actual": "procedure",
     "predicted": "procedure"
    },
    {
     "id": "example-1-2",
     "text": "procedure sample document number 2 for this supplied dataset.",
     "group": "a",
     "actual": "procedure",
     "predicted": "procedure"
    },
    {
     "id": "example-2-0",
     "text": "example sample document number 0 for this supplied dataset.",
     "group": "a",
     "actual": "example",
     "predicted": "example"
    },
    {
     "id": "example-2-1",
     "text": "example sample document number 1 for this supplied dataset.",
     "group": "b",
     "actual": "example",
     "predicted": "example"
    },
    {
     "id": "example-2-2",
     "text": "example sample document number 2 for this supplied d
… (truncated)
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/training-question-supplied-group-evaluation-16853480/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from market.datapackvibe.com](https://www.zero.xyz/host/market.datapackvibe.com/llms.txt)