# AIAlign Capability Evaluation – Weighted Pass Rate & Score Aggregator

> AIAlign Capability Evaluation – Weighted Pass Rate & Score Aggregator is a paid API for AI agents from aialign.halowerk.com, paid per call via x402, $0.003/call, status unknown (last checked 2026-09-14).

Aggregates caller-labeled test cases into weighted pass rates and weighted scores with deterministic per-category summaries for AI capability evaluation.

## Facts

- Endpoint: POST https://aialign.halowerk.com/v1/capability-eval
- Price: $0.003/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/aialign-capability-evaluation-weighted-pass-rate-score-aggregator-0f16e17f
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_zAEqblBe1eG2T15cE6n8d

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability aialign-capability-evaluation-weighted-pass-rate-score-aggregator-0f16e17f -d '<json body>'
```

Example prompt: I have 500 labeled test cases for our AI assistant — each one has a category like 'reasoning' or 'safety', a pass/fail result, a score between 0 and 1, and a weight up to 1000 — can you compute the weighted pass rates and weighted scores broken down by category?

## When to prefer this

Choose this endpoint when you already have labeled test outcomes and want a fast, deterministic, weighted aggregation by category — not when you need to actually run tests, validate labels, or assess untested capabilities. It is ideal for post-evaluation rollup pipelines where the evaluation set is fixed and you need reproducible per-category pass rate and score summaries without any ML inference overhead.

## Known failure modes

- Missing required fields (case_id, category, passed, score, weight) cause validation errors
- Weight values outside [0.000001, 1000000] or scores outside [0, 1] are rejected
- Empty test_cases array or array exceeding 100,000 items returns a bounds error
- Malformed JSON body returns a 400 parse error
- Payment failure (x402) returns a 402 response before processing begins

## How this service works

Computes weighted pass rates and weighted scores from caller-labeled test outcomes, with deterministic category summaries. It does not run tests, validate labels, measure untested capabilities or establish deployment safety; the result is only as representative as the supplied evaluation set.

## Output

Returns weighted pass rates and weighted aggregate scores per category, computed deterministically from the supplied test case array. Each category entry reflects the sum-of-weights-normalized pass rate and score across all test cases tagged to that category. The result is purely a function of the submitted data; no external inference or validation is performed.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "test_cases": {
   "type": "array",
   "items": {
    "type": "object",
    "required": [
     "case_id",
     "category",
     "passed",
     "score",
     "weight"
    ],
    "properties": {
     "score": {
      "type": "number",
      "maximum": 1,
      "minimum": 0
     },
     "passed": {
      "type": "boolean"
     },
     "weight": {
      "type": "number",
      "maximum": 1000000,
      "minimum": 0.000001
     },
     "case_id": {
      "type": "string",
      "maxLength": 128,
      "minLength": 1
     },
     "category": {
      "type": "string",
      "maxLength": 128,
      "minLength": 1
     }
    },
    "additionalProperties": false
   },
   "maxItems": 100000,
   "minItems": 1
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/aialign-capability-evaluation-weighted-pass-rate-score-aggregator-0f16e17f/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from aialign.halowerk.com](https://www.zero.xyz/host/aialign.halowerk.com/llms.txt)
