# LLM Eval Case Normalizer

> LLM Eval Case Normalizer is a paid API for AI agents from signalharness.ai, paid per call via x402, $0.005/call, status unknown (last checked 2026-09-13).

Normalizes and standardizes LLM evaluation test case JSON into a canonical format for consistent evaluation pipelines.

## Facts

- Endpoint: POST https://signalharness.ai/api/agent/services/llm_eval_case_normalize/invoke
- Price: $0.005/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-13
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/llm-eval-case-normalizer-4e2fae40
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_Zjr8p3W7uBetzEH_0PD5K

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability llm-eval-case-normalizer-4e2fae40 -d '<json body>'
```

Example prompt: Can you normalize this LLM evaluation case JSON for me so it's in a consistent, canonical format ready for benchmarking? Here's the raw JSON: {"prompt": "What is 2+2?", "expected": "4", "tags": ["math"]}

## When to prefer this

Use this endpoint when you need to normalize LLM evaluation test cases into a canonical format before feeding them into an evaluation or benchmarking pipeline. Prefer this over manual preprocessing when dealing with heterogeneous eval case formats from multiple sources or vendors. It is particularly useful in automated agent workflows that assemble eval datasets from diverse inputs.

## Known failure modes

- Invalid or malformed JSON string in request_json — returns error or warnings
- Input JSON exceeds 65536 character limit — request rejected
- Empty or too-short input JSON (minLength 2) — request rejected
- Caller-supplied data that cannot be interpreted as a valid eval case — may produce warnings in the result

## How this service works

Explore 330 pay-per-call x402 API services and 27 agent-native digital products, with Base USDC pricing, secure Polar checkout, and free discovery.

## Output

Returns a JSON object containing a normalized analysis_json string representing the standardized evaluation case, along with any warnings about the input data, the service_id, and an evidence_scope field indicating the data provenance. Also includes a payment receipt with execution metadata.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "request_json": {
   "type": "string",
   "maxLength": 65536,
   "minLength": 2
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "replay": false,
  "result": {
   "warnings": [
    "Verify the caller-supplied data before relying on this result."
   ],
   "service_id": "llm_eval_case_normalize",
   "analysis_json": "{\"example\":\"schema-valid caller-supplied data\"}",
   "evidence_scope": "caller_supplied_data"
  },
  "status": "succeeded",
  "receipt": {
   "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
   "usage": [],
   "status": "succeeded",
   "network": "eip155:8453",
   "artifacts": [],
   "endedAtMs": 0,
   "latencyMs": 0,
   "paymentId": "example-payment",
   "receiptId": "example-receipt",
   "requestId": "example-request",
   "serviceId": "llm_eval_case_normalize",
   "executionId": "example-execution",
   "startedAtMs": 0,
   "amountAtomic": "5000",
   "resultSha256": "35c7edda0781047359e02190ab429a4a8847abb8649cc5048ab43265ce0ebcbe",
   "serviceVersion": "1.0.0",
   "settlementReference": "0x0000000000000000000000000000000000000000000000000000000000000000"
  },
  "artifacts": [],
  "requestId": "example-request",
  "executionId": "example-execution"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/llm-eval-case-normalizer-4e2fae40/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from signalharness.ai](https://www.zero.xyz/host/signalharness.ai/llms.txt)