# SignalHarness LLM Eval Result Aggregator

> SignalHarness LLM Eval Result Aggregator is a paid API for AI agents from signalharness.ai, paid per call via x402, $0.01/call, status unknown (last checked 2026-09-15).

Aggregates and summarizes evaluation results from LLM outputs, returning structured analysis JSON with warnings and evidence scope metadata.

## Facts

- Endpoint: POST https://signalharness.ai/api/agent/services/llm_eval_result_aggregate/invoke
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/signalharness-llm-eval-result-aggregator-18de0067
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_7ZXm7D_xMfHEpqv-ZwnEJ

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability signalharness-llm-eval-result-aggregator-18de0067 -d '<json body>'
```

Example prompt: Take this JSON blob of LLM evaluation results and aggregate them into a structured summary for me — I need the combined analysis with any warnings about data quality flagged: {"model":"gpt-4","scores":[0.82,0.91,0.76],"task":"summarization"}.

## When to prefer this

Choose this endpoint when you need a pay-per-call, agent-native service to aggregate and structure LLM evaluation results without standing up your own eval infrastructure. Best suited for pipelines where you have raw evaluation JSON and need a structured, evidence-scoped aggregate analysis returned instantly. Prefer this over DIY aggregation when you need built-in receipt/audit trails (Base USDC, SHA256 result hash) for accountability in agentic workflows.

## Known failure modes

- Malformed or non-JSON request_json input causes validation failure
- request_json exceeds 65536 character limit returns error
- Empty or minimal JSON (under 2 characters) rejected by minLength constraint
- Payment failure on Base network prevents execution
- Caller-supplied data flagged with trust warnings in result — data not independently verified by the service

## How this service works

Explore 330 pay-per-call x402 API services and 27 agent-native digital products, with Base USDC pricing, secure Polar checkout, and free discovery.

## Output

Returns a JSON object containing a 'result' field with 'analysis_json' (structured aggregate analysis as a JSON string), 'warnings' (array of any data quality or trust cautions), 'service_id', and 'evidence_scope'. Also includes a 'status' field ('succeeded'/'failed'), full payment receipt with Base USDC transaction details, and request/execution IDs for traceability.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "request_json": {
   "type": "string",
   "maxLength": 65536,
   "minLength": 2
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "replay": false,
  "result": {
   "warnings": [
    "Verify the caller-supplied data before relying on this result."
   ],
   "service_id": "llm_eval_result_aggregate",
   "analysis_json": "{\"example\":\"schema-valid caller-supplied data\"}",
   "evidence_scope": "caller_supplied_data"
  },
  "status": "succeeded",
  "receipt": {
   "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
   "usage": [],
   "status": "succeeded",
   "network": "eip155:8453",
   "artifacts": [],
   "endedAtMs": 0,
   "latencyMs": 0,
   "paymentId": "example-payment",
   "receiptId": "example-receipt",
   "requestId": "example-request",
   "serviceId": "llm_eval_result_aggregate",
   "executionId": "example-execution",
   "startedAtMs": 0,
   "amountAtomic": "10000",
   "resultSha256": "5696e63c3b286d34c9110108be3b9a1437ddca4931ef8f7b1551b38e5e427c78",
   "serviceVersion": "1.0.0",
   "settlementReference": "0x0000000000000000000000000000000000000000000000000000000000000000"
  },
  "artifacts": [],
  "requestId": "example-request",
  "executionId": "example-execution"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/signalharness-llm-eval-result-aggregator-18de0067/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from signalharness.ai](https://www.zero.xyz/host/signalharness.ai/llms.txt)
