# SignalHarness RAG Pipeline Evaluation Report

> SignalHarness RAG Pipeline Evaluation Report is a paid API for AI agents from signalharness.ai, paid per call via x402, $0.025/call, status unknown (last checked 2026-09-15).

Evaluates a RAG (Retrieval-Augmented Generation) pipeline by analyzing caller-supplied data and returning a structured evaluation report with analysis JSON and warnings.

## Facts

- Endpoint: POST https://signalharness.ai/api/agent/services/rag_pipeline_evaluation_report/invoke
- Price: $0.025/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/signalharness-rag-pipeline-evaluation-report-2b2011e8
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_JkMSzo05CtBAxE4G6zsGL

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability signalharness-rag-pipeline-evaluation-report-2b2011e8 -d '<json body>'
```

Example prompt: Can you run an evaluation report on my RAG pipeline data and tell me what issues or warnings come up? Here's the pipeline JSON: {"retriever":"dense","chunks":50,"query":"what is the capital of France","retrieved_docs":["Paris is the capital..."],"generated_answer":"Paris"}.

## When to prefer this

Choose this endpoint when you need a structured, on-demand evaluation report for a RAG pipeline and want results returned as machine-readable JSON with explicit warnings. It is particularly useful for agents that need to audit RAG system quality programmatically at low cost ($0.025/call) without standing up their own evaluation infrastructure. Prefer this over generic LLM prompting when you need a standardized report format with an auditable receipt.

## Known failure modes

- Invalid or malformed request_json input returns a validation error
- request_json exceeding 65536 characters is rejected
- Missing required request_json field causes a failure response
- Caller-supplied data that cannot be parsed may yield warnings rather than a hard error
- Payment failure on the x402 protocol results in no execution

## How this service works

Explore 330 pay-per-call x402 API services and 27 agent-native digital products, with Base USDC pricing, secure Polar checkout, and free discovery.

## Output

Returns a JSON object containing an analysis_json field with the structured evaluation findings, a warnings array listing any data quality or reliability concerns, an evidence_scope indicating the data source (caller-supplied), and a payment receipt with execution metadata including latency, payment ID, and result hash.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "request_json": {
   "type": "string",
   "maxLength": 65536,
   "minLength": 2
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "replay": false,
  "result": {
   "warnings": [
    "Verify the caller-supplied data before relying on this result."
   ],
   "service_id": "rag_pipeline_evaluation_report",
   "analysis_json": "{\"example\":\"schema-valid caller-supplied data\"}",
   "evidence_scope": "caller_supplied_data"
  },
  "status": "succeeded",
  "receipt": {
   "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
   "usage": [],
   "status": "succeeded",
   "network": "eip155:8453",
   "artifacts": [],
   "endedAtMs": 0,
   "latencyMs": 0,
   "paymentId": "example-payment",
   "receiptId": "example-receipt",
   "requestId": "example-request",
   "serviceId": "rag_pipeline_evaluation_report",
   "executionId": "example-execution",
   "startedAtMs": 0,
   "amountAtomic": "25000",
   "resultSha256": "3f1ad893918472771b6dc2562dc98813cb816833968d47e84b76d4510bb6a333",
   "serviceVersion": "1.0.0",
   "settlementReference": "0x0000000000000000000000000000000000000000000000000000000000000000"
  },
  "artifacts": [],
  "requestId": "example-request",
  "executionId": "example-execution"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/signalharness-rag-pipeline-evaluation-report-2b2011e8/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from signalharness.ai](https://www.zero.xyz/host/signalharness.ai/llms.txt)