# A/B Test Readout Check

> A/B Test Readout Check is a paid API for AI agents from api.aiskills402.com, paid per call via x402, $0.01/call, status unknown (last checked 2026-10-20).

Reviews a written A/B test readout (paragraph, email, table, or slide transcript) and flags up to five specific statistical mistakes that can falsely declare a no-effect test a win.

## Facts

- Endpoint: GET https://api.aiskills402.com/v1/skills/ab-test-readout-check/file?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-20
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/a-b-test-readout-check-ea776208
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_JZXmfWQnAgA1mSv3a3-LH

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability a-b-test-readout-check-ea776208
```

Example prompt: Can you check this A/B test readout for statistical mistakes — like peeking, multiple comparisons without correction, or a skewed user split — and tell me exactly what's wrong and how to fix it? Here's the paragraph: 'We ran the test for 3 days and stopped when variant B hit p=0.04 across 12 metrics, with a 52/48 user split instead of the planned 50/50.'

## When to prefer this

Choose this endpoint when you need a focused, codified statistical audit of a single A/B test write-up — particularly to catch peeking, multiple comparison issues, or sample ratio mismatch before results are shared with stakeholders. Prefer it over general-purpose LLM prompting when you need consistent error codes and structured one-line findings rather than free-form commentary.

## Known failure modes

- Input text is too short or lacks enough context to assess statistical validity
- The readout does not contain quantitative results, making statistical checks impossible
- API returns an error if the request payload or headers are malformed
- Service may not detect mistakes in highly ambiguous or incomplete descriptions
- Edge case: if the readout is in a language other than English, detection quality may degrade

## How this service works

A/B Test Readout Check — Checks the written readout of ONE A/B test (a paragraph, an email, a table or a slide transcript) for the five statistical mistakes that turn a no-effect test into a "win", and lists only those, one line each with a fixed code, the place, the evidence with the arithmetic and the fix - or exactly No findings. It catches stopping the moment a result looks significant, many metrics or variants judged without correction, a split of users that differs from the planned split …

## Output

A list of statistical mistakes found in the readout, each on one line with a fixed error code, the location in the text, arithmetic evidence, and a concrete fix — or exactly 'No findings' if the readout is clean. The service checks for: early stopping/peeking, multiple metrics or variants without correction, sample ratio mismatch versus planned split, and related statistical errors.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD"
     ],
     "type": "string"
    },
    "headers": {
     "type": "object",
     "additionalProperties": {
      "type": "string"
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/a-b-test-readout-check-ea776208/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.aiskills402.com](https://www.zero.xyz/host/api.aiskills402.com/llms.txt)