# A/B Test Statistical Significance Calculator

> A/B Test Statistical Significance Calculator is a paid API for AI agents from math-stats.x402tookit.com, paid per call via x402, $0.02/call, status unknown (last checked 2026-10-29).

Computes conversion rates, relative lift, two-proportion z-test p-value, confidence interval, and a significance verdict for an A/B experiment.

## Facts

- Endpoint: GET https://math-stats.x402tookit.com/ab-test?utm_source=zero.xyz
- Price: $0.02/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-29
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/a-b-test-statistical-significance-calculator-1d4da3c8
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap__ZBUEqQz2eILeO1ffKknR

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability a-b-test-statistical-significance-calculator-1d4da3c8
```

Example prompt: Can you run an A/B significance test on my experiment? Control had 10,000 visitors and 320 conversions, variant had 10,200 visitors and 380 conversions — use a 0.05 significance level and tell me if the lift is statistically significant.

## When to prefer this

Choose this endpoint when you need a complete, ready-to-interpret A/B test report — not just a raw p-value — including relative lift, confidence intervals, and a plain-language verdict. It is ideal for product and marketing teams running two-group conversion experiments where a two-proportion z-test is the standard method. Prefer it over a generic statistics library when you want the verdict and summary text included in the response without post-processing.

## Known failure modes

- Missing required parameters (visitorsA, conversionsA, visitorsB, conversionsB) returns a validation error
- Alpha outside 0.001–0.2 range may be rejected or defaulted
- Conversions exceeding visitor count produces invalid input error
- Very small sample sizes may return a result with enoughConversions=false and a degraded flag
- Zero visitors in either group causes division-by-zero handling with a degraded response

## How this service works

A/B conversion test: rates, relative lift, two-proportion z-test p-value, confidence interval and a significance verdict.

## Output

Returns conversion rates for both groups, the absolute difference in percentage points, relative lift percentage, pooled rate, z-statistic, two-sided p-value, confidence interval (lower/upper bounds with level), a boolean significance flag, a human-readable verdict string, a summary, reasons list, whether there were enough conversions, and optional degraded/disclaimer fields.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "visitorsA",
      "conversionsA",
      "visitorsB",
      "conversionsB"
     ],
     "properties": {
      "alpha": {
       "type": "number",
       "description": "Significance level 0.001 to 0.2 (default 0.05)"
      },
      "visitorsA": {
       "type": "number",
       "description": "Visitors in A (control)"
      },
      "visitorsB": {
       "type": "number",
       "description": "Visitors in B (variant)"
      },
      "conversionsA": {
       "type": "number",
       "description": "Conversions in A"
      },
      "conversionsB": {
       "type": "number",
       "description": "Conversions in B"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object",
     "properties": {
      "asOf": {
       "type": [
        "null",
        "string"
       ]
      },
      "alpha": {
       "type": [
        "null",
        "number"
       ]
      },
      "rateA": {
       "type": [
        "null",
        "number"
       ]
      },
      "rateB": {
       "type": [
        "null",
        "number"
       ]
      },
      "source": {
       "type": [
        "null",
        "string"
       ]
      },
      "reasons": {
       "type": [
        "array",
        "null"
       ],
       "items": {
        "type": "string"
       }
      },
      "summary": {
       "type": [
        "null",
        "string"
       ]
      },
      "verdict": {
       "type": [
        "null",
        "string"
       ]
      },
      "degraded": {
       "type": [
        "boolean",
        "null"
       ]
      },
      "disclaimer": {
       "type": [
        "null",
        "string"
       ]
      },
      "notChecked": {
       "type": [
        "array",
        "null"
       ],
       "items": {
        "type": "string"
       }
      },
      "pooledRate": {
       "type": [
        "null",
        "number"
       ]
      },
      "zStatistic": {
       "t
… (truncated)
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/a-b-test-statistical-significance-calculator-1d4da3c8/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from math-stats.x402tookit.com](https://www.zero.xyz/host/math-stats.x402tookit.com/llms.txt)