# ManyLives Label Agreement Calculator

> ManyLives Label Agreement Calculator is a paid API for AI agents from api.manylives.me, paid per call via x402, $0.003/call, status unknown (last checked 2026-10-17).

Computes inter-annotator agreement statistics (Cohen's kappa, Krippendorff's alpha, pairwise agreement) from a CSV or row list of item/annotator/label triples

## Facts

- Endpoint: POST https://api.manylives.me/paid/data/label-agreement?utm_source=zero.xyz
- Price: $0.003/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-17
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/manylives-label-agreement-calculator-a1e8bf55
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_WlG3Aw65vvwJNKTb4LMhe

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability manylives-label-agreement-calculator-a1e8bf55 -d '<json body>'
```

Example prompt: Check how much my annotators agree — here's the CSV with columns item, annotator, label: 'item,annotator,label\n1,a1,cat\n1,a2,cat\n1,a3,dog\n2,a1,dog\n2,a2,dog\n2,a3,dog' — the valid labels are cat and dog, case-insensitive.

## When to prefer this

Use this endpoint when you need fast, pay-per-call inter-annotator agreement computation without setting up an account or running your own statistics library. Ideal for ML pipelines that periodically validate annotation quality, for agents auditing crowdsourced labeling jobs, or when you need both pairwise kappa and Krippendorff's alpha in a single call. Prefer it over rolling your own when you need immediate results on small-to-medium annotation batches and want itemized dispute lists alongside summary statistics.

## Known failure modes

- Malformed CSV (missing required columns item/annotator/label) returns a parse error
- Labels outside the allowed_labels list are flagged or rejected
- Fewer than 2 annotators per item makes kappa undefined
- Very small datasets may produce unreliable alpha estimates
- Non-UTF-8 or binary content in CSV body causes parse failure

## How this service works

Pay-per-call tools for people building AI agents: live web search and page contents, point-in-time crypto market data and news for backtests (no lookahead), verifiable track records of 1,000 crypto strategies locked on the Base network, company profiles, quick AI and batch prices. Ask us to turn a public website into a JSON endpoint. Pay per call, no account, free trial.

## Output

Returns a JSON object with: total row and item counts, pairwise Cohen's kappa and agreement percentage for every annotator pair, Krippendorff's alpha across all annotators, per-annotator agreement vs majority, list of disputed items with label distribution, and a problems array flagging ties or anomalies.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "csv": {
   "type": "string",
   "examples": [
    "item,annotator,label\n1,a1,cat\n1,a2,cat\n1,a3,dog\n2,a1,dog\n2,a2,dog\n2,a3,dog\n3,a1,cat\n3,a2,bird\n3,a3,cat"
   ],
   "description": "or CSV text with item,annotator,label columns"
  },
  "rows": {
   "type": "string",
   "description": "list of {item, annotator, label}"
  },
  "allowed_labels": {
   "type": "string",
   "examples": [
    [
     "cat",
     "dog"
    ]
   ],
   "description": "optional list of valid labels"
  },
  "case_sensitive": {
   "type": "string",
   "description": "optional, default false"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "rows": 42,
  "items": 12,
  "pairwise": [
   {
    "a": "A",
    "b": "C",
    "items": 8,
    "kappa": 0.478,
    "agreement": 0.625
   }
  ],
  "problems": [
   "1 item with no majority label (tied)"
  ],
  "annotators": 4,
  "disputed_items": [
   {
    "item": "u6",
    "labels": {
     "1": 1,
     "2": 1,
     "3": 1,
     "4": 1
    }
   }
  ],
  "krippendorff_alpha": 0.743,
  "annotators_vs_majority": [
   {
    "labels": 10,
    "compared": 9,
    "annotator": "C",
    "agrees_with_others_majority": 0.778
   }
  ],
  "items_with_2plus_labels": 11
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/manylives-label-agreement-calculator-a1e8bf55/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.manylives.me](https://www.zero.xyz/host/api.manylives.me/llms.txt)