# Remove Duplicates → Filter → Count by Group Data Pipeline

> Remove Duplicates → Filter → Count by Group Data Pipeline is a paid API for AI agents from market.datapackvibe.com, paid per call via x402, $0.01/call, status unknown (last checked 2026-10-14).

Processes a flat record set through three sequential steps: deduplication, value-based row filtering, and grouped value counting — returning output and row counts per step.

## Facts

- Endpoint: POST https://market.datapackvibe.com/x402/assistant-cap-229469365aa2e85eabe5?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/remove-duplicates-filter-count-by-group-data-pipeline-3dcf1a91
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_2bJDDHv4VqNT9djHFukH9

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability remove-duplicates-filter-count-by-group-data-pipeline-3dcf1a91 -d '<json body>'
```

Example prompt: I have a list of up to 300 customer records with a 'category' field — can you run them through the dedup, filter, and count-by-group pipeline so I can see how many unique entries fall into each category?

## When to prefer this

Choose this endpoint when you need a lightweight, all-in-one data cleaning and aggregation pipeline on up to 300 flat records without any external data lookup. It is ideal when you want deduplication, non-null filtering, and group counting in a single paid call rather than chaining separate tools. At $0.01 USDC per call it is cost-effective for small to medium batch jobs on customer-supplied tabular data.

## Known failure modes

- records array is empty or missing — returns validation error
- records exceed 300 items — rejected by maxItems constraint
- field name does not match pattern (must start with a letter, alphanumeric/underscore, max 40 chars) — schema validation error
- records contain objects with more than 30 properties — rejected by maxProperties constraint
- all rows are duplicates and filtered out — returns empty result with zero counts

## How this service works

Remove duplicate rows → Keep rows with a value → Count values by group: Process customer-supplied records: Remove duplicate rows → Keep rows with a value → Count values by group. Returns the processed output and row counts per step. No external data lookup. 0.01 USDC includes up to 300 flat records.

## Output

Returns the processed output at each pipeline stage (deduplicated records, filtered records, grouped counts) along with row counts per step, so the caller can audit data loss and see final aggregation.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "field": {
   "type": "string",
   "default": "text",
   "pattern": "^[a-zA-Z][a-zA-Z0-9_]{0,39}$",
   "maxLength": 40
  },
  "records": {
   "type": "array",
   "items": {
    "type": "object",
    "maxProperties": 30,
    "additionalProperties": {
     "type": [
      "string",
      "number",
      "boolean",
      "null"
     ]
    }
   },
   "default": [
    {
     "text": " Useful example ",
     "value": 10
    },
    {
     "text": "Useful example",
     "value": 20
    },
    {
     "text": "Other row",
     "value": 5
    }
   ],
   "maxItems": 300,
   "minItems": 1
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/remove-duplicates-filter-count-by-group-data-pipeline-3dcf1a91/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from market.datapackvibe.com](https://www.zero.xyz/host/market.datapackvibe.com/llms.txt)