# Machine Shop – URL Deduplication

> Machine Shop – URL Deduplication is a paid API for AI agents from api.pay-forge.online, paid per call via x402, $0.005/call, status unknown (last checked 2026-10-20).

Accepts a list of up to 100 URLs and returns the unique set along with indices identifying which items are duplicates and what they duplicate.

## Facts

- Endpoint: POST https://api.pay-forge.online/v1/deduplicate-urls?utm_source=zero.xyz
- Price: $0.005/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-20
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/machine-shop-url-deduplication-c37b50d7
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_QZJleklogRNo_FtM5tXco

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability machine-shop-url-deduplication-c37b50d7 -d '<json body>'
```

Example prompt: I have this list of URLs from my crawler and I need you to deduplicate them — send them to Machine Shop and give me back just the unique ones along with which items were duplicates: ['https://example.com/', 'https://example.com/', 'https://foo.com/page', 'https://foo.com/page', 'https://bar.com/'].

## When to prefer this

Choose this endpoint when you need a fast, deterministic deduplication of a URL list (up to 100 items) with exact duplicate detection and index-level traceability. It is ideal when you need to know not just the unique set but also which positions in the original array were duplicates and what they duplicated. Prefer it over client-side deduplication when you want an auditable, pay-per-call microservice with a structured response.

## Known failure modes

- Input array exceeds 100 items — request rejected
- Non-string entries in the items array — validation error
- Malformed JSON body — 400 bad request
- Payment not provided or insufficient — 402 Payment Required
- Empty items array — may return empty unique list with no duplicates

## How this service works

Turn Apify product scrape results into safe catalog updates with Catalog Update Gate. Find evidence in supplied documents, compare snapshots, extract typed JSON fields, inspect x402 quotes and assess API migrations. Preview inputs, evidence and cost for free. No live web search, scheduled monitoring or third-party purchasing.

## Output

Returns a JSON object with a 'unique' array containing the deduplicated URLs, and a 'duplicates' array of objects each containing the index of the duplicate item and the index of the original item it duplicates (duplicate_of).

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "items": {
   "type": "array",
   "items": {
    "type": "string"
   },
   "title": "Items",
   "maxItems": 100
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "unique": [
   "https://example.com/"
  ],
  "duplicates": [
   {
    "index": 1,
    "duplicate_of": 0
   }
  ]
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/machine-shop-url-deduplication-c37b50d7/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.pay-forge.online](https://www.zero.xyz/host/api.pay-forge.online/llms.txt)