# Web Dossier Extraction & RAG Ingestion

> Web Dossier Extraction & RAG Ingestion is a paid API for AI agents from x402-gateway-production-1f21.up.railway.app, paid per call via x402, $0.008/call, status unknown (last checked 2026-10-12).

Fetches a URL and returns a structured dossier of its content including full text, metadata, and RAG-ready chunked segments for downstream ingestion

## Facts

- Endpoint: POST https://x402-gateway-production-1f21.up.railway.app/web/dossier?utm_source=zero.xyz
- Price: $0.008/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-12
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/web-dossier-extraction-rag-ingestion-5a5076f9
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_qnM682wN9dfX42rjTyCq2

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability web-dossier-extraction-rag-ingestion-5a5076f9 -d '<json body>'
```

Example prompt: Fetch the page at https://example.com/blog/ai-trends and extract all its text as a dossier with chunks of 500 characters and an overlap of 50 — I want it ready for RAG ingestion.

## When to prefer this

Choose this endpoint when you need to ingest a single webpage or document URL into a RAG pipeline with configurable chunking, or when you need structured text plus metadata from a web page in one call. Prefer it over generic scrapers when chunk_size and chunk_overlap control matter for downstream embedding workflows. Best for agentic pipelines that need machine-payable, per-call web extraction without maintaining infrastructure.

## Known failure modes

- URL is unreachable or returns non-200 status — extraction fails with error
- Page is JavaScript-rendered and content is not accessible via static fetch
- max_text_chars exceeded or content is too large — truncation or rejection
- Invalid URL format — schema validation error
- Rate limiting or blocking by target website — empty or partial content returned
- Payment not received via x402 — 402 response before processing begins

## How this service works

Machine-payable x402 utilities for hashing, Base64, UUID generation, unit and timezone conversion, realtime crypto market data, webpage/document extraction, URL-to-Markdown, metadata, RAG ingestion and deterministic website change detection.

## Output

Returns a JSON object with status 'ready' plus extracted page text, document metadata (title, description, URL), and chunked text segments sized and overlapped according to input parameters, suitable for direct ingestion into a vector store or RAG pipeline.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method",
    "bodyType",
    "body"
   ],
   "properties": {
    "body": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "format": "uri"
      },
      "chunk_size": {
       "type": "integer",
       "maximum": 10000,
       "minimum": 100
      },
      "user_agent": {
       "type": "string",
       "maxLength": 200
      },
      "chunk_overlap": {
       "type": "integer",
       "maximum": 5000,
       "minimum": 0
      },
      "max_text_chars": {
       "type": "integer",
       "maximum": 150000,
       "minimum": 1000
      }
     },
     "additionalProperties": false
    },
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "POST"
     ],
     "type": "string"
    },
    "bodyType": {
     "enum": [
      "json",
      "form-data",
      "text"
     ],
     "type": "string"
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "status": "ready"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/web-dossier-extraction-rag-ingestion-5a5076f9/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from x402-gateway-production-1f21.up.railway.app](https://www.zero.xyz/host/x402-gateway-production-1f21.up.railway.app/llms.txt)