# Rafid Website Downloader — Full Site Archive & Manifest

> Rafid Website Downloader — Full Site Archive & Manifest is a paid API for AI agents from api.rafidsystem.com, paid per call via x402, $0.75/call, status unknown (last checked 2026-10-10).

Crawls and downloads a website into a structured archive and/or file manifest, following links up to a configurable depth and file limit.

## Facts

- Endpoint: POST https://api.rafidsystem.com/api/v1/x402/websites/download?utm_source=zero.xyz
- Price: $0.75/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-10
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/rafid-website-downloader-full-site-archive-manifest-3ecb3927
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_jaKAeqVlq6B_8YV-gfiSc

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability rafid-website-downloader-full-site-archive-manifest-3ecb3927 -d '<json body>'
```

Example prompt: Download the entire website at https://example.com up to 3 levels deep, include all assets like images and CSS, stay on the same domain only, and give me back both the archive and a full file manifest — cap it at 2000 files and 100 MB.

## When to prefer this

Choose this endpoint when you need to capture a full or partial snapshot of a website — including its pages and static assets — as a structured archive or file manifest. It is ideal for compliance archiving, competitive analysis of site structure, offline mirroring, or pre-processing website content for downstream AI workflows. Prefer this over single-page scrapers when you need recursive multi-level crawling with asset collection in one API call.

## Known failure modes

- Target URL unreachable or returns non-2xx — success=false with error detail
- Crawl exceeds maxSizeMb limit — partial archive returned with warning
- Crawl exceeds timeoutSeconds — partial results with timeout warning
- maxDepth=0 with no files found — empty manifest
- robots.txt or auth-gated pages block crawl — limited coverage with warnings
- Invalid URL format — validation error on input
- Domain has infinite redirect loops — timeout or warning triggered

## How this service works

Rafid Agent API provides structured intelligence and paid APIs for AI agents across property, company and risk, supplier, finance, document, website, automotive, logistics, recruitment, trading, voice, video and business-planning workflows.

## Output

Returns a JSON object containing: a success flag, the final resolved URL, a manifest listing every downloaded file with its local path, content type, and size in bytes, an optional binary archive, total file and size counts, pages and assets downloaded counts, elapsed duration in milliseconds, and any warnings encountered during crawl.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "url": {
   "type": "string",
   "maxLength": 2048,
   "minLength": 1
  },
  "output": {
   "enum": [
    "manifest",
    "archive",
    "archive_and_manifest"
   ],
   "type": "string",
   "default": "archive_and_manifest"
  },
  "maxDepth": {
   "type": "integer",
   "default": 3,
   "maximum": 10,
   "minimum": 0
  },
  "maxFiles": {
   "type": "integer",
   "default": 2000,
   "maximum": 10000,
   "minimum": 1
  },
  "maxSizeMb": {
   "type": "integer",
   "default": 100,
   "maximum": 1024,
   "minimum": 1
  },
  "convertLinks": {
   "type": "boolean",
   "default": true
  },
  "includeAssets": {
   "type": "boolean",
   "default": true
  },
  "sameDomainOnly": {
   "type": "boolean",
   "default": true
  },
  "timeoutSeconds": {
   "type": "integer",
   "default": 120,
   "maximum": 900,
   "minimum": 5
  },
  "adjustExtensions": {
   "type": "boolean",
   "default": true
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "archive": null,
  "success": true,
  "finalUrl": "https://example.com/",
  "manifest": {
   "files": [
    {
     "type": "html",
     "localPath": "example.com/index.html",
     "sizeBytes": 1256,
     "contentType": null
    }
   ]
  },
  "warnings": [],
  "sourceUrl": "https://example.com/",
  "durationMs": 1200,
  "totalFiles": 1,
  "totalSizeBytes": 1256,
  "pagesDownloaded": 1,
  "assetsDownloaded": 0
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/rafid-website-downloader-full-site-archive-manifest-3ecb3927/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.rafidsystem.com](https://www.zero.xyz/host/api.rafidsystem.com/llms.txt)