# ScrapFly Crawl Metadata API

> ScrapFly Crawl Metadata API is a paid API for AI agents from scrapfly.vercel.app, paid per call via x402, $0.01/call, status unknown (last checked 2026-10-24).

Fetches structured metadata from a given URL via web crawling

## Facts

- Endpoint: POST https://scrapfly.vercel.app/api/crawl/metadata?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-24
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapfly-crawl-metadata-api-8a538900
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_Hq4um7jum7Bybirq-SSEk

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapfly-crawl-metadata-api-8a538900 -d '<json body>'
```

Example prompt: Can you crawl this URL and pull back all the structured metadata from the page: https://example.com/blog/my-article?

## When to prefer this

Choose this endpoint when you need to programmatically extract structured metadata from a specific web page URL without building your own scraping infrastructure. It is ideal for agents that need page title, description, Open Graph data, or other metadata for link previews, SEO audits, or content enrichment pipelines. Prefer it over browser automation or raw HTTP fetching when you want a managed, pay-per-use scraping service that handles anti-bot challenges.

## Known failure modes

- Invalid or malformed URL returns an error or success:false
- Target URL is unreachable or returns a non-200 status, resulting in empty or failed crawl
- Anti-bot protections on the target site may block the crawl and return partial or no data
- Rate limiting or payment issues on the x402/Base chain side may prevent the request from completing
- Timeout if the target URL is slow to respond

## How this service works

69 endpoints for data, content generation, and web scraping. Pay per request via x402 on Base chain.

## Output

Returns a JSON object with a success boolean and a data object containing structured metadata extracted from the crawled URL, such as page title, description, Open Graph tags, and other available metadata fields.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "url"
 ],
 "properties": {
  "url": {
   "type": "string",
   "description": "url"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "success"
 ],
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapfly-crawl-metadata-api-8a538900/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from scrapfly.vercel.app](https://www.zero.xyz/host/scrapfly.vercel.app/llms.txt)