# Scrape-Permit URL Check

> Scrape-Permit URL Check is a paid API for AI agents from apiwitchcraft.duckdns.org, paid per call via x402, $0.002/call, status unknown (last checked 2026-09-14).

Checks whether a given URL is permitted to be scraped (i.e., allows web scraping based on its robots.txt or access policy).

## Facts

- Endpoint: GET https://apiwitchcraft.duckdns.org/scrape-permit/check
- Price: $0.002/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-14
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrape-permit-url-check-dbb5df36
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_etLUni9UgaMIlWH2yoqWI

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrape-permit-url-check-dbb5df36
```

Example prompt: Before I scrape it, can you check whether https://example.com/products is permitted for scraping?

## When to prefer this

Use this endpoint before initiating any web scraping workflow to programmatically verify that a target URL permits automated GET access, avoiding potential legal or policy violations. Prefer this over manual robots.txt parsing when you need a fast, API-integrated permission check as part of an agent pipeline.

## Known failure modes

- Missing or invalid 'url' query parameter returns a validation error
- URL is unreachable or times out, resulting in an error or indeterminate response
- Malformed URL format causes a parsing or bad-request error
- Payment not provided or insufficient USDC results in a 402 response blocking access

## How this service works

Scrape-permit API: check whether a website allows automated scraping before you crawl it. Returns robots.txt rules, AI-crawler directives, rate limits, licensing/ToS flags, and a clear 'scrape allowed / restricted' verdict. x402 pay-per-call on Base USDC. Keeps AI agents and data pipelines compliant and avoids bans and legal risk.

## Output

Returns a permission status indicating whether the specified URL allows scraping via GET requests, based on its access policy or robots.txt rules.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrape-permit-url-check-dbb5df36/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from apiwitchcraft.duckdns.org](https://www.zero.xyz/host/apiwitchcraft.duckdns.org/llms.txt)