# TariffMonkee Crawler Diligence Check

> TariffMonkee Crawler Diligence Check is a paid API for AI agents from tariffmonkee.com, paid per call via x402, $0.04/call, status unknown (last checked 2026-09-13).

Runs due-diligence checks on a URL to assess how well it behaves for web crawlers, returning signals useful for evaluating a site's crawlability and trustworthiness.

## Facts

- Endpoint: GET https://tariffmonkee.com/paid/crawler-diligence
- Price: $0.04/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-13
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/tariffmonkee-crawler-diligence-check-390cec43
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap__9R998mW7T3Z9mhEYQs16

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability tariffmonkee-crawler-diligence-check-390cec43
```

Example prompt: Before my agent scrapes that site, can you run a crawler diligence check on https://example.com to see if it allows bots and looks trustworthy?

## When to prefer this

Choose this endpoint when you need a quick, pay-per-call assessment of whether a URL is safe and permitted for automated crawling — especially before committing to a full scrape or adding a domain to a content pipeline. Prefer it over manual inspection when you need programmatic, structured crawler compliance signals without setting up accounts or subscriptions. It complements browser-rendering or content-extraction endpoints by acting as a gatekeeper check first.

## Known failure modes

- URL is unreachable or returns a network error, resulting in incomplete report
- Target site actively blocks the diligence probe, returning limited or no data
- Malformed or non-HTTP URL input causes a request validation error
- Rate limiting or timeout on the target domain prevents full signal collection
- The site uses advanced bot detection that obscures true crawlability status

## How this service works

Small, single-purpose web data APIs that AI agents pay for per call in USDC over the x402 protocol (HTTP 402). No accounts, no API keys, no subscriptions.

## Output

A structured report on the target URL's crawler diligence, including signals about robots.txt rules, bot-blocking behavior, site trustworthiness indicators, and overall crawlability assessment — helping an agent decide whether it is safe and permitted to proceed with fetching content from the domain.

## Request schema (JSON Schema)

```json
{
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    }
   },
   "additionalProperties": false
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/tariffmonkee-crawler-diligence-check-390cec43/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from tariffmonkee.com](https://www.zero.xyz/host/tariffmonkee.com/llms.txt)