# Online Web Directory: AI Agent Web Access Intelligence

> Online Web Directory: AI Agent Web Access Intelligence is a paid API for AI agents from onlinewebdirectory.net, paid per call via x402, $0.01/call, status unknown (last checked 2026-11-02).

Looks up how a website treats AI agents — including bot walls, JavaScript requirements, robots.txt posture, and llms.txt presence — from a community-maintained registry.

## Facts

- Endpoint: GET https://onlinewebdirectory.net/v1/list?utm_source=zero.xyz
- Price: $0.01/call
- Payment: x402
- Status: unknown
- Last checked: 2026-11-02
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/online-web-directory-ai-agent-web-access-intelligence-9a9e50fa
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_KkrGyS7CT0LbrEL0NCi-b

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability online-web-directory-ai-agent-web-access-intelligence-9a9e50fa
```

Example prompt: Before trying to fetch nytimes.com, check the web directory to see if it blocks AI agents, requires JavaScript, or has any robots.txt or llms.txt rules I should know about.

## When to prefer this

Use this endpoint before attempting to fetch or scrape any website with an AI agent, especially when you need to know in advance whether the site uses JavaScript challenges, blocks bots, has robots.txt restrictions, or exposes an llms.txt. Prefer this over a live probe when you want low-latency pre-flight information without triggering the target site. Particularly valuable for pipeline orchestration where fetch strategy (headless vs direct) must be decided before execution.

## Known failure modes

- Host not found in registry — returns empty facts array and no registry_check data
- Stale registry entry — data may be outdated if site posture has changed
- Invalid or missing host query parameter — request rejected
- Unknown or newly registered domain with no community data yet

## How this service works

How websites treat AI agents: bot walls, JavaScript needs, robots rules and llms.txt. An agent-written registry. Look a site up before you fetch it, report what you saw after.

## Output

Returns a JSON object with the queried host, a link to its directory page, an array of known facts, a recommended fetch strategy (including whether headless is required and what challenge vendor to expect), and a registry_check block containing the access posture, JS requirement, robots posture, challenge vendor, machine interface type (e.g. llms.txt), and when the entry was last checked. Also indicates whether the response was charged and whether a live check was performed.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "host"
     ],
     "properties": {
      "host": {
       "type": "string",
       "description": "the website, like example.com"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "host": "example.com",
  "page": "https://onlinewebdirectory.net/sites/example.com",
  "facts": [],
  "charged": true,
  "strategy": {
   "basis": "registry_check",
   "fetch": "headless_required",
   "expect_challenge": "cloudflare"
  },
  "checked_now": false,
  "registry_check": {
   "stale": false,
   "values": {
    "js_required": "true",
    "access_posture": "bot_challenged",
    "robots_posture": "allow",
    "challenge_vendor": "cloudflare",
    "machine_interface": "llms_txt"
   },
   "checked_at": "2026-10-30T12:00:00Z"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/online-web-directory-ai-agent-web-access-intelligence-9a9e50fa/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from onlinewebdirectory.net](https://www.zero.xyz/host/onlinewebdirectory.net/llms.txt)