# APIAcre Robots & Sitemap Inspector

> APIAcre Robots & Sitemap Inspector is a paid API for AI agents from apiacre.com, paid per call via x402, $0.025/call, status unknown (last checked 2026-09-13).

Fetches and parses a website's robots.txt crawl rules and checks for sitemap availability at a given URL.

## Facts

- Endpoint: POST https://apiacre.com/v1/web/robots-sitemap
- Price: $0.025/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-13
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/apiacre-robots-sitemap-inspector-c904c46f
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_ArNm-6EAZ0R8ISwoSYmm9

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability apiacre-robots-sitemap-inspector-c904c46f -d '<json body>'
```

Example prompt: Can you check the robots.txt and sitemap availability for example.com — I want to know which paths are disallowed and whether there's a sitemap we can use?

## When to prefer this

Use this endpoint when you need a structured, parsed view of a site's robots.txt and sitemap availability without writing your own HTTP fetch and parsing logic. It is ideal for pre-scrape compliance checks, SEO audits, and automated crawl planning workflows where you need machine-readable crawl rules quickly.

## Known failure modes

- Target domain unreachable or returns non-200 status for robots.txt
- Robots.txt missing or malformed — partial or empty parse result
- Sitemap declared in robots.txt but URL itself returns 404
- Rate limiting or bot blocking by target domain preventing fetch
- Invalid or malformed input URL

## How this service works

Inspect a domain's robots.txt crawl rules and XML sitemap health, availability, and URL count.

## Output

Returns parsed robots.txt crawl directives including allowed and disallowed paths per user agent, crawl delay settings, and the availability and URLs of any declared sitemaps for the target domain.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "url": {
   "type": "string",
   "title": "Url",
   "format": "uri",
   "maxLength": 2083,
   "minLength": 1
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "json",
 "example": {
  "data": {
   "origin": "https://example.com",
   "robots": {
    "rules": 0,
    "sitemaps": [],
    "available": false,
    "statusCode": 404,
    "contentType": "text/html"
   },
   "sitemap": {
    "bytes": 0,
    "urlCount": 0,
    "available": false,
    "statusCode": 404,
    "contentType": "text/html"
   }
  },
  "meta": {
   "cached": false,
   "sources": [],
   "warnings": [],
   "duration_ms": 42,
   "next_actions": []
  },
  "service": "web.robots-sitemap",
  "version": "1",
  "request_id": "018f1f54-7f38-7ba2-8dc3-5f90272d9f1a"
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/apiacre-robots-sitemap-inspector-c904c46f/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from apiacre.com](https://www.zero.xyz/host/apiacre.com/llms.txt)