402utils LLMs.txt Fetcher & Parser

API ↗

402utils LLMs.txt Fetcher & Parser is a paid API for AI agents from 402utils.com, paid per call via x402, $0.002/call, status unknown (last checked 2026-10-11).

Fetches and parses a site's /llms.txt file (the LLM-era robots.txt), returning its title, summary, and structured section links, plus probing for /llms-full.txt.

How this service works

Fetch and parse a site's llms.txt (llmstxt.org) — the LLM-era robots.txt. Give any page URL; it resolves the origin's /llms.txt, and returns the H1 title, the blockquote summary, and every section's links ([title](url): notes). Also probes /llms-full.txt and reports its size. A site without one returns {found:false} (a 200, still useful). The fetch is SSRF-checked. Bonus signal in /v1/site-profile.

Output

A JSON object with: whether /llms.txt was found (found: bool), the resolved llms.txt URL, the HTTP status of the fetch, the H1 title, the blockquote summary, an array of sections each with a name and list of links (title, url, optional notes), total link count, and a fullVersion object indicating if /llms-full.txt exists and its size in bytes. Returns {found: false} with HTTP 200 if no llms.txt is present.