# agentstools.dev Structured Web Page Parser

> agentstools.dev Structured Web Page Parser is a paid API for AI agents from api.agentstools.dev, paid per call via x402, $0.003/call, status unknown (last checked 2026-10-13).

Parses a public URL into structured fields: main text, headings, links, tables, and rich metadata (Open Graph, Twitter cards, JSON-LD, canonical, lang) without a browser.

## Facts

- Endpoint: GET https://api.agentstools.dev/structured?utm_source=zero.xyz
- Price: $0.003/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-13
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/agentstools-dev-structured-web-page-parser-dd22b7f3
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_mToxFvGJv-UInNhv5f_GQ

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agentstools-dev-structured-web-page-parser-dd22b7f3
```

Example prompt: Can you parse https://techcrunch.com/2024/01/15/openai-sora/ and give me the main text, headings, and all the Open Graph and JSON-LD metadata from that page?

## When to prefer this

Choose this endpoint when you need a structured breakdown of a public web page's content into typed fields (text, headings, links, tables, metadata) rather than raw HTML. It is ideal for agents that need to reason over page content, extract Open Graph/JSON-LD/Twitter card metadata for enrichment, or feed structured content into downstream processing — all without spinning up a browser. Prefer it over raw HTML fetch endpoints when clean field separation matters, and over full crawlers when you only need a single page.

## Known failure modes

- URL is not publicly accessible (private/paywalled) — returns error or empty content
- robots.txt disallows crawling — request is refused with a robots-blocked error
- Malformed or non-HTTP URL — validation error on the 'url' query parameter
- Page returns non-200 status — upstream HTTP error propagated
- Page has no structured metadata — metadata fields returned empty or null
- Timeout on slow-loading upstream page — timeout error

## How this service works

Structured parse of a public web page: main text, headings, links, tables and rich metadata (description, canonical, lang, Open Graph, Twitter cards, JSON-LD) as separate fields. Browserless, robots.txt-respecting.

## Output

A structured object with separate fields for: main page text, headings array, de-duplicated links, tables, and rich metadata including description, canonical URL, language, Open Graph tags, Twitter card tags, and JSON-LD — only the sections requested via the optional 'include' filter.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD",
      "DELETE"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "Public http(s) URL to parse"
      },
      "include": {
       "type": "array",
       "items": {
        "enum": [
         "text",
         "headings",
         "links",
         "tables",
         "metadata"
        ],
        "type": "string"
       },
       "description": "Which sections to return (default: all)"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agentstools-dev-structured-web-page-parser-dd22b7f3/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.agentstools.dev](https://www.zero.xyz/host/api.agentstools.dev/llms.txt)