# agentstools.dev Web Page Extractor

> agentstools.dev Web Page Extractor is a paid API for AI agents from api.agentstools.dev, paid per call via x402, $0.002/call, status unknown (last checked 2026-09-15).

Fetches a public URL and returns the main content as clean markdown or plain text, plus page metadata, using trafilatura.

## Facts

- Endpoint: GET https://api.agentstools.dev/extract
- Price: $0.002/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/agentstools-dev-web-page-extractor-95147e02
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_uQxK6bqGQ1XrdoSwMyRIn

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agentstools-dev-web-page-extractor-95147e02
```

Example prompt: Fetch https://www.bbc.com/news/science-environment-68887560 and give me the main article text as clean markdown — also render the JavaScript so nothing is missed.

## When to prefer this

Use this endpoint when you need to extract the human-readable main content from a public webpage and want it returned as clean markdown or plain text with metadata, especially when you want JS rendering support. Prefer this over raw HTTP fetchers when you need boilerplate removed and content normalized for downstream LLM consumption.

## Known failure modes

- URL is not publicly accessible or requires authentication — extraction fails
- Page is heavily JavaScript-rendered and render flag not set — content may be incomplete or empty
- Invalid or malformed URL provided — returns error
- Paywalled content cannot be extracted beyond the preview
- trafilatura finds no main content block — returns empty or minimal result
- Network timeout if the target URL is slow to respond

## How this service works

Fetch any public web page and return its main readable content as clean Markdown or plain text plus metadata (title), stripping nav/ads/boilerplate (trafilatura). Optional JS rendering via headless browser for SPAs; markdown or text output. Robots-respecting, public content only — the reader/scraper building block for RAG and agent pipelines.

## Output

Returns the main readable content of the page as clean markdown or plain text (with boilerplate and navigation stripped), plus page metadata such as title and author, extracted using trafilatura.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD",
      "DELETE"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "Public http(s) URL to extract"
      },
      "format": {
       "enum": [
        "markdown",
        "text"
       ],
       "type": "string"
      },
      "render": {
       "type": "boolean",
       "description": "Render JS via headless browser"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agentstools-dev-web-page-extractor-95147e02/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from api.agentstools.dev](https://www.zero.xyz/host/api.agentstools.dev/llms.txt)