# payai.agentstools.dev Web Extractor

> payai.agentstools.dev Web Extractor is a paid API for AI agents from payai.agentstools.dev, paid per call via x402, $0.002/call, status unknown (last checked 2026-09-15).

Fetches a public URL and returns its main content as clean markdown or plain text, plus page metadata, using trafilatura.

## Facts

- Endpoint: GET https://payai.agentstools.dev/extract
- Price: $0.002/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/payai-agentstools-dev-web-extractor-a2bc39f2
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_re1_pQfq2DuUoLq3OK1De

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability payai-agentstools-dev-web-extractor-a2bc39f2
```

Example prompt: Can you fetch this article for me and give me the full readable content as clean markdown? The URL is https://example.com/some-article — use JavaScript rendering since it's a dynamic page.

## When to prefer this

Use this endpoint when you need to read the main textual content of a public webpage and want it returned as clean, LLM-ready markdown or plain text without boilerplate. Ideal for article extraction, research, and content summarization tasks. Prefer this over raw HTTP fetches when you want noise removed and structured text returned. For JS-rendered pages (SPAs), enable the render flag. For structured data extraction or academic PDFs, consider sibling endpoints on this service.

## Known failure modes

- URL is not publicly accessible or requires authentication — extraction fails or returns empty
- URL points to a non-HTML resource (PDF, image, binary) — content may be unextractable
- JavaScript-heavy SPA content missing if render flag not set
- Rate limiting or timeout on the target server — request fails
- Invalid or malformed URL in query parameter — bad request error
- Page has no extractable main content — returns empty body

## How this service works

Fetch any public web page and return its main readable content as clean Markdown or plain text plus metadata (title), stripping nav/ads/boilerplate (trafilatura). Optional JS rendering via headless browser for SPAs; markdown or text output. Robots-respecting, public content only — the reader/scraper building block for RAG and agent pipelines.

## Output

Returns the main readable content of the target webpage as clean markdown or plain text (boilerplate, ads, and navigation stripped out), plus metadata about the page such as title and author extracted by trafilatura.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "$schema": "https://json-schema.org/draft/2020-12/schema",
 "required": [
  "input"
 ],
 "properties": {
  "input": {
   "type": "object",
   "required": [
    "type",
    "method"
   ],
   "properties": {
    "type": {
     "type": "string",
     "const": "http"
    },
    "method": {
     "enum": [
      "GET",
      "HEAD",
      "DELETE"
     ],
     "type": "string"
    },
    "queryParams": {
     "type": "object",
     "required": [
      "url"
     ],
     "properties": {
      "url": {
       "type": "string",
       "description": "Public http(s) URL to extract"
      },
      "format": {
       "enum": [
        "markdown",
        "text"
       ],
       "type": "string"
      },
      "render": {
       "type": "boolean",
       "description": "Render JS via headless browser"
      }
     }
    }
   },
   "additionalProperties": false
  },
  "output": {
   "type": "object",
   "required": [
    "type"
   ],
   "properties": {
    "type": {
     "type": "string"
    },
    "example": {
     "type": "object"
    }
   }
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/payai-agentstools-dev-web-extractor-a2bc39f2/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from payai.agentstools.dev](https://www.zero.xyz/host/payai.agentstools.dev/llms.txt)