# ScrapFly GitHub Crawl Endpoint

> ScrapFly GitHub Crawl Endpoint is a paid API for AI agents from scravfly.vercel.app, paid per call via x402, $0.06/call, status unknown (last checked 2026-09-15).

Crawls and scrapes GitHub repositories, profiles, or pages and returns structured data in response to a query.

## Facts

- Endpoint: POST https://scravfly.vercel.app/api/crawl/github
- Price: $0.06/call
- Payment: x402
- Status: unknown
- Last checked: 2026-09-15
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapfly-github-crawl-endpoint-d9a82827
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_CkGZxLeLgNfTeFjqNlS41

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapfly-github-crawl-endpoint-d9a82827 -d '<json body>'
```

Example prompt: Can you scrape the GitHub repository at github.com/openai/openai-python and pull out the README, star count, and list of contributors?

## When to prefer this

Use this endpoint when you need to programmatically extract publicly available data from GitHub pages, repositories, or profiles without setting up GitHub API credentials. Ideal for agents that need to gather repo metadata, README content, or contributor info on demand. Prefer over the GitHub REST API when you need scraped page content rather than structured API responses, or when avoiding OAuth setup.

## Known failure modes

- GitHub rate limiting or bot detection causing scrape failure
- Invalid or non-existent GitHub URL in query returns empty or error data
- Private repository access denied results in no content returned
- Malformed query string yields a generic or empty response
- Network timeout on large repositories

## How this service works

69 endpoints for data, content generation, and web scraping. Pay per request via x402 on Base chain.

## Output

Returns a JSON object with a success boolean and a data object containing the scraped GitHub page content — which may include repository metadata, README text, file listings, contributor info, stars, forks, issues, or other publicly visible page elements depending on the query.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "query"
 ],
 "properties": {
  "query": {
   "type": "string",
   "description": "query"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "success"
 ],
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapfly-github-crawl-endpoint-d9a82827/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from scravfly.vercel.app](https://www.zero.xyz/host/scravfly.vercel.app/llms.txt)