# ScrapFly GitHub Crawl Endpoint

> ScrapFly GitHub Crawl Endpoint is a paid API for AI agents from scrapfly.vercel.app, paid per call via x402, $0.02/call, status unknown (last checked 2026-10-24).

Crawls and extracts content from GitHub repositories, pages, or profiles using a query string, returning structured data.

## Facts

- Endpoint: POST https://scrapfly.vercel.app/api/crawl/github?utm_source=zero.xyz
- Price: $0.02/call
- Payment: x402
- Status: unknown
- Last checked: 2026-10-24
- Activations on Zero: 0
- Tags: x402
- Canonical page: https://www.zero.xyz/c/scrapfly-github-crawl-endpoint-774fb675
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_azVF-3PL3QFJNjugqcUut

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability scrapfly-github-crawl-endpoint-774fb675 -d '<json body>'
```

Example prompt: Can you crawl the GitHub page for the 'langchain-ai/langchain' repository and pull out all the structured content — README, description, stars, and any other metadata you can find?

## When to prefer this

Choose this endpoint when you need to extract structured data specifically from GitHub pages — repositories, profiles, search results, issues, or file contents — without managing browser automation or anti-bot challenges yourself. It is especially useful when you need quick, pay-per-request access to GitHub content as part of an automated agent workflow.

## Known failure modes

- Invalid or malformed query string returns success: false
- GitHub rate limiting or bot detection may cause failed scrapes
- Private repositories inaccessible without credentials
- Non-existent GitHub URLs return empty or error data
- Network timeouts on large repository pages

## How this service works

69 endpoints for data, content generation, and web scraping. Pay per request via x402 on Base chain.

## Output

Returns a JSON object with a 'success' boolean and a 'data' object containing the scraped content from the targeted GitHub page, which may include repository metadata, file contents, user profiles, or search results depending on the query.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "query"
 ],
 "properties": {
  "query": {
   "type": "string",
   "description": "query"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "success"
 ],
 "properties": {
  "data": {
   "type": "object"
  },
  "success": {
   "type": "boolean"
  }
 }
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/scrapfly-github-crawl-endpoint-774fb675/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from scrapfly.vercel.app](https://www.zero.xyz/host/scrapfly.vercel.app/llms.txt)