# List Benchmark Tasks

> List Benchmark Tasks is a paid API for AI agents from agents.forwardlane.com, paid per call via MPP, ~$0.02/call (observed), status healthy (last checked 2026-10-23, last successful call 2026-10-23).

Lists SWE-bench style benchmark task instances from ForwardLane's financial-services code repositories, with optional filtering by repo, domain, and difficulty.

## Facts

- Endpoint: GET https://agents.forwardlane.com/api/benchmark/tasks?utm_source=zero.xyz
- Price: ~$0.02/call (observed)
- Payment: MPP
- Status: healthy
- Last checked: 2026-10-23
- Last successful call: 2026-10-23
- Success rate: 100% of calls made through Zero
- Activations on Zero: 2
- Provider: agents.forwardlane.com
- Website: https://agents.forwardlane.com
- Canonical page: https://www.zero.xyz/c/agents-forwardlane-com-list-benchmark-tasks-0bb18889
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_lJ_nAEsnlN4Bkfn1LyjMV

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agents-forwardlane-com-list-benchmark-tasks-0bb18889
```

Example prompt: Show me up to 50 hard SWE-bench benchmark tasks from ForwardLane's financial-services repos, filtered to the risk-management domain.

## When to prefer this

Use this endpoint when you need to discover or browse the available SWE-bench benchmark tasks across ForwardLane's 151 private financial-services repositories — especially when you want to filter by repo name, domain, or difficulty before retrieving a specific task with Get Benchmark Task. Prefer this over Get Benchmark Task when you don't yet know the instance_id and need to explore what tasks exist.

## Known failure modes

- Invalid difficulty value (not easy/medium/hard) returns an error or empty results
- Specifying a non-existent repo name returns empty task list
- Limit below 1 or above 500 triggers a validation error
- Network or server error returns a 5xx response
- No tasks match the combined filters, resulting in an empty list

## How this service works

Catalog of SWE-bench-format benchmark tasks (metadata only).

Each item carries ``instance_id``, ``repo``, ``difficulty``, ``domain``,
``complexity`` (when scored), ``fail_to_pass_count``,
``pass_to_pass_count``, ``created_at``, ``version`` and ``solve_rate``.
The problem statement, gold patch and test lists are not included; fetch
one task by ``instance_id`` for the full record. ``total`` is the number
of tasks matching the filters before ``limit`` is applied; items are
newest first.

## Output

A JSON object containing a list of SWE-bench benchmark task instances matching the specified filters. Each task includes details such as instance ID, repository name, domain, and difficulty. Returns up to the specified limit (default 20, max 500).

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "properties": {
  "repo": {
   "type": "string",
   "anyOf": [
    {
     "type": "string"
    },
    {
     "type": "null"
    }
   ],
   "title": "Repo",
   "description": "Filter by repository name"
  },
  "limit": {
   "type": "integer",
   "title": "Limit",
   "default": 20,
   "maximum": 500,
   "minimum": 1,
   "description": "Maximum tasks to return"
  },
  "domain": {
   "type": "string",
   "anyOf": [
    {
     "type": "string"
    },
    {
     "type": "null"
    }
   ],
   "title": "Domain",
   "description": "Filter by domain"
  },
  "difficulty": {
   "type": "string",
   "anyOf": [
    {
     "type": "string"
    },
    {
     "type": "null"
    }
   ],
   "title": "Difficulty",
   "description": "Filter by difficulty (easy/medium/hard)"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "additionalProperties": true
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agents-forwardlane-com-list-benchmark-tasks-0bb18889/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agents.forwardlane.com](https://www.zero.xyz/host/agents.forwardlane.com/llms.txt)