# Get Benchmark Task

> Get Benchmark Task is a paid API for AI agents from agents.forwardlane.com, paid per call via MPP, $10/call, status unknown (last checked 2026-10-22).

Retrieves a single SWE-bench style benchmark task instance by its unique instance ID from ForwardLane's financial-services code evaluation dataset.

## Facts

- Endpoint: GET https://agents.forwardlane.com/api/benchmark/tasks/{instance_id}?utm_source=zero.xyz
- Price: $10/call
- Payment: MPP
- Status: unknown
- Last checked: 2026-10-22
- Activations on Zero: 0
- Provider: agents.forwardlane.com
- Website: https://agents.forwardlane.com
- Canonical page: https://www.zero.xyz/c/agents-forwardlane-com-get-benchmark-task-2407073b
- Structured record (JSON): https://api.zero.xyz/v1/capabilities/cap_-d3XCIXl5km5hkcJ_Bdej

Status and success rate cover calls made through Zero and Zero's own probes. Third-party monitors may report differently.

## How to call it through Zero

Zero handles the 402 payment challenge and records the run. With the Zero CLI installed (`npm i -g @zeroxyz/cli`):

```sh
zero fetch --capability agents-forwardlane-com-get-benchmark-task-2407073b
```

Example prompt: Pull up the ForwardLane benchmark task with instance ID 'django__django-11001' so I can see the full task specification and evaluation details.

## When to prefer this

Use this endpoint when you have a specific benchmark task instance_id and need the complete details of that single task. Prefer this over the List Benchmark Tasks endpoint when you already know the exact instance you want to inspect, need the full task payload rather than a summary list, or are comparing a model's solution against a specific evaluation challenge in ForwardLane's financial-services repository dataset.

## Known failure modes

- Invalid or non-existent instance_id returns a 404 or error response
- Missing required instance_id path parameter causes a 422 validation error
- Payment failure (402) if the $10 per-call fee cannot be processed
- Network timeout if the FL Repos Intelligence platform is temporarily unavailable
- Malformed instance_id format may result in an empty or null response

## How this service works

Full record of one benchmark task.

Returns the catalog metadata plus ``problem_statement``, ``base_commit``,
``environment_setup_commit``, the gold ``patch`` (unified diff) and the
``FAIL_TO_PASS`` / ``PASS_TO_PASS`` test lists in SWE-bench format.

## Output

Returns a JSON object representing a single SWE-bench style benchmark task instance, including task specification, instance metadata, expected code changes, repository context, and evaluation criteria relevant to financial-services codebases. The response schema allows additional properties, so the full payload may include rich contextual fields.

## Request schema (JSON Schema)

```json
{
 "type": "object",
 "required": [
  "instance_id"
 ],
 "properties": {
  "instance_id": {
   "type": "string",
   "title": "Instance Id",
   "description": "Task instance id"
  }
 }
}
```

## Response schema (JSON Schema)

```json
{
 "type": "object",
 "additionalProperties": true
}
```

## More

- Live health (JSON, refreshed every minute): https://www.zero.xyz/c/agents-forwardlane-com-get-benchmark-task-2407073b/health.json
- [Zero catalog index](https://www.zero.xyz/llms.txt)
- [Other services from agents.forwardlane.com](https://www.zero.xyz/host/agents.forwardlane.com/llms.txt)