Search results

Use Pydantic Model to define report made by swebench swtbench gaia commit0

Status: Open.

#212 In OpenHands/benchmarks;

· simonrosenberg opened on Dec 26, 2025

SWE-Bench 500-image run: empty patches from LLM budget cap + Modal sandbox errors

Status: Open.

#210 In OpenHands/benchmarks;

· simonrosenberg opened on Dec 26, 2025

SWT bench eval: Command '/bin/bash /eval.sh' timed out after 1800 seconds

Status: Open.

#202 In OpenHands/benchmarks;

· juanmichelini opened on Dec 23, 2025

Multimodal: add support test split

Status: Open.

#201 In OpenHands/benchmarks;

· juanmichelini opened on Dec 23, 2025

ALL: enrich output.jsonl from output.report.jsonl

Status: Open.

#195 In OpenHands/benchmarks;

· juanmichelini opened on Dec 22, 2025

Multimodal: create output.report.json

Status: Open.

#194 In OpenHands/benchmarks;

· juanmichelini opened on Dec 22, 2025

feat: Add SWE-bench Pro support

Status: Open.

#184 In OpenHands/benchmarks;

· tonylek opened on Dec 22, 2025

feat: respect registry rate limits

Status: Open.

#172 In OpenHands/benchmarks;

· juanmichelini opened on Dec 17, 2025

refactor: GAIA should use same retry and max attempts logic as swebench.

Status: Open.

#171 In OpenHands/benchmarks;

· juanmichelini opened on Dec 17, 2025

CONTRIBUTE.md

Status: Open.

#168 In OpenHands/benchmarks;

· juanmichelini opened on Dec 16, 2025

Port tau-bench to this repo

Status: Open.

#163 In OpenHands/benchmarks;

· neubig opened on Dec 15, 2025

Combine infer and eval in a single command

Status: Open.

#162 In OpenHands/benchmarks;

· simonrosenberg opened on Dec 15, 2025