Skip to content

Pull requests: OpenHands/benchmarks

New pull request New
20 Open 218 Closed
20 Open 218 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

build(deps): bump the version-all group across 1 directory with 17 updates dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code
#404 opened Feb 9, 2026 by dependabot bot Loading…
fix(swtbench): prevent build workflow from hanging indefinitely
#403 opened Feb 6, 2026 by juanmichelini Loading…
1
Fix: skip installing multi-swe-bench on macOS
#402 opened Feb 6, 2026 by cizezsy Loading…
1
Remove double setting of default values in function signatures
#399 opened Feb 5, 2026 by juanmichelini Loading…
1
Add eval_infer.py for OpenAgentSafety benchmark
#387 opened Jan 30, 2026 by juanmichelini Loading…
1
9
refactor(swtbench): regroup all hyperparameters in constants.py
#372 opened Jan 27, 2026 by simonrosenberg • Draft
1
4
refactor(gaia): regroup all hyperparameters in constants.py
#371 opened Jan 27, 2026 by simonrosenberg • Draft
1
6
refactor(commit0): consolidate hyperparameters in constants.py
#370 opened Jan 27, 2026 by simonrosenberg • Draft
1
7
Regroup all multiswebench hyperparameters in constants.py
#369 opened Jan 27, 2026 by simonrosenberg Loading…
1
Regroup all swebenchmultimodal hyperparameters in constants.py openhands
#368 opened Jan 27, 2026 by simonrosenberg Loading…
1
Add security benchmark with ASTRA
#361 opened Jan 26, 2026 by XZ-X • Draft
1
Add SDK commit hash to workflow run titles for index benchmarks
#351 opened Jan 21, 2026 by juanmichelini Loading…
1
fix(swebench-multimodal): create output.report.json for consistency
#331 opened Jan 16, 2026 by juanmichelini Loading…
4
BREAKING: Rename --max-attempts to --n-critic-runs
#325 opened Jan 16, 2026 by juanmichelini • Draft
1
Fix SDK submodule update to handle commit SHAs
#311 opened Jan 14, 2026 by juanmichelini Loading…
8
Fix dataset loading schema validation issue in CI
#304 opened Jan 13, 2026 by juanmichelini Loading…
2
build(deps): bump actions/github-script from 7 to 8 in the version-all group dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#292 opened Jan 12, 2026 by dependabot bot Loading…
Add add_resolve_rate_to_predictions function to output_utils
#199 opened Dec 23, 2025 by juanmichelini • Draft
1
2
Agentic code search
#141 opened Dec 8, 2025 by adityasoni9998 Loading…
5
API-based Critic implementation build-swebench-200 Build 200 SWE-Bench Verified Image based on SDK version on this PR.
#117 opened Nov 26, 2025 by xingyaoww • Draft
2
ProTip! Follow long discussions with comments:>50.