Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Jan 8, 2026

• docs/styles: Minor updates to some docs and some formatting (#12320)

  mamoodi

  authored
  adfabe7

  Copy full SHA for adfabe7

Commits on Dec 31, 2025

• feat: Support Tau-Bench and BFCL evaluation benchmarks (#11953)

  Show description for 4c0f0a1
  

  aaron-seq

  and

  openhands-agent

  authored
  4c0f0a1

  Copy full SHA for 4c0f0a1

Commits on Dec 15, 2025

• Add deprecation warning to evaluation README (#11997)

  Show description for 089d9c1
  

  neubig

  and

  openhands-agent

  authored
  089d9c1

  Copy full SHA for 089d9c1

Commits on Nov 27, 2025

• SWE-fficiency benchmark implementation (#11716)

  Show description for 974bcdf
  

  3 peopleauthored
  974bcdf

  Copy full SHA for 974bcdf

Commits on Nov 11, 2025

• Propose fix some typos and ignore emacs backup files (#11701)

  Show description for 967e9e1
  jeis4wpi

  authored
  967e9e1

  Copy full SHA for 967e9e1

Commits on Nov 10, 2025

• ci: remove outdated integration runner (#11653)

  enyst

  authored
  14807ed

  Copy full SHA for 14807ed

Commits on Oct 30, 2025

• feat(evaluation): Filter task ids by difficulty for SWE Gym rollouts (#11490)

  Show description for 12d6da8
  

  3 peopleauthored
  12d6da8

  Copy full SHA for 12d6da8

Commits on Oct 27, 2025

• Bugfix: respect config.tom system_prompt_filename when running swe-bench (#11091)

  Show description for 818f743
  

  3 peopleauthored
  818f743

  Copy full SHA for 818f743

Commits on Oct 25, 2025

• Replace All-Hands-AI references with OpenHands (#11287)

  Show description for b5e00f5
  

  3 peopleauthored
  b5e00f5

  Copy full SHA for b5e00f5

Commits on Oct 23, 2025

• Fixes to unblock frontend (#11488)

  Show description for 4b303ec
  

  tofarr

  and

  raymyers

  authored
  4b303ec

  Copy full SHA for 4b303ec

Commits on Oct 16, 2025

• feat(evaluation): Add multi-swe-bench dependency and fix rollout script (#11326)

  Show description for a237b57
  

  KevinMusgrave

  and

  neubig

  authored
  a237b57

  Copy full SHA for a237b57

• fix(integration-tests): accept --eval-num-workers and --eval-note in integration test runner (#11387)

  enyst

  authored
  3e645f8

  Copy full SHA for 3e645f8

• Mint security eval fix (#11273)

  Show description for 471d272
  

  juanmichelini

  and

  xingyaoww

  authored
  471d272

  Copy full SHA for 471d272

Commits on Oct 13, 2025

• feat(evaluation): Add placeholders to `swe_gpt4.j2` (#11228)

  Show description for 19bae5a
  

  KevinMusgrave

  and

  neubig

  authored
  19bae5a

  Copy full SHA for 19bae5a

Commits on Sep 22, 2025

• Add inference generation of SWE-Perf Benchmark (#10246)

  Show description for 7906eab
  

  4 peopleauthored
  7906eab

  Copy full SHA for 7906eab

• Multi swe gym (#10605)

  Show description for 547e104
  

  juanmichelini

  and

  openhands-agent

  authored
  547e104

  Copy full SHA for 547e104

Commits on Sep 8, 2025

• Implement model routing support (#9738)

  Show description for df9320f
  

  ryanhoangt

  and

  openhands-agent

  authored
  df9320f

  Copy full SHA for df9320f

Commits on Sep 4, 2025

• Add a new benchmark: AlgoTune (#10724)

  Show description for bd8b1bf
  

  3 peopleauthored
  bd8b1bf

  Copy full SHA for bd8b1bf

• Fix swe-bench `run_infer.py` config parsing from config.toml (#10792)

  Zacharias030

  authored
  20e5c40

  Copy full SHA for 20e5c40

Commits on Aug 27, 2025

• feat(llm): add support for deepseek and gpt-5-mini, util for token count (#10626)

  Show description for b082ccc
  

  xingyaoww

  and

  openhands-agent

  authored
  b082ccc

  Copy full SHA for b082ccc

Commits on Aug 22, 2025

• Evaluation: redirect sessions to repo-local .eval_sessions via helper; apply across entrypoints; add tests (#10540)

  Show description for 4507a25
  

  xingyaoww

  and

  openhands-agent

  authored
  4507a25

  Copy full SHA for 4507a25

Commits on Aug 21, 2025

• Fix: expose aggregated LLM metrics in State for evaluation scripts (#10537)

  Show description for 91d3d1d
  

  enyst

  and

  openhands-agent

  authored
  91d3d1d

  Copy full SHA for 91d3d1d

Commits on Aug 18, 2025

• feat(evaluation): Added INSTRUCTION_TEMPLATE_NAME to run_infer.py in swe_bench (#10270)

  Show description for 74ba21b
  

  3 peopleauthored
  74ba21b

  Copy full SHA for 74ba21b

Commits on Aug 16, 2025

• feat(evaluation): Add NoCode-bench evaluation script (#10229)

  ZhonghaoJiang

  authored
  7229a16

  Copy full SHA for 7229a16

Commits on Aug 15, 2025

• chore(eval): remove old, unused regression test framework under evaluation/regression (#10419)

  enyst

  authored
  f7f4fcf

  Copy full SHA for f7f4fcf

Commits on Aug 13, 2025

• chore(lint): Apply comprehensive linting and formatting fixes (#10287)

  Show description for c2f4620
  

  xingyaoww

  and

  openhands-agent

  authored
  c2f4620

  Copy full SHA for c2f4620

Commits on Aug 12, 2025

• feat(eval): Support evaluation on SWE-rebench (#10251)

  ibragim-bad

  authored
  19a6b6b

  Copy full SHA for 19a6b6b

• Readability improvement & remove duplicated and unused prompts (#10241)

  insop

  authored
  1d0d88d

  Copy full SHA for 1d0d88d

Commits on Aug 11, 2025

• Remove SecretStr conversion in GAIA eval (#10204)

  ryanhoangt

  authored
  758e30c

  Copy full SHA for 758e30c

Commits on Aug 8, 2025

• feat(cli): Use CLI to launch OpenHands UI server via Docker (#9783)

  Show description for 04ff4a0
  

  xingyaoww

  and

  openhands-agent

  authored
  04ff4a0

  Copy full SHA for 04ff4a0

Commits on Aug 7, 2025

• chore(eval): Remove eval_infer_remote.sh script and related references (#10157)

  Show description for c4f303a
  

  xingyaoww

  and

  openhands-agent

  authored
  c4f303a

  Copy full SHA for c4f303a

Commits on Jul 22, 2025

• Evaluation: disable browser when NOT run_with_browsing (#9837)

  li-boxuan

  authored
  7af35ab

  Copy full SHA for 7af35ab

Commits on Jul 16, 2025

• Fix: Continue evaluation when an instance fails after max retries (#8868)

  Show description for ea50fe4
  

  3 peopleauthored
  ea50fe4

  Copy full SHA for ea50fe4

• Fix integration tests (#9746)

  enyst

  authored
  fba2218

  Copy full SHA for fba2218

Commits on Jul 15, 2025

• Add README for terminal_bench evaluation harness (#9700)

  li-boxuan

  authored
  5c3619b

  Copy full SHA for 5c3619b