feat(bench): add CLI comparison harness

Browse Source

Harvest #3009 for the v0.8.59 release lane. Adds a paired Terminal-Bench harness for CodeWhale and Codex, a Codex Harbor adapter, generated-result ignore protection, and benchmark docs.

Maintainer amendments keep explicit zero-valued metrics, regenerate parent task names, write refreshed summaries in regenerate mode, and allow transcript paths outside the repo.

Fixes #2952.

...

This commit is contained in:

idling11

2026-06-12 01:15:00 -07:00

committed by Hunter B

parent f99fff969a

commit 0cd8bcde1b

6 changed files with 754 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

benchmark_results/.gitkeep