With only one configuration of runs (e.g. only with_skill), aggregate_results() emitted a delta computed against an invented zero baseline, so the benchmark report claimed a pass-rate/time/token improvement that no comparison supported. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| aggregate_benchmark.py | ||
| generate_report.py | ||
| improve_description.py | ||
| package_skill.py | ||
| quick_validate.py | ||
| run_eval.py | ||
| run_loop.py | ||
| utils.py | ||