gstack/test/helpers
Garry Tan 02925cfc7a
feat: wire costs[] from modelUsage into eval results
Extract per-model token usage from resultLine.modelUsage (including
cache tokens and exact API cost), flow CostEntry[] through EvalCollector,
aggregate in finalize(). Extend CostEntry with cache_read_input_tokens,
cache_creation_input_tokens, cost_usd. computeCosts() prefers exact
cost_usd over MODEL_PRICING when available (~4x more accurate with
prompt caching).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-15 16:47:27 -05:00
..
eval-store.test.ts feat: wire costs[] from modelUsage into eval results 2026-03-15 16:47:27 -05:00
eval-store.ts feat: wire costs[] from modelUsage into eval results 2026-03-15 16:47:27 -05:00
llm-judge.ts feat: 3-tier eval suite with planted-bug outcome testing (EVALS=1) 2026-03-14 01:17:36 -05:00
observability.test.ts fix: never clean up observability artifacts — partial file persists after finalize 2026-03-14 12:37:38 -05:00
session-runner.test.ts feat: wire costs[] from modelUsage into eval results 2026-03-15 16:47:27 -05:00
session-runner.ts feat: wire costs[] from modelUsage into eval results 2026-03-15 16:47:27 -05:00
skill-parser.ts feat: 3-tier eval suite with planted-bug outcome testing (EVALS=1) 2026-03-14 01:17:36 -05:00