mirror of https://github.com/garrytan/gstack.git
af5f066186
The first re-run after wiring the LLM judge revealed that the model also
emits a third surface I hadn't anticipated: a properly-formatted question
with options ("Pick A, B, or C in your reply") rendered as prose AND
followed by ExitPlanMode (outcome=plan_ready). The migrated tests only
accepted (## Decisions section) OR (BLOCKED string) — neither matched
this case, so the test failed even though the user clearly saw the
question.
Three valid surfaces now:
1. `## Decisions to confirm` section in plan file (legacy fallback path,
still valid through migration window)
2. `BLOCKED — AskUserQuestion` string in TTY (post-v1.28 BLOCKED rule)
3. Numbered/lettered options visible in TTY as prose (post-v1.28 prose
rendering — uses the existing isProseAUQVisible detector)
Also fixes assertReportAtBottomIfPlanWritten to be tolerant of:
- Missing files (path detected from TTY but file not persisted) — was
throwing ENOENT on plan_design_plan_mode and plan_ceo_plan_mode test 1
- 'asked' outcome (smoke test exited at first AUQ before the model
reached the report-writing step) — was throwing on the 1 fail in the
plan-eng-plan-mode --disallowedTools test
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
||
|---|---|---|
| .. | ||
| providers | ||
| agent-sdk-runner.ts | ||
| benchmark-judge.ts | ||
| benchmark-runner.ts | ||
| claude-pty-runner.ts | ||
| claude-pty-runner.unit.test.ts | ||
| codex-session-runner.ts | ||
| e2e-helpers.ts | ||
| eval-store.test.ts | ||
| eval-store.ts | ||
| gemini-session-runner.test.ts | ||
| gemini-session-runner.ts | ||
| llm-judge.ts | ||
| observability.test.ts | ||
| pricing.ts | ||
| secret-sink-harness.ts | ||
| session-runner.test.ts | ||
| session-runner.ts | ||
| skill-parser.ts | ||
| tool-map.ts | ||
| touchfiles.ts | ||