honcho/tests/unified/test_cases
Eugene Eisenstein d655ace97c fix(tests): repair unsatisfiable unified-test assertions and surface traces
Five of the eight persistent `unified-tests` failures assert things the code
cannot produce. None are regressions.

Raise the queue-drain timeout to 600s on the three large longmem fixtures.
They ingest 484-550 messages across ~50 sessions, then wait on the 60s
`WaitAction` default; the deriver is still working normally when the timer
fires. Matches the sibling 550-message case that already passes.

Raise `max_tokens` to 2500 in the two config-summary fixtures. Context
allocates 40% of the limit to the summary, so the previous 400 gave a
160-token budget while `SUMMARY.MAX_TOKENS_SHORT` is 1000 — no conforming
summary could ever fit, and the query returned `summary=None` even though the
summary was created.

Drop `session_id` from the dream test's `get_representation` step. A bare
session id becomes a one-element allowlist, and an allowlist narrows levels to
`ALLOWLIST_SAFE_LEVELS` (`explicit`), so the deductive and inductive
observations the step asserts on are excluded by design. The unscoped
representation is where the dreamer's conclusions are actually served.

Delete `WaitAction.flush`. Flush is process-wide — the harness starts the
deriver with `DERIVER_FLUSH_ENABLED=true` — and there is no per-request flush,
so the field never had an effect despite being set in 47 places. `TestStep`
now forbids extra fields so a dead knob cannot silently accumulate again.

Presign the reasoning traces alongside `results.json` and report both to the
Discord webhook and a GitHub job summary. The traces hold the full prompts and
model outputs and were already uploaded, but only `results.json` was surfaced.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-02 18:26:44 -04:00
..
config_deriver_hierarchy.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
config_message_positive_override.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
config_peercard_control.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
config_summary_control.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
config_summary_control_deriver_off.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
dialectic_reasoning_levels.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
dialectic_structured_output.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
dialectic_tool_calls.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
dream_knowledge_updates_and_patterns.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_ancash.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_ancash_directional.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_ancash_no_session.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_giftcard.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_plank.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_triple_7161e7e2_single-session-assistant.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_triple_e47becba_single-session-user.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
longmem_triple_gpt4_59149c77_temporal-reasoning.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
message_deriver_disabled.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_2peer_bidirectional.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_2peer_both_observe_me_false.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_2peer_default.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_2peer_observe_me_false_blocks_observation.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_2peer_observe_me_false_but_can_still_observe_others.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_2peer_unidirectional_alice_observes_bob.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_2peer_unidirectional_bob_observes_alice.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_3peer_all_observe_each_other.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_3peer_circular.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_3peer_multiple_observers_one_observed.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_3peer_one_observer_multiple_observed.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_3peer_selective_observation.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_4peer_complex_matrix.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_asymmetric_visibility.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
observation_isolation_between_sessions.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
peer_isolation_test.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
scope_confines_recall.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
session_deriver_disabled.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
workspace_chat_cross_peer.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
workspace_chat_from_messages.json feat: Add workspace-level chat (#931) 2026-08-24 15:54:23 -04:00
workspace_chat_from_observations.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00
workspace_chat_scope.json feat: Add workspace-level chat (#931) 2026-08-24 15:54:23 -04:00
workspace_deriver_disabled.json fix(tests): repair unsatisfiable unified-test assertions and surface traces 2026-09-02 18:26:44 -04:00