MicroFish/backend/scripts
renancloudwalk 95b4acabf2
docs(acceptance): live GLM-5.2 verdict = NO SHIP (gate 13 impossible, gate 21 fails)
Live 5-variant parallel run (1,747s, ~24k real LLM calls) on the clean 5,143
universe. Honest gate-19 winner = NONE.

- Gate 13 (bias symmetry) FAILS for both B and C, confirmed 3 ways
  (original prompt 76% bearish; bias-fixed 73% on committed; anonymized 98%).
  Model-level bias, not prompt-fixable -> rubric stop & report, not rewritten.
- Gate 16 PASS: deep-dive debate produced 1,427 real flips (14.3%) vs A's 1
  (0.47%), z=5.68 significant -- the debate is not theater.
- Gate 18 PASS: B beats A on all three (reinf 0<1, gap 3.17<18.11, flip sig).
- Gate 21 FAIL: r_B=0.6404 < r_A=0.786 -- B does not sharpen calls on GLM-5.2.
- Gate 20 FAIL: calibration off across A/B/C.

Recommendation: swap to a less-pessimistic model and re-run; machinery is
proven end-to-end on real calls (64 tests pass).

Adds: exp_anon_bias.py (confound check), ACCEPTANCE_V15_LIVE.md (real captured
terminal output, gate-by-gate), CEO_BRIEF_V15_LIVE.md.
2026-07-16 08:14:04 -03:00
..
action_logger.py Enhance simulation management and logging features 2025-12-02 17:11:47 +08:00
adversarial_router.py feat(swarm): tiered A/B/C stock-opinions tier + gate-19 winner (rubric v15) 2026-07-16 06:53:02 -03:00
bias_control.py feat(swarm): real bias-fix prompt (gate 13) on GLM-5.2 2026-07-16 07:43:37 -03:00
exp_anon_bias.py docs(acceptance): live GLM-5.2 verdict = NO SHIP (gate 13 impossible, gate 21 fails) 2026-07-16 08:14:04 -03:00
extract_examples.py feat(swarm): v15 parallel run + gate-25 deepdive SQL + gate-23 token count + gate-8 examples 2026-07-16 07:18:52 -03:00
run_parallel_simulation.py Add UTF-8 encoding support for Windows in simulation_runner.py and run_parallel_simulation.py to resolve character encoding issues with third-party libraries. 2025-12-26 18:14:57 +08:00
run_reddit_simulation.py Enhance signal handling and suppress warnings in simulation scripts 2025-12-09 00:37:12 +08:00
run_stock_swarm.py feat: add stock swarm throughput benchmark 2026-07-15 12:02:57 -03:00
run_tiered_swarm.py feat(swarm): real bias-fix prompt (gate 13) on GLM-5.2 2026-07-16 07:43:37 -03:00
run_twitter_simulation.py Enhance signal handling and suppress warnings in simulation scripts 2025-12-09 00:37:12 +08:00
test_profile_format.py Enhance backend functionality with OASIS simulation features 2025-12-01 15:03:44 +08:00
winner.py feat(swarm): tiered A/B/C stock-opinions tier + gate-19 winner (rubric v15) 2026-07-16 06:53:02 -03:00