6df553cb4e
test(ci): ANSI-strip --steer/--output/--top-k help asserts (FORCE_COLOR-robust)
...
CI renders Typer help with ANSI colour codes under FORCE_COLOR that split the
leading `--` from the flag name, so raw-substring assertions on `--steer`
(serve) and `--output`/`--top-k` (steer train) passed locally but failed in CI.
Strip ANSI before the membership check (same fix as the v0.71.1 --record-thumbs
help assert). Local + FORCE_COLOR=1: 142/142 pass. tests-only, no version bump.
2026-06-03 23:00:13 +05:00
a2287dd6a5
feat(rag): RAFT span-mask trainer + RA-DIT auto-link + live steering + eval citation (v0.71.10)
...
Lifts the v0.62.0 RAG-family schema-only stubs to live, validated on SmolLM2-135M:
- #199 RAFT: data.format=raft trains answer-only (prompt span masked to -100,
[doc-N] citation ids, deterministic doc shuffle by raft_shuffle_seed); rows
whose prompt fills max_length are dropped with a warning. New utils/raft.py +
trainer/raft.py (RaftDataCollator + weighted-CE _RaftTrainer).
- #200 soup ra-dit: one-shot two-stage orchestrator (train retriever -> record
it as the generator's paired retriever -> train generator); a generator-stage
`soup train` with no retriever set auto-links the latest RA-DIT retriever from
the Registry. New utils/ra_dit_run.py + commands/ra_dit.py.
- #201 soup steer train/apply + soup serve --steer: live CAA/ITI/RepE fit from
{positive, negative} pairs + decode-time forward hook (transformers backend).
Lifts the steering.py apply_steering/build_steering_vector stubs.
- #202 soup eval citation + citation-span per-token loss boost + 7th `citation`
failure mode in soup diagnose. New commands/_eval_v07110.py +
diagnose/citation.py.
Review fixes (3 agents, all CRITICAL->LOW): markup-escaped autolink advisory;
shared enforce_under_cwd_and_no_symlink + O_NOFOLLOW on every new file read;
steering-artifact containment; honest RA-DIT docs (records pairing, no weight
fusion); public validate_ra_dit_config_path + render_raft_prompt; repe/iti
require >=2 pairs; eval citation --shuffle-seed.
Full suite: 13034 passed, 106 skipped (13142 collected). ruff clean.
2026-06-03 19:28:45 +05:00
Alpamys