RomanNum3ral/soup - soup - RomanNum3ral's Gitea

Author SHA1 Message Date

Author	SHA1	Message	Date
Alpamys	0ee5f78986	fix(ci): ANSI-robust serve help test + restore 77% coverage gate (v0.71.1) The v0.71.1 release commit (`514761c`) went red on CI for two reasons: - test_flag_in_help asserted a raw "--record-thumbs" substring, but Rich splits an option name's dashes with ANSI codes under CI's FORCE_COLOR (it passes locally without color). Strip ANSI before the substring check. - Coverage fell to 76.96% (< 77% gate): CI installs [dev], which has no FastAPI, so the new /v1/thumbs endpoint + record-thumbs startup block in serve.py are uncovered there. Restore the gate honestly (no lowering, no pragma) by adding 19 genuine no-FastAPI tests for previously-uncovered pure-CLI paths: lock show / lock check (no-drift / drift exit 3 / missing), env check (no-drift / missing / drift exit 3), env fix error branches, env lock null-byte output, and load_evidence_file (the `eval unlearning --evidence` loader). CI-equivalent (no-fastapi) coverage: 76.96% -> 77.24%. Tests: 12134 -> 12153.	2026-06-01 15:03:37 +05:00
Alpamys	514761c89a	feat(env,lock,serve,eval): v0.71.1 — quick wins + wiring (7 closures) Closes #195 #210 #214 #224 #230 #233 #209. - soup env fix: print-only install-plan renderer from soup-env.lock (uv-pip / requirements; non-pip entries surfaced as comments). (#209) - soup lock write --env-lock: auto-derive --env-hash from soup-env.lock via new compute_env_hash (excludes created_at). (#224) - soup serve --record-thumbs <db>: capture thumbs-up/down into the local-RL SQLite + POST /v1/thumbs (transformers backend). (#230) - Judge-calibration persistence: JudgeCalibrationReport.to_dict + write/load_judge_calibration + judge_calibration registry kind; load re-validates the frozen dataclass with cwd/symlink containment. (#214) - soup completions: introspect a base model's real LoRA target modules (config-only AutoConfig, local_files_only, never networks/raises). (#210) - Bundled MUSE + WMDP unlearning eval fixtures; WMDP forget rows ship REDACTED (Soup never bundles verbatim hazardous content). (#195) - build_dag.validate_build_source: cwd-containment + symlink rejection. (#233) Review-fix hardening (consolidated python+code+security+tdd, 0 CRIT/0 HIGH): load_judge_calibration containment + friendly missing-field ValueError; serve thumbs success-print escape; env_fix --output Optional[str]; empty --env-hash auto-derives; render_install_plan PEP 440 docstring note. Tests: 12071 -> 12134 (12044 passed, 90 skipped, 2 deselected).	2026-06-01 14:12:30 +05:00
Alpamys	87fd760847	Add Phase 3: serve, data generate, sweep, diff, DeepSpeed (v0.3.0) - soup serve: FastAPI inference server with OpenAI-compatible API, SSE streaming - soup data generate: synthetic data generation via OpenAI API or local models - soup sweep: grid/random hyperparameter search with experiment tracker integration - soup diff: side-by-side model comparison with metrics - Multi-GPU/DeepSpeed: ZeRO Stage 2/3 configs, --deepspeed flag in train command - 95 new tests (281 total), all passing - Removed TESTING_GUIDE.md Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-03-05 17:14:08 +05:00

Alpamys

0ee5f78986

fix(ci): ANSI-robust serve help test + restore 77% coverage gate (v0.71.1)

The v0.71.1 release commit (514761c) went red on CI for two reasons:

- test_flag_in_help asserted a raw "--record-thumbs" substring, but Rich
  splits an option name's dashes with ANSI codes under CI's FORCE_COLOR
  (it passes locally without color). Strip ANSI before the substring check.
- Coverage fell to 76.96% (< 77% gate): CI installs [dev], which has no
  FastAPI, so the new /v1/thumbs endpoint + record-thumbs startup block in
  serve.py are uncovered there. Restore the gate honestly (no lowering, no
  pragma) by adding 19 genuine no-FastAPI tests for previously-uncovered
  pure-CLI paths: lock show / lock check (no-drift / drift exit 3 / missing),
  env check (no-drift / missing / drift exit 3), env fix error branches,
  env lock null-byte output, and load_evidence_file (the
  `eval unlearning --evidence` loader).

CI-equivalent (no-fastapi) coverage: 76.96% -> 77.24%. Tests: 12134 -> 12153.

2026-06-01 15:03:37 +05:00

Alpamys

514761c89a

feat(env,lock,serve,eval): v0.71.1 — quick wins + wiring (7 closures)

Closes #195 #210 #214 #224 #230 #233 #209.

- soup env fix: print-only install-plan renderer from soup-env.lock
  (uv-pip / requirements; non-pip entries surfaced as comments). (#209)
- soup lock write --env-lock: auto-derive --env-hash from soup-env.lock
  via new compute_env_hash (excludes created_at). (#224)
- soup serve --record-thumbs <db>: capture thumbs-up/down into the
  local-RL SQLite + POST /v1/thumbs (transformers backend). (#230)
- Judge-calibration persistence: JudgeCalibrationReport.to_dict +
  write/load_judge_calibration + judge_calibration registry kind; load
  re-validates the frozen dataclass with cwd/symlink containment. (#214)
- soup completions: introspect a base model's real LoRA target modules
  (config-only AutoConfig, local_files_only, never networks/raises). (#210)
- Bundled MUSE + WMDP unlearning eval fixtures; WMDP forget rows ship
  REDACTED (Soup never bundles verbatim hazardous content). (#195)
- build_dag.validate_build_source: cwd-containment + symlink rejection. (#233)

Review-fix hardening (consolidated python+code+security+tdd, 0 CRIT/0 HIGH):
load_judge_calibration containment + friendly missing-field ValueError;
serve thumbs success-print escape; env_fix --output Optional[str];
empty --env-hash auto-derives; render_install_plan PEP 440 docstring note.

Tests: 12071 -> 12134 (12044 passed, 90 skipped, 2 deselected).

2026-06-01 14:12:30 +05:00

Alpamys

87fd760847

Add Phase 3: serve, data generate, sweep, diff, DeepSpeed (v0.3.0)

- soup serve: FastAPI inference server with OpenAI-compatible API, SSE streaming
- soup data generate: synthetic data generation via OpenAI API or local models
- soup sweep: grid/random hyperparameter search with experiment tracker integration
- soup diff: side-by-side model comparison with metrics
- Multi-GPU/DeepSpeed: ZeRO Stage 2/3 configs, --deepspeed flag in train command
- 95 new tests (281 total), all passing
- Removed TESTING_GUIDE.md

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-05 17:14:08 +05:00

3 Commits