mirror of https://github.com/razor-ai/soup.git
0be8a03a8a
v0.11.0 — Alignment methods: - ORPO (task: orpo) — wraps trl.ORPOTrainer, no reference model needed - SimPO (task: simpo) — wraps trl.CPOTrainer with loss_type='simpo' - IPO (task: ipo) — wraps trl.DPOTrainer with loss_type='ipo' - Templates: soup init --template orpo/simpo/ipo - Init wizard, train routing, sweep shortcuts for all three v0.12.0 — Advanced PEFT: - DoRA (use_dora: true) — weight-decomposed LoRA in all 9 trainers - LoRA+ (loraplus_lr_ratio) — different lr for A and B matrices - GaLore (use_galore: true) — memory-efficient full-param training - GaLore validation: incompatible with quantization and unsloth Security: - experiment_name path traversal validation (no / \ : null bytes) - GaLore optim_args type enforcement before string interpolation Tests: 877 passed (was 746), 42 test files, 56.98% coverage |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| constants.py | ||
| deepspeed.py | ||
| errors.py | ||
| galore.py | ||
| gpu.py | ||
| qat.py | ||
| unsloth.py | ||
| vllm.py | ||