3 Commits

Author	SHA1	Message	Date
Alpamys	1b6b428aaa	feat: v0.24.0 — Dataset Hub, Freeze Training, Loss Watchdog, Dataset Registry ... Part A: HuggingFace Dataset browser - soup data search: search HF Hub for datasets (sort by downloads/likes) - soup data preview: preview remote dataset metadata, splits, features - soup data download: stream HF dataset to local JSONL (with format conversion) - Security: trust_remote_code=False, path traversal protection, samples cap at 1M Part B: Freeze training (like LLaMA-Factory finetuning_type: freeze) - freeze_layers / freeze_ratio config fields - soup_cli/utils/freeze.py: detect layers, freeze bottom N - Wired into SFT trainer before LoRA application - Supports LLaMA (layers.N) and GPT-2 (h.N) naming Part C: Loss watchdog (like Axolotl loss_watchdog_threshold) - loss_watchdog, loss_watchdog_threshold, loss_watchdog_patience config - Implemented in SoupTrainerCallback with patience counter - Rich warning panel (stops Live display first), fires only once - Wired into all 11 trainers via callback kwargs Part D: Dataset info registry - soup data register/unregister/registry commands - ~/.soup/datasets.json local name→path+format mapping - Name validation, path traversal protection, Rich markup escaping 82 new tests (2061 total), 74 test files.	2026-04-03 16:35:23 +05:00
Alpamys	1b1d679141	feat: v0.21.0 — migrate, recipes, NEFTune, rsLoRA ... - `soup migrate` — import configs from LLaMA-Factory, Axolotl, Unsloth notebooks (AST-only .ipynb parsing, path traversal protection) - `soup recipes` — 30 ready-made configs for popular models (list/show/use/search with path traversal protection) - NEFTune (`neftune_alpha`) — noisy embeddings for SFT/DPO/KTO/ORPO/SimPO/IPO - rsLoRA (`use_rslora`) — rank-stabilized LoRA scaling in all 11 trainers - Fix: `soup doctor` torchvision circular import crash - Fix: `load_eval_tasks()` now accepts str in addition to Path - Security: Rich markup injection prevention in migration warnings - Security: 10 MB file size limit on migration input files - 1789 tests, 62 test files, 64% coverage	2026-04-02 14:08:36 +05:00
Alpamys	cbc0a0e558	v0.16.0: embedding models, ONNX/TensorRT export, speculative decoding ... New features: - task: embedding — fine-tune sentence embedding models (BGE, E5, GTE) with contrastive, triplet, or cosine loss and configurable pooling - soup export --format onnx — ONNX export via optimum - soup export --format tensorrt — TensorRT-LLM export for GPU inference - soup serve --speculative-decoding — draft model for 2-3x faster generation (transformers assisted generation + vLLM native speculative decoding) - soup init --template embedding — new template for embedding fine-tuning Security: - ONNX export: removed unconditional trust_remote_code, added warning - Speculative decoding: SSRF protection (URL blocked), warning panel - vLLM speculative: URL validation rejects http:// schemes - TensorRT export: separated try/except per subprocess call - Embedding config: Literal constraints, margin gt=0 validation 1270 tests, 52 test files, 58% coverage	2026-03-26 12:41:39 +05:00