2 Commits

Author	SHA1	Message	Date
Salil Mhatre	d134abb008	Introduce 'soup runs clean' for smart checkpoint space management (#9) ... * feat(cli): add 'soup runs clean' intelligent checkpoint cleanup to reclaim disk space * update README * feat(cli): add 'soup runs clean' intelligent checkpoint cleanup to reclaim disk space * fixed whitespace trails * style(cli): fix lints (line length and spacing) in runs.py * style: fix all E501 line length lint errors * fix test mismatch, improve deletion warnings, add path validation, and enforce argument exclusivity * fix: break long message into multiple lines for Ruff compliance * test: update runs clean test to use CWD-based output directory for security compliance	2026-04-06 22:35:16 +05:00
Alpamys	2aaa87fb4e	Phase 2: experiment tracking, data tools, model evaluation ... - Add SQLite experiment tracker (~/.soup/experiments.db) with auto-logging of config, per-step metrics, hardware info, and eval results - Add soup runs commands: list, show (with plotext loss curves), compare, delete - Integrate tracker into soup train (auto start_run/finish_run/fail_run) - Add soup data convert (alpaca/sharegpt/chatml bidirectional conversion) - Add soup data merge (concatenate datasets with optional shuffle) - Add soup data dedup (MinHash near-duplicate removal via datasketch) - Add soup data stats (length percentiles, token counts, language detection) - Add soup eval (lm-evaluation-harness wrapper with tracker integration) - Add reverse format conversion: messages_to_format() in data/formats.py - Add extended_stats() to data/validator.py - Update monitoring callback to log metrics to tracker - Add plotext to deps, datasketch as optional [data] dep - Update README and CLAUDE.md with Phase 2 docs - 70 tests passing, ruff clean Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-23 23:34:28 +05:00