RomanNum3ral
/
soup
mirror of https://github.com/razor-ai/soup.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
399 Commits 1 Branch 0 Tags 10 MiB
Commit Graph

3 Commits

Author SHA1 Message Date
Chinmaya Sahu 0e69b210e3
feat(examples): add DPO example config, sample data, and tests (#48) 
Add a working DPO (Direct Preference Optimization) example using the
current Pydantic config schema with Llama 3.1 8B Instruct and QLoRA.

- examples/configs/dpo_example.yaml: DPO config with all core training
  and LoRA parameters, plus commented-out advanced options
- examples/data/dpo_sample.jsonl: 8 preference pairs in DPO format
  with ShareGPT-style message lists for chosen/rejected
- tests/test_dpo_example.py: 7 tests validating config loading, field
  values, data format detection, and data validation
- examples/README.md: document the new DPO with QLoRA example
 2026-04-23 12:20:06 +05:00
Alpamys d2ef452bac Fix Phase 6.1 community files: real emails, DPO data format, correct file names 
- Replace fake @soup-cli.dev emails with real contact (vpn.alpamys@gmail.com)
- Add GitHub Security Advisories link in SECURITY.md
- Fix FUNDING.yml: ko_fi → buy_me_a_coffee
- Rewrite chat_preferences.jsonl with proper DPO chosen/rejected pairs
- Fix examples/README.md: correct file names, remove nonexistent files

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-24 11:19:56 +05:00
Alpamys e0f8e921bd Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING) 2026-03-23 23:10:45 +05:00