Chinmaya Sahu 0e69b210e3 feat(examples): add DPO example config, sample data, and tests (#48) ... Add a working DPO (Direct Preference Optimization) example using the current Pydantic config schema with Llama 3.1 8B Instruct and QLoRA. - examples/configs/dpo_example.yaml: DPO config with all core training and LoRA parameters, plus commented-out advanced options - examples/data/dpo_sample.jsonl: 8 preference pairs in DPO format with ShareGPT-style message lists for chosen/rejected - tests/test_dpo_example.py: 7 tests validating config loading, field values, data format detection, and data validation - examples/README.md: document the new DPO with QLoRA example		2026-04-23 12:20:06 +05:00
..
alpaca_tiny.jsonl	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00
chat_preferences.jsonl	Fix Phase 6.1 community files: real emails, DPO data format, correct file names	2026-03-24 11:19:56 +05:00
dpo_sample.jsonl	feat(examples): add DPO example config, sample data, and tests (#48)	2026-04-23 12:20:06 +05:00
reasoning_math.jsonl	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00