Chinmaya Sahu 0e69b210e3 feat(examples): add DPO example config, sample data, and tests (#48) ... Add a working DPO (Direct Preference Optimization) example using the current Pydantic config schema with Llama 3.1 8B Instruct and QLoRA. - examples/configs/dpo_example.yaml: DPO config with all core training and LoRA parameters, plus commented-out advanced options - examples/data/dpo_sample.jsonl: 8 preference pairs in DPO format with ShareGPT-style message lists for chosen/rejected - tests/test_dpo_example.py: 7 tests validating config loading, field values, data format detection, and data validation - examples/README.md: document the new DPO with QLoRA example		2026-04-23 12:20:06 +05:00
..
dpo_chat.yaml	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00
dpo_example.yaml	feat(examples): add DPO example config, sample data, and tests (#48)	2026-04-23 12:20:06 +05:00
grpo_reasoning.yaml	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00
rlhf_step1_sft.yaml	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00
rlhf_step2_reward.yaml	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00
rlhf_step3_ppo.yaml	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00
sft_basic.yaml	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00
vision_llama.yaml	Release v0.10.0: Phase 6.1 - Community (CONTRIBUTING, CODE_OF_CONDUCT, SECURITY, examples, FUNDING)	2026-03-23 23:10:45 +05:00