Commit Graph

5 Commits

Author SHA1 Message Date
Jaret Burkett (Ostris) fc4d6ebf39
Add support for fine-tuning Hidream O1 (#831)
* Initial support for hidream. Lora keys likely need work

* Fix saving for hidream-o1

* Remove dependence on flash attention for hidream o1

* Fix gradient checkpointing for hidream o1

* A lot of fixes for hidream. Handle loading and saving as comfy model.

* Omit layers not used in comfy. Fix issue with lora loading keys in comfy

* Version bumpo
2026-05-12 11:15:16 -06:00
Jaret Burkett 2faba22b46 Fix issue when saving advanced prompt embeds. No such file or directory error 2026-04-16 12:22:56 -06:00
Jaret Burkett e74bc9ac7b Fix issue with concatinating advanced prompt embeds. 2026-04-14 16:04:34 -06:00
Jaret Burkett 7eb1226a6d Fix issue with loading advanced prompt configs metadata 2026-04-14 15:42:09 -06:00
Jaret Burkett 1058ef3513 Made AdvancedPromptEmbeds that is compatable with previous PromptEmbeds functionality, but is more streamlined and can accomidate more model embedding paradigms. 2026-04-11 10:45:47 -06:00