Commit Graph

1138 Commits

Author SHA1 Message Date
Jaret Burkett b5f21ae695 Fixed issue where the training type dropdown in the ui was not showing fully 2026-06-03 10:14:15 -06:00
Jaret Burkett d9f26c2f87 Add gradient checkpointing to tipsv2 heads 2026-06-01 05:00:15 -06:00
Jaret Burkett bd468727a6 Fixed issue where some image cards in samples and datasets would show gray instead of the image until you scroll. 2026-06-01 03:36:32 -06:00
Jaret Burkett f5446c0d5f Version bump 2026-06-01 02:16:47 -06:00
Jaret Burkett e5439509b5 Added pure lpips dfe 2026-05-31 11:52:03 -06:00
Jaret Burkett 212cfe998a Add ability to download or delete the optimizer state from the ui 2026-05-29 08:56:22 -06:00
Jaret Burkett 5e84bf0d0b Fixed issue with hidream-01 that could cause a weird nan state. Took forever to track down as it was 1 in 10 starts. 2026-05-28 12:48:24 -06:00
Jaret Burkett 87bac27513 Fixed issue with new bucket scaler 2026-05-28 11:34:16 -06:00
Jaret Burkett 30886b8f92 Added a wallet indicator for Ostris Cloud 2026-05-28 11:09:51 -06:00
Jaret Burkett 3e86d81fc6 Adjust bucket sizes to achieve maximum pixels without going over. 2026-05-28 09:36:17 -06:00
Jaret Burkett ef57c1077c Change z image divisibility 2026-05-28 09:09:36 -06:00
Jaret Burkett 15082cfb8a Round buckets for divisibility instead of always rounding down. 2026-05-28 09:08:21 -06:00
Jaret Burkett c9264bdd0b Reworked the bucketing system to precisly match model specific divisibility. The old SDXL bucket sizes needed to go. 2026-05-28 08:35:58 -06:00
Jaret Burkett 68e9b38220 Add ability to trigger a save from the ui which whill make the trainer save on the next step 2026-05-26 08:38:49 -06:00
Jaret Burkett 2aa60e4ca5 Update default agreement threshold for automagic v2 to be 0.5 2026-05-26 07:57:54 -06:00
Jaret Burkett 76c99da4e4 Add version to the ui 2026-05-26 07:30:09 -06:00
Jaret Burkett 266956068a Add a way to delete checkpoints on the ui 2026-05-26 07:09:21 -06:00
Jaret Burkett 954c5efec8 Show job info on sidebar active job in ui 2026-05-25 11:07:29 -06:00
Jaret Burkett 083236a2a7 Drastically improve the loading speed of images in the ui by using a custom loader and abort controller to abort when images leave the view. 2026-05-25 10:04:25 -06:00
Jaret Burkett 7354def271 Added decode latent method to qwen image model 2026-05-25 10:02:09 -06:00
Jaret Burkett 3d836ac371 Show active jobs in the sidebar of the ui 2026-05-25 08:21:42 -06:00
Jaret Burkett a798e06dd2 Updated the support button to look more like a button 2026-05-25 07:48:04 -06:00
Jaret Burkett 8042cbe9d2 Added virtulization for sample images to handle huge number of samples more efficientyly. 2026-05-25 07:22:24 -06:00
Jaret Burkett fbac1cb7f5 Dont force flash attention on hidream 01. Causes random issues and is slower. 2026-05-24 16:05:22 -06:00
Jaret Burkett 307ff11bc5 Drastically improved the performance of the dataset viewer on large datasets by switching to virtualization. Fixed issue with images loading when they have two periods in a row .. 2026-05-24 15:13:55 -06:00
Jaret Burkett c6a7e81a70 Added a dataset image viewer. Fixed an issue where captions would show as not saved when they were saved. 2026-05-24 14:31:06 -06:00
Jaret Burkett 12304e170f Added some experimental loss targets 2026-05-24 14:13:23 -06:00
Jaret Burkett 644a6f9246 Fix device casting for zimage in some instances 2026-05-23 10:37:33 -06:00
Jaret Burkett c6ecc03ccd Fixed saving full model of z_image l2p for finetuning 2026-05-23 07:36:24 -06:00
Jaret Burkett 6102370df9 Add support for ZImage L2P 2026-05-22 14:58:28 -06:00
Jaret Burkett 6fc08a8928 Fix issue with saving images from new sample viewer 2026-05-22 11:58:32 -06:00
Jaret Burkett 5579837c3f Add hidream o1 to the readme 2026-05-21 07:56:54 -06:00
Jaret Burkett aecd554128 Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders. 2026-05-20 08:56:16 -06:00
Jaret Burkett 15d4fb89ff Fixed overflow issue on modal 2026-05-19 10:12:43 -06:00
Jaret Burkett df851b3497 Made the UI mobile friendly, finally... 2026-05-19 09:27:36 -06:00
Jaret Burkett 6ecaf679dc Add ability to run small scripts from the ui and added a merge lora script 2026-05-18 14:33:47 -06:00
Jaret Burkett ec58dcde92 Add better gradient checkpointing to dfes 2026-05-18 09:25:23 -06:00
Jaret Burkett b42acb988f Remove future steps from loss log if resuming from an earlier step 2026-05-18 09:23:55 -06:00
Jaret Burkett e03c6e4dc9 Fix potential inconsistency with different attention mentods in hidream01 2026-05-13 09:08:11 -06:00
Jaret Burkett 4bfe944792 Scale dfe 7 with velocity_equiv_weight 2026-05-13 09:06:59 -06:00
Jaret Burkett (Ostris) fc4d6ebf39
Add support for fine-tuning Hidream O1 (#831)
* Initial support for hidream. Lora keys likely need work

* Fix saving for hidream-o1

* Remove dependence on flash attention for hidream o1

* Fix gradient checkpointing for hidream o1

* A lot of fixes for hidream. Handle loading and saving as comfy model.

* Omit layers not used in comfy. Fix issue with lora loading keys in comfy

* Version bumpo
2026-05-12 11:15:16 -06:00
Jaret Burkett f38de2a2fe Add tipsv2 locally and fix gradient checkpointing for it 2026-05-10 14:47:44 -06:00
Jaret Burkett d144cb5ea6 Switch to uplot for loss graph and rework performance of graph. It is significantly more perfromant now. 2026-05-07 07:38:00 -06:00
Jaret Burkett a12ddd72a1 Change the velocity weight cap on dfe 9 2026-05-07 07:37:05 -06:00
Jaret Burkett 6bb8acbffc Add agreement_threshold default of 0.6 to automagic 2 2026-05-05 19:13:00 -06:00
Jaret Burkett 963a9f42b2 Add decode latent to wan 2.1 models. Add gradinet checkpointing to wan vae. 2026-05-05 11:30:16 -06:00
Jaret Burkett 4260a3c5b6 Add optimizer test suite and make minor speed adjustments to Automagicv2 2026-05-05 10:02:30 -06:00
Jaret Burkett aeca7fe404 Add Automagic v2 optimizer. It uses significantly less vram and is much more efficient. 2026-05-05 09:09:07 -06:00
Jaret Burkett 0d91fcee9e Allow edit of captioning job 2026-04-30 16:00:16 -06:00
Jaret Burkett eadc9a58af Version bump 2026-04-30 06:00:58 -06:00