Commit Graph

281 Commits

Author SHA1 Message Date
Jaret Burkett 6b7fb60a22 Make contrastive guidance loss do constant instead of sigma loss schedule by default 2026-08-13 09:52:02 -06:00
Jaret Burkett 257da9b586 Rework DOP so it works with caching text embeddings 2026-08-09 22:13:49 -06:00
Jaret Burkett 72623ed3d6 When doing auto frame count. Ensure the time is not squeezed or expanded to fit tempooral spacing. trime the few extra frames. Also fixed frame counts of buckets. 2026-08-09 12:31:02 -06:00
Jaret Burkett 1e1418b22c Apply sigma to contrastive guidance to balance loss better. Prevent noise grads on images/non audio datasets. Prep for training adapters on MiniMax H3 2026-08-05 13:27:12 -06:00
Jaret Burkett 00a93e3830 Add dataset flag to cache the raw tensors 2026-08-04 15:32:48 -06:00
Jaret Burkett 41676bb258 Queue up videos with multiple threads when caching latents so the VAE is not waiting on videos to process 2026-08-03 15:41:36 -06:00
Jaret Burkett 497014bf5d Set i2v to default to false when omitted from the config 2026-07-31 19:11:58 -06:00
Jaret Burkett c3afd95cc4 Improvements for mps convrot quants 2026-07-28 12:11:19 -06:00
Jaret Burkett 0c3a5e6970 Default to lokr full rank when not passed. 2026-07-25 09:06:49 -06:00
Jaret Burkett efb58c8641 Switch to thumbnails and thumbnail creation on the sample grid page until clicked. 2026-07-25 08:40:33 -06:00
Jaret Burkett 1eb97b7443 Added validation loss 2026-07-19 19:33:45 -06:00
rmatif 3e6bd874c4
feat: Add Anima support (#860)
* Add Anima training support

* Update Anima modular training

* Use sample guidance for Anima

* Fix Anima sampling

* Limit Anima LoRA targets

* Convert Anima LoRA exports

* Fix Anima local loading

* Update Anima default model

* Pin upstream Anima diffusers

* Adjust template defaults to be consistent with other models. Update README

---------

Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com>
2026-07-15 11:59:01 -06:00
fatalis 8bbd051667
Add sample_start_step setting to configure when sampling starts (#949)
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
2026-07-15 11:15:50 -06:00
Jaret Burkett dd08579eda Add ability to pull control images from same folder group 2026-07-08 05:21:31 -06:00
Jaret Burkett 6ecff36f26 Add a way to do full rank lora modules of non lora layers such as embeddings, norm, etc 2026-06-25 11:55:07 -06:00
PlagueKind 089e41dd1c
Compile improvements - auto cache size, fix fullgraph setting, fix triton detection (#899)
* Compile improvements - auto cache size, fix fullgraph setting, fix triton detection

* remove forced torchao no longer needed
2026-06-24 07:59:41 -06:00
Jaret Burkett 60c1ac6a50 Add support for Boogu Image and Boogu Image Edit 2026-06-18 15:05:49 -06:00
Jaret Burkett 178eb5fbbe Add unconditional lora support so Ideogram 4 inference will more closely resemble the full pipeline results. I pushed a finetuned unconditional lora to the hub as an adapter. 2026-06-16 13:27:43 -06:00
Jaret Burkett c730d64478 Added a flag to keep loading the image when latents are cached. Useful for DFE and other methods that target pixelspace losses. 2026-06-15 05:31:48 -06:00
Jaret Burkett 2f91db8363 Defauly to compiling full graph to false 2026-06-13 07:28:51 -06:00
PlagueKind e908d85f5e
Allow quantized unet offload compile and force fullgraph false (#881) 2026-06-13 07:27:28 -06:00
Jaret Burkett d83f7dd4d9 Fix a few issues with compile. Changed defaults. Future proofed block layer compile. 2026-06-12 11:43:43 -06:00
PlagueKind 6b1f89f30b
Enhanced torch.compile System with Block-Level Compilation and Unified Whole-Model Fallback (#866)
* Add block-level compile and qcompile torch.compile whole model  modes

* Update torch compile system
2026-06-12 10:35:12 -06:00
Jaret Burkett 41157b460c Added ability to set the caption extention in dataset viewer, captioner, and trainer so one dataset can have multiple caption styles in different files with different extensions. Added dataset caption template for a blank ideogram 4 formatted template. 2026-06-06 08:32:24 -06:00
Jaret Burkett 12304e170f Added some experimental loss targets 2026-05-24 14:13:23 -06:00
Jaret Burkett aecd554128 Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders. 2026-05-20 08:56:16 -06:00
Jaret Burkett (Ostris) fc4d6ebf39
Add support for fine-tuning Hidream O1 (#831)
* Initial support for hidream. Lora keys likely need work

* Fix saving for hidream-o1

* Remove dependence on flash attention for hidream o1

* Fix gradient checkpointing for hidream o1

* A lot of fixes for hidream. Handle loading and saving as comfy model.

* Omit layers not used in comfy. Fix issue with lora loading keys in comfy

* Version bumpo
2026-05-12 11:15:16 -06:00
Jaret Burkett f4445cd78c Added psuedo_huber loss 2026-04-19 09:51:46 -06:00
Jaret Burkett 9b4e2d1b0b More flac support 2026-04-10 12:27:09 -06:00
Jaret Burkett 78cf049c29
Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785)
* Base ace step 1.5 xl added. Generating, still wip on training and ui

* Base training code done

* Fix some issues with caching text embeddings. Update sample cards to show audio

* Fix issue with quantizing ace step

* Add album artwork to samples with waveform.

* Cleanup logs

* Add album art endpoint to speed up album art loading

* Made an make video with artwork script

* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.

* Add prompt tagging system for special tagged models.

* prompt tagging processing for ui working.

* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model

* Add a captioner job with music captioner that is prepped for use with the ui

* Add basit ui setup for captioning modal and handeling captioning jobs

* Starting captioning job from ui working. Still better management for it.

* Better filtering of job options in the job view for captioning jobs

* Added qwen3 vl as a captioner for images

* Have an indicator when a dataset is being captioned.

* Adjust the way caption jobs look in the queue

* Fix a few issues. Adjust defaults.

* Version bump

* Added ace step to the readme.
2026-04-09 15:02:03 -06:00
Jaret Burkett da2a79590f Add a merge network on save strength 2026-04-01 09:21:08 -06:00
Jaret Burkett 4a3251640a More work on compiling models 2026-03-31 12:11:56 -06:00
Jaret Burkett 171535833a
Add Mac OS support for Apple Silicon (#770)
* Made an install script and auto updates env for mac

* GPU sensors and initial training working for MAC. Still WIP.

* Switch dataloader to single threaded until I can work around some mac pickeling issues.

* Get quantization working on mac

* Fix mac exclusive imports so they don't break other builds.

* Add mac instructions to the UI
2026-03-30 09:37:47 -06:00
Jaret Burkett 6a1fc54779 Add t0 loss target 2026-03-28 13:35:21 -06:00
Jaret Burkett 7f3309b291 Add support for audo frame count so datasets can have varrying length videos. Varous ltx 2.3 VAE optimizations such as removing tiling articacts, and doing frame split encoding to reduce vram on encoding/decoding. 2026-03-24 12:20:09 -06:00
Jaret Burkett 0f075fc45e Adjust signal amplification target. Allow signal amplification strength in config. 2026-03-22 08:30:13 -06:00
Jaret Burkett dcd98dc0d5 Add signal amplification 2026-03-21 07:44:18 -06:00
Jaret Burkett 4909b809c7 Fixed issue with audio loss multiplier. 2026-03-10 15:16:09 -06:00
Jaret Burkett 06ef3d343a add ability to use batch noise correction during training 2026-03-10 09:05:57 -06:00
Jaret Burkett 1c74ca5d22 Add audio_loss_multiplier to scale audio loss to larger values if desired. 2026-02-19 11:57:44 -07:00
Jaret Burkett a055947d56 Add signal_correction_noise_scale to config to scale the signal correction strength 2026-02-07 12:04:21 -07:00
Jaret Burkett 454722cc97 Add signal correction noise 2026-02-07 09:49:55 -07:00
Jaret Burkett 5c37db04f9 Added ability to activate experimental blank stabilization during training to zero out latents with blank prompts. 2026-02-04 13:00:03 -07:00
Jaret Burkett 5b5aadadb8
Add LTX-2 Support (#644)
* WIP, adding support for LTX2

* Training on images working

* Fix loading comfy models

* Handle converting and deconverting lora so it matches original format

* Reworked ui to habdle ltx and propert dataset default overwriting.

* Update the way lokr saves to it is more compatable with comfy

* Audio loading and synchronization/resampling is working

* Add audio to training. Does it work? Maybe, still testing.

* Fixed fps default issue for sound

* Have ui set fps for accurate audio mapping on ltx

* Added audio procession options to the ui for ltx

* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett 87edca1b2b Added initial support to initiate lora training from an existing lora 2025-12-22 12:49:15 -07:00
Jaret Burkett ba00eea7d9 Add loss graph to the ui 2025-12-18 10:08:59 -07:00
Jaret Burkett e6c5aead3b Fix issue that prevented ramtorch layer offloading with z_image 2025-12-02 16:14:34 -07:00
Jaret Burkett 2e7b2d9926 Added Differential Guidance training target 2025-11-10 09:38:25 -07:00
Jaret Burkett 6f308fc46e When soing guidance loss, make CFG zero an optional target instead of a forced one. 2025-11-04 09:16:15 -07:00
Jaret Burkett ee206cfa18 Added blank prompt preservation 2025-10-22 14:55:13 -06:00