c730d64478
Added a flag to keep loading the image when latents are cached. Useful for DFE and other methods that target pixelspace losses.
2026-06-15 05:31:48 -06:00
41157b460c
Added ability to set the caption extention in dataset viewer, captioner, and trainer so one dataset can have multiple caption styles in different files with different extensions. Added dataset caption template for a blank ideogram 4 formatted template.
2026-06-06 08:32:24 -06:00
aecd554128
Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders.
2026-05-20 08:56:16 -06:00
af6458d1b5
Enable caching of ACE step latents.
2026-04-28 13:39:20 -06:00
78cf049c29
Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. ( #785 )
...
* Base ace step 1.5 xl added. Generating, still wip on training and ui
* Base training code done
* Fix some issues with caching text embeddings. Update sample cards to show audio
* Fix issue with quantizing ace step
* Add album artwork to samples with waveform.
* Cleanup logs
* Add album art endpoint to speed up album art loading
* Made an make video with artwork script
* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.
* Add prompt tagging system for special tagged models.
* prompt tagging processing for ui working.
* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model
* Add a captioner job with music captioner that is prepped for use with the ui
* Add basit ui setup for captioning modal and handeling captioning jobs
* Starting captioning job from ui working. Still better management for it.
* Better filtering of job options in the job view for captioning jobs
* Added qwen3 vl as a captioner for images
* Have an indicator when a dataset is being captioned.
* Adjust the way caption jobs look in the queue
* Fix a few issues. Adjust defaults.
* Version bump
* Added ace step to the readme.
2026-04-09 15:02:03 -06:00
7f3309b291
Add support for audo frame count so datasets can have varrying length videos. Varous ltx 2.3 VAE optimizations such as removing tiling articacts, and doing frame split encoding to reduce vram on encoding/decoding.
2026-03-24 12:20:09 -06:00
5642b656b9
Fix audio issues with ltx2 models. Silent codec fails now raised. Auto convert surround sound audio to stereo. Invalidate old caches just to be safe so they recache now.
2026-03-23 20:08:33 +00:00
1ce2428722
Shrink text embeds to max token length for LTX-2. Drastically reduces cached text embedding sizes
2026-01-28 12:54:49 -07:00
73dedbf662
Do caching of latents, first frame and audio when caching latents for LTX2
2026-01-14 11:05:23 -07:00
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
ff14cd6343
Fix check for making sure vae is on the right device.
2025-10-21 14:49:20 -06:00
be990630b9
Remove dropout from cached text embeddings even if used specifies it so blank prompts are not cached.
2025-09-26 11:50:53 -06:00
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
390e21bec6
Integrate dataset level trigger words and allow them to be cached. Default to global trigger if it is set.
2025-09-18 03:29:18 -06:00
f699f4be5f
Add ability to set transparent color for control images
2025-09-02 11:08:44 -06:00
5c27f89af5
Add example config for qwen image edit
2025-08-23 18:20:36 -06:00
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
77dc38a574
Some work on caching text embeddings
2025-07-26 09:22:04 -06:00
5e86139e0a
Fix `NameError`.
2025-06-11 15:07:20 +02:00
c5d6b74fea
Fix caption loading.
2025-06-11 15:05:31 +02:00
22cdfadab6
Added new timestep weighing strategy
2025-06-04 01:16:02 -06:00
1210050ead
Reworked control generator. It is now significantly faster. Also uses better pose model with better license.
2025-05-08 14:35:55 -06:00
c12036df95
Added ability to use short captions from json caption file
2025-04-16 08:32:28 -06:00
d8bdc03256
Allow full control of caption extensions
2025-04-10 07:42:04 -06:00
96ba2fd129
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
2025-04-09 13:35:04 -06:00
1d5f387f54
Fix docker command to work better with runpod
2025-03-27 17:44:46 -06:00
45be82d5d6
Handle inpainting training for control_lora adapter
2025-03-24 13:17:47 -06:00
f10937e6da
Handle multi control inputs for control lora training
2025-03-23 07:37:08 -06:00
b829983b16
Added ability to load video datasets and train with them
2025-03-19 09:54:26 -06:00
c52421aab7
Allow clip image to not have processor on dataloader for raw img
2025-03-15 08:27:54 -06:00
5e663746b8
Working multi gpu training. Still need a lot of tweaks and testing.
2025-01-25 16:46:20 -07:00
3922981996
Added some additional experimental things to the vision direct encoder
2024-10-10 19:42:26 +00:00
ab22674980
Allow for a default caption file in the folder. Minor bug fixes.
2024-10-10 07:31:33 -06:00
28e6f00790
Fixed bug in returning clip image embed to actually return it
2024-10-03 10:49:09 -06:00
67e0aca750
Added ability to load clip pairs randomly from folder. Other small bug fixes
2024-10-03 10:03:49 -06:00
58537fc92b
Added initial direct vision pixtral support
2024-09-28 10:47:51 -06:00
e127c079da
fix: print out the path where the image encode failed ( #107 )
2024-08-22 21:34:35 -06:00
9001e5c933
Change flux latent spact if so it will not use old cache
2024-08-14 11:27:40 -06:00
87ba867fdc
Added flux training. Still a WIP. Wont train right without rectified flow working right
2024-08-02 15:00:30 -06:00
03613c523f
Bugfixes and cleanup
2024-08-01 11:45:12 -06:00
80aa2dbb80
New image generation img2img. various tweaks and fixes
2024-07-24 04:13:41 -06:00
e4558dff4b
Partial implementation for training auraflow.
2024-07-12 12:11:38 -06:00
bd10d2d668
Some work on sd3 training. Not working
2024-06-13 12:19:16 -06:00
3f3636b788
Bug fixes and little improvements here and there.
2024-06-08 06:24:20 -06:00
833c833f28
WIP on SAFE encoder. Work on fp16 training improvements. Various other tweaks and improvements
2024-05-27 10:50:24 -06:00
10e1ecf1e8
Added single value adapter training
2024-04-28 06:04:47 -06:00
b96913d73c
Improvements to dataloader
2024-04-27 09:28:28 -06:00
5da3613e0b
Bug fixes and minor features
2024-04-25 06:14:31 -06:00
427847ac4c
Small tweaks and fixes for specialized ip adapter training
2024-03-26 11:35:26 -06:00
Jaret Burkett
Hameer Abbasi
liaoliaojun