97bf49edad
Add support for video references in MiniMax H3 ref2va
2026-08-15 06:18:09 -06:00
257da9b586
Rework DOP so it works with caching text embeddings
2026-08-09 22:13:49 -06:00
72623ed3d6
When doing auto frame count. Ensure the time is not squeezed or expanded to fit tempooral spacing. trime the few extra frames. Also fixed frame counts of buckets.
2026-08-09 12:31:02 -06:00
8c1a4082fd
Allow images to work with auto frame count, and include images in video datasets if they exist.
2026-08-08 20:26:28 -06:00
3afa270ab5
Fix audio losses for DOP and other preservation losses
2026-08-04 22:08:48 -06:00
0f9094db95
Fix audio loss when doing do_guidance_loss
2026-08-04 21:43:31 -06:00
00a93e3830
Add dataset flag to cache the raw tensors
2026-08-04 15:32:48 -06:00
8502a845b1
Add support for MiniMax H3 T2V and I2V training
2026-08-03 10:17:39 -06:00
6b95282097
Recover from issue when a video model first fram may not have been cached properly
2026-08-01 12:00:33 -06:00
3f8afcac7e
Allow dataloader to encode first frame with the text embeddings if the model needs it.
2026-07-29 17:50:45 -06:00
c730d64478
Added a flag to keep loading the image when latents are cached. Useful for DFE and other methods that target pixelspace losses.
2026-06-15 05:31:48 -06:00
41157b460c
Added ability to set the caption extention in dataset viewer, captioner, and trainer so one dataset can have multiple caption styles in different files with different extensions. Added dataset caption template for a blank ideogram 4 formatted template.
2026-06-06 08:32:24 -06:00
78cf049c29
Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. ( #785 )
...
* Base ace step 1.5 xl added. Generating, still wip on training and ui
* Base training code done
* Fix some issues with caching text embeddings. Update sample cards to show audio
* Fix issue with quantizing ace step
* Add album artwork to samples with waveform.
* Cleanup logs
* Add album art endpoint to speed up album art loading
* Made an make video with artwork script
* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.
* Add prompt tagging system for special tagged models.
* prompt tagging processing for ui working.
* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model
* Add a captioner job with music captioner that is prepped for use with the ui
* Add basit ui setup for captioning modal and handeling captioning jobs
* Starting captioning job from ui working. Still better management for it.
* Better filtering of job options in the job view for captioning jobs
* Added qwen3 vl as a captioner for images
* Have an indicator when a dataset is being captioned.
* Adjust the way caption jobs look in the queue
* Fix a few issues. Adjust defaults.
* Version bump
* Added ace step to the readme.
2026-04-09 15:02:03 -06:00
7f3309b291
Add support for audo frame count so datasets can have varrying length videos. Varous ltx 2.3 VAE optimizations such as removing tiling articacts, and doing frame split encoding to reduce vram on encoding/decoding.
2026-03-24 12:20:09 -06:00
1ce2428722
Shrink text embeds to max token length for LTX-2. Drastically reduces cached text embedding sizes
2026-01-28 12:54:49 -07:00
73dedbf662
Do caching of latents, first frame and audio when caching latents for LTX2
2026-01-14 11:05:23 -07:00
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
a767b82b60
Fixed issue with new logger when ooming
2025-12-25 16:57:34 +00:00
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
e27e229b36
add prior_reg flag to FileItemDTO
2025-09-18 02:09:39 +03:00
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
5d8922fca2
Add ability to designate a dataset as i2v or t2v for models that support it
2025-08-06 09:29:47 -06:00
24cd94929e
Fix bug that can happen with fast processing dataset
2025-06-25 14:01:08 -06:00
f3eb1dff42
Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss
2025-06-24 08:51:29 -06:00
9794416a5d
Fixed bug when loading video datasets
2025-04-10 08:16:05 -06:00
38ad5a4644
Fixed issue with video dataset sizing
2025-04-07 12:46:41 -06:00
3d131fb27a
Added a file signature check on the dataset size caching system to invalidate cached dimensions if the file changes.
2025-04-01 07:39:36 -06:00
45be82d5d6
Handle inpainting training for control_lora adapter
2025-03-24 13:17:47 -06:00
b829983b16
Added ability to load video datasets and train with them
2025-03-19 09:54:26 -06:00
bedb8197a2
Fixed issue with sizes for some images being loaded sideways resulting in squished images.
2024-10-20 11:51:29 -06:00
86b5938cf3
Fixed the webp bug finally.
2024-09-25 13:56:00 -06:00
58dffd43a8
Added caching to image sizes so we dont do it every time.
2024-07-15 19:07:41 -06:00
10e1ecf1e8
Added single value adapter training
2024-04-28 06:04:47 -06:00
b96913d73c
Improvements to dataloader
2024-04-27 09:28:28 -06:00
337945de9a
Added this not that guidance. Added ability to replace prompts.
2024-02-28 20:10:14 -07:00
1ae1017748
Bug fixes. added ability to use l1 loss. varous other tests and improvements
2024-01-31 06:30:54 -07:00
645b27f97a
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
2024-01-04 12:59:38 -07:00
0f8daa5612
Bug fixes, work on maing IP adapters more customizable.
2023-12-24 08:32:39 -07:00
0f597f453e
Switched ip adapter dataloader to clip_image paths so the control paths can be used for training assistant adapters while training ip adapters
2023-12-20 10:32:24 -07:00
1ee62562a4
diffirential guidance is WORKING (from what I can tell)
2023-11-07 19:24:12 -07:00
8a9e8f708f
Added base for using guidance during training. Still not working right.
2023-11-05 04:03:32 -07:00
d742792ee4
Fixed issue with not loading short prompt
2023-10-24 16:19:32 -06:00
002279cec3
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
2023-10-24 16:02:07 -06:00
07bf7bd7de
Allow augmentations and targeting different loss types fron the config file
2023-10-18 03:04:57 -06:00
bb1d3793e3
Added ability to add masks to dataloader and sd trainer to adjust weight of image
2023-10-09 11:21:00 -06:00
f73402473b
Bug fixes. Added some functionality to help with private extensions
2023-10-05 07:09:34 -06:00
579650eaf8
Fixed big issue with bucketing dataloader and added random cripping to a point of interest
2023-10-02 18:31:08 -06:00
085787b799
Allow loading auxillery images from dataloader
2023-09-30 07:28:23 -06:00
19255cdc7c
Bugfixes. Added small augmentations to dataloader. Will switch to abluminations soon though. Added ability to adjust step count on start to override what is in the file
2023-09-20 05:30:10 -06:00
Jaret Burkett
squewel