Commit Graph

426 Commits

Author SHA1 Message Date
Jaret Burkett e8573dad34 Fix trailing progress bar print when stopping a job in the ui 2026-07-22 10:11:08 -06:00
Jaret Burkett 479c72ada2 Add replacing triggers on prompts when caching text encoder 2026-07-19 09:03:05 -06:00
Jaret Burkett f1bc6508ad Fix issue with qwen image edit models. 2026-07-17 09:14:04 -06:00
Jaret Burkett 988d891102 Added a Sample Next Step in the job gear dropdown to force a sample on the next step. 2026-07-17 07:59:30 -06:00
Jaret Burkett 5cb54ba9cc Allow setting weight saving flag on hidream_o1 2026-07-16 07:40:25 -06:00
DasPauluteli a92f18bf71
krea2: don't hardcode the NVIDIA-only cuDNN SDPA backend (#933)
* krea2: don't hardcode NVIDIA-only cuDNN SDPA backend

The krea2 attention() forced SDPBackend.CUDNN_ATTENTION, which is
NVIDIA-only. On non-NVIDIA backends (AMD ROCm, Intel XPU, Apple MPS)
every forward pass fails with 'RuntimeError: No available kernel.
Aborting execution.', so Krea 2 LoRA training cannot run at all there.

Pass a priority list [CUDNN, FLASH, EFFICIENT, MATH] instead. NVIDIA
still selects cuDNN; other backends fall back to flash/efficient/math.
Verified training end-to-end on an AMD Radeon 8060S (gfx1151, ROCm 7.2).

* Version bump

* Add set priority flag so CUDNN_ATTENTION is selected on cuda devices first.

---------

Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
2026-07-15 12:44:34 -06:00
Jaret Burkett b8f8a08ba4 Fix sampling bar with anima 2026-07-15 12:17:06 -06:00
rmatif 3e6bd874c4
feat: Add Anima support (#860)
* Add Anima training support

* Update Anima modular training

* Use sample guidance for Anima

* Fix Anima sampling

* Limit Anima LoRA targets

* Convert Anima LoRA exports

* Fix Anima local loading

* Update Anima default model

* Pin upstream Anima diffusers

* Adjust template defaults to be consistent with other models. Update README

---------

Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com>
2026-07-15 11:59:01 -06:00
fatalis 8bbd051667
Add sample_start_step setting to configure when sampling starts (#949)
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
2026-07-15 11:15:50 -06:00
Jaret Burkett 30162c0602 Improvements for captioner quantization to speed it up. Block compile on captioners. 2026-07-15 10:25:47 -06:00
Jaret Burkett 691ddf434e Add Qwen3.6 VL captioner. 2026-07-15 07:02:33 -06:00
Jaret Burkett abba6b5845 Show better errors on captioner 2026-07-14 07:19:03 -06:00
Jaret Burkett 28f2c0acbe Move z_image over to the new modeling class 2026-07-13 17:12:30 -06:00
Jaret Burkett 7602e476eb Exclude sensative layers from quantization in krea 2026-07-13 10:14:53 -06:00
Jaret Burkett ad07b06de5 Use cached first frame for wan22_5 model 2026-07-10 10:21:34 -06:00
Jaret Burkett 886c2aec57 Allow for vae tiling onle without low vram on wan models with a model kwarg 2026-07-10 09:42:52 -06:00
Jaret Burkett fe82487187 Add tiling on vae decode for qwen image models when low vram flag is on 2026-07-10 09:07:29 -06:00
Jaret Burkett e7951ad29e Exclude sensative layers from quantization on wan models 2026-07-10 08:56:05 -06:00
Jaret Burkett 883d60eb71 Do vae tiling when decoding wan models with low vram active. 2026-07-10 08:02:32 -06:00
Jaret Burkett a4bbe167ce Added reference token attention isolation (kv_cache) for Krea2 edit training. Same training cost with significant inference speed up. 2x inference speedup. 2026-07-09 12:00:55 -06:00
Jaret Burkett 6233efe1bb Fix sampling issue on zimage turbo and krea2 turbo models 2026-07-08 12:34:39 -06:00
Jaret Burkett 7bceec3b07 Apply a loss mask for first frame conditioning for wan and ltx 2026-07-07 09:05:53 -06:00
Jaret Burkett bd93a312bc Load more types of comfy ui style quants for ltx2 2026-07-07 09:04:51 -06:00
Jaret Burkett b1e1a834d4 Added support to train Krea2 as an edit model 2026-07-04 09:12:39 -06:00
Jaret Burkett 4e50535478 Allow models to provide an additional loss 2026-06-28 09:49:36 -06:00
Jaret Burkett 1e12b6b73f Remove duplicate save when triggering save next step 2026-06-28 07:18:16 -06:00
Jaret Burkett 7ee1f98f6d Allow loading and saving z_image in comfy safetensors format. 2026-06-28 07:15:49 -06:00
Jaret Burkett f8667f0334 Save Krea2 even if quantized 2026-06-28 06:03:37 -06:00
Jaret Burkett 4a99ddabad Fix breaking change with diffusers qwen image 2026-06-26 10:04:35 -06:00
Jaret Burkett 5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett d14f6e567a Allow individual models to scale the loss after it is calculated. 2026-06-25 10:13:58 -06:00
Jaret Burkett 7a089fd0d7 Add support for training directly on Krea2 Turbo with a training adapter 2026-06-23 20:32:02 -06:00
Jaret Burkett a803611ec1 Enable tiling on vae when decoding with low_vram flag on krea2 2026-06-23 18:38:52 -06:00
Jaret Burkett 724e67d634 Set krea 2 to use new lokr format 2026-06-23 13:31:50 -06:00
Jaret Burkett e20b42e84a Add offloading support for krea2 2026-06-23 10:43:36 -06:00
Jaret Burkett (Ostris) 99be3d96a2
Add support for Krea2 (#906)
* Add support for krea2

* Update repo pointer to actual repo
2026-06-23 09:18:14 -06:00
Jaret Burkett 820d534d6e Add features for models that may need a non masked loss such as inpainiting. 2026-06-22 10:59:17 -06:00
Jaret Burkett 99f8fd44e3 Add a fallback bbox adjustment when json parsing fails on ideogram4 captioner 2026-06-19 07:25:54 -06:00
Jaret Burkett 022d1c29e0 Remove color pallet for individual objects in the caption prompts 2026-06-19 06:56:18 -06:00
Jaret Burkett 60c1ac6a50 Add support for Boogu Image and Boogu Image Edit 2026-06-18 15:05:49 -06:00
Jaret Burkett e886745051 Added additional information on addine new models and some additional gotchas 2026-06-18 15:04:50 -06:00
Jaret Burkett 515b0ea5cd Remove transformer log supression from captioner 2026-06-18 10:00:30 -06:00
Jaret Burkett ad49d4ef25 Update example to cover some common issues 2026-06-18 07:54:37 -06:00
Jaret Burkett 66f7c06742 Patch away the qwen3vl conv3d that only has slow bf16 kernels 2026-06-17 14:29:20 -06:00
Jaret Burkett 92814f9e6d Apply ideogram dynamic shifting to sampling 2026-06-16 18:52:16 -06:00
Jaret Burkett 178eb5fbbe Add unconditional lora support so Ideogram 4 inference will more closely resemble the full pipeline results. I pushed a finetuned unconditional lora to the hub as an adapter. 2026-06-16 13:27:43 -06:00
Jaret Burkett f6c0104f25 Handle unconditional conditioning for ideogram 4 more in line with example code. 2026-06-16 10:23:08 -06:00
Jaret Burkett 86b19589a0 Update the Ideogram 4 prompt generation/parsing/ui to handle the updated format notes better. 2026-06-16 09:44:38 -06:00
Jaret Burkett fcccc0fbd2 Add gradient checkpointing to ideogram4 vae 2026-06-15 10:00:40 -06:00
Jaret Burkett c0d600b5d6 Allow using flash backend for ideogram 2026-06-13 15:17:20 -06:00