3365ad18a5
Support LTX2 tiny vae (taeltx_2) ( #11929 )
2026-01-21 23:03:51 -05:00
abe2ec26a6
Support the Anima model. ( #12012 )
2026-01-21 19:44:28 -05:00
0fc15700be
Add LyCoris LoKr MLP layer support for Flux2 ( #11997 )
2026-01-20 23:18:33 -05:00
e755268e7b
Config for Qwen 3 0.6B model. ( #11998 )
2026-01-20 23:08:31 -05:00
c4a14df9a3
Dynamically detect chroma radiance patch size ( #11991 )
2026-01-20 18:46:11 -05:00
965d0ed509
fix: remove normalization of audio in LTX Mel spectrogram creation ( #11990 )
...
For LTX Audio VAE, remove normalization of audio during MEL spectrogram creation.
This aligs inference with training and prevents loud audio from being attenuated.
2026-01-20 18:44:28 -05:00
8ccc0c94fa
Make omni stuff work on regular z image for easier testing. ( #11985 )
2026-01-20 00:32:00 -05:00
2108167f9f
Support zimage omni base model. ( #11979 )
2026-01-19 23:17:38 -05:00
70c91b8248
Fix #11963 ( #11982 )
2026-01-19 22:32:40 -05:00
0da5a0fe58
Convert mono audio to fake stereo for LTXV VAE encoding ( #11965 )
2026-01-19 22:12:02 -05:00
e0eacb0688
Simpler way to implement the #11980 loras. ( #11981 )
2026-01-19 22:00:36 -05:00
7ac999bf30
Add image sizes to clip vision outputs. ( #11923 )
2026-01-16 23:02:28 -05:00
4c816d5c69
Adjust memory usage factor calculation for flux2 klein. ( #11900 )
2026-01-15 20:06:40 -05:00
3b832231bb
Flux2 Klein support. ( #11890 )
2026-01-15 10:33:15 -05:00
be518db5a7
Remove extraneous clip missing warnings when loading LTX2 embeddings_connector weights ( #11874 )
2026-01-14 17:54:04 -05:00
80441eb15e
utils: fix lanczos grayscale upscaling ( #11873 )
2026-01-14 17:53:16 -05:00
6165c38cb5
Optimize nvfp4 lora applying. ( #11866 )
...
This changes results a bit but it also speeds up things a lot.
2026-01-14 00:49:38 -05:00
712cca36a1
feat: throttle ProgressBar updates to reduce WebSocket flooding ( #11504 )
2026-01-13 22:41:44 -05:00
eff2b9d412
Optimize nvfp4 lora applying. ( #11856 )
2026-01-13 19:37:19 -05:00
15b312de7a
Optimize nvfp4 lora applying. ( #11854 )
2026-01-13 19:23:58 -05:00
1dcbd9efaf
Bump ltxav mem estimation a bit. ( #11842 )
2026-01-13 01:42:07 -05:00
117e7a5853
Refactor to try to lower mem usage. ( #11840 )
2026-01-12 21:01:52 -08:00
b3c0e4de57
Make loras work on nvfp4 models. ( #11837 )
...
The initial applying is a bit slow but will probably be sped up in the
future.
2026-01-12 22:33:54 -05:00
fd5c0755af
Reduce LTX2 VRAM use by more efficient timestep embed handling ( #11829 )
2026-01-12 17:28:59 -05:00
c881a1d689
Support the siglip 2 naflex model as a clip vision model. ( #11831 )
...
Not useful yet.
2026-01-12 17:05:54 -05:00
a3b5d4996a
Support ModelScope-Trainer DiffSynth lora for Z Image. ( #11805 )
2026-01-12 15:38:46 -05:00
2f642d5d9b
Fix chroma fp8 te being treated as fp16. ( #11795 )
2026-01-10 14:40:42 -08:00
cd912963f1
Fix issue with t5 text encoder in fp4. ( #11794 )
2026-01-10 17:31:31 -05:00
6e4b1f9d00
pythorch_attn_by_def_on_gfx1200 ( #11793 )
2026-01-10 16:51:05 -05:00
dc202a2e51
Properly save mixed ops. ( #11772 )
2026-01-10 02:03:57 -05:00
bd0e6825e8
Be less strict when loading mixed ops weights. ( #11769 )
2026-01-09 14:21:06 -05:00
1dc3da6314
Add most basic Asset support for models ( #11315 )
...
* Brought over minimal elements from PR 10045 to reproduce seed_assets and register_assets_system without adding anything to the DB or server routes yet, for now making everything sync (can introduce async once everything is cleaned up and brought over)
* Added db script to insert assets stuff, cleaned up some code; assets (models) now get added/rescanned
* Added support for 5 http endpoints for assets
* Replaced Optional with | None in schemas_in.py and schemas_out.py
* Remove two routes that will not be relevant yet in this PR: HEAD /api/assets/hash/<hash> and PUT /api/assets/<id>/preview
* Remove some functions the two deleted endpoints were using
* Don't show assets scan message upon calling /object_info endpoint
* removed unsued import to satisfy ruff
* Simplified hashing function tpye hint and _hash_file_obj
* Satisfied ruff
2026-01-08 22:21:51 -05:00
1a20656448
Fix import issue. ( #11746 )
2026-01-08 17:23:59 -05:00
0f11869d55
Better detection if AMD torch compiled with efficient attention. ( #11745 )
2026-01-08 17:16:58 -05:00
50d6e1caf4
Tweak ltxv vae mem estimation. ( #11722 )
2026-01-07 23:07:05 -05:00
21e8425087
Add warning for old pytorch. ( #11718 )
2026-01-07 21:07:26 -05:00
b6c79a648a
ops: Fix offloading with FP8MM performance ( #11697 )
...
This logic was checking comfy_cast_weights, and going straight to
to the forward_comfy_cast_weights implementation without
attempting to downscale input to fp8 in the event comfy_cast_weights
is set.
The main reason comfy_cast_weights would be set would be for async
offload, which is not a good reason to nix FP8MM.
So instead, and together the underlying exclusions for FP8MM which
are:
* having a weight_function (usually LowVramPatch)
* force_cast_weights (compute dtype override)
* the weight is not Quantized
* the input is already quantized
* the model or layer has MM explictily disabled.
If you get past all of those exclusions, quantize the input tensor.
Then hand the new input, quantized or not off to
forward_comfy_cast_weights to handle it. If the weight is offloaded
but input is quantized you will get an offloaded MM8.
2026-01-07 21:01:16 -05:00
25bc1b5b57
Add memory estimation function to ltxav text encoder. ( #11716 )
2026-01-07 20:11:22 -05:00
3cd19e99c1
Increase ltxav mem estimation by a bit. ( #11715 )
2026-01-07 20:04:56 -05:00
34751fe9f9
Lower ltxv text encoder vram use. ( #11713 )
2026-01-07 19:12:15 -05:00
48e5ea1dfd
model_patcher: Remove confusing load stat ( #11710 )
...
If the loader passes 1e32 as the usable memory size, it means force
the full load. This happens with CPU loads and a few other misc cases.
Removing the confusing number and just leave the other details.
2026-01-07 18:39:20 -05:00
3cd7b32f1b
Support gemma 12B with quant weights. ( #11696 )
2026-01-07 05:15:14 -05:00
b7d7cc1d49
Fix fp8 fast issue. ( #11688 )
2026-01-07 01:39:06 -05:00
edee33f55e
Disable comfy kitchen cuda if pytorch cuda less than 13 ( #11681 )
2026-01-06 22:13:43 -05:00
2c03884f5f
Skip fp4 matrix mult on devices that don't support it. ( #11677 )
2026-01-06 18:07:26 -05:00
6e9ee55cdd
Disable ltxav previews. ( #11676 )
2026-01-06 17:41:27 -05:00
023cf13721
Fix lowvram issue with ltxv2 text encoder. ( #11675 )
2026-01-06 17:33:03 -05:00
c3c3e93c5b
Use rope functions from comfy kitchen. ( #11674 )
2026-01-06 16:57:50 -05:00
1618002411
Revert "Use rope functions from comfy kitchen. ( #11647 )" ( #11648 )
...
This reverts commit 6ef85c4915
2026-01-05 23:07:39 -05:00
6ef85c4915
Use rope functions from comfy kitchen. ( #11647 )
2026-01-05 22:50:35 -05:00
6da00dd899
Initial ops changes to use comfy_kitchen: Initial nvfp4 checkpoint support. ( #11635 )
...
---------
Co-authored-by: Jedrzej Kosinski <kosinkadink1@gmail.com>
2026-01-05 21:48:58 -05:00
d157c3299d
Refactor module_size function. ( #11637 )
2026-01-05 03:48:31 -05:00
f2b002372b
Support the LTXV 2 model. ( #11632 )
2026-01-05 01:58:59 -05:00
53e762a3af
Print memory summary on OOM to help with debugging. ( #11613 )
2026-01-03 22:28:38 -05:00
9a552df898
Remove leftover scaled_fp8 key. ( #11603 )
2026-01-02 17:28:10 -08:00
65cfcf5b1b
New Year ruff cleanup. ( #11595 )
2026-01-01 22:06:14 -05:00
1bdc9a947f
Remove duplicate import of model_management ( #11587 )
2025-12-31 19:29:55 -05:00
d622a61874
Refactor: move clip_preprocess to comfy.clip_model ( #11586 )
2025-12-31 17:38:36 -05:00
0357ed7ec4
Add support for sage attention 3 in comfyui, enable via new cli arg ( #11026 )
...
* Add support for sage attention 3 in comfyui, enable via new cli arg
--use-sage-attiention3
* Fix some bugs found in PR review. The N dimension at which Sage
Attention 3 takes effect is reduced to 1024 (although the improvement is
not significant at this scale).
* Remove the Sage Attention3 switch, but retain the attention function
registration.
* Fix a ruff check issue in attention.py
2025-12-30 22:53:52 -05:00
178bdc5e14
Add handling for vace_context in context windows ( #11386 )
...
Co-authored-by: ozbayb <17261091+ozbayb@users.noreply.github.com>
2025-12-30 14:40:42 -08:00
0e6221cc79
Add some warnings for pin and unpin errors. ( #11561 )
2025-12-29 18:26:42 -05:00
9ca7e143af
mm: discard async errors from pinning failures ( #10738 )
...
Pretty much every error cudaHostRegister can throw also queues the same
error on the async GPU queue. This was fixed for repinning error case,
but there is the bad mmap and just enomem cases that are harder to
detect.
Do some dummy GPU work to clean the error state.
2025-12-29 18:19:34 -05:00
8fd07170f1
Comment out unused norm_final in lumina/z image model. ( #11545 )
2025-12-28 22:07:25 -05:00
2943093a53
Enable async offload by default for AMD. ( #11534 )
2025-12-27 18:54:15 -05:00
1e4e342f54
Fix noise with ancestral samplers when inferencing on cpu. ( #11528 )
2025-12-26 22:03:01 -05:00
fb478f679a
Only apply gemma quant config to gemma model for newbie. ( #11436 )
2025-12-20 01:02:43 -05:00
4c432c11ed
Implement Jina CLIP v2 and NewBie dual CLIP ( #11415 )
...
* Implement Jina CLIP v2
* Support quantized Gemma in NewBie dual CLIP
2025-12-20 00:57:22 -05:00
31e961736a
Fix issue with batches and newbie. ( #11435 )
2025-12-20 00:23:51 -05:00
3ab9748903
Disable prompt weights on newbie te. ( #11434 )
2025-12-20 00:19:47 -05:00
0aa7fa464e
Implement sliding attention in Gemma3 ( #11409 )
2025-12-20 00:16:46 -05:00
514c24d756
Fix error from logging line ( #11423 )
...
Co-authored-by: ozbayb <17261091+ozbayb@users.noreply.github.com>
2025-12-19 20:22:45 -08:00
809ce68749
Support nested tensor denoise masks. ( #11431 )
2025-12-19 19:59:25 -05:00
cc4ddba1b6
Allow enabling use of MIOpen by setting COMFYUI_ENABLE_MIOPEN=1 as an env var ( #11366 )
2025-12-19 17:01:50 -05:00
28eaab608b
Diffusion model part of Qwen Image Layered. ( #11408 )
...
Only thing missing after this is some nodes to make using it easier.
2025-12-18 20:21:14 -05:00
6a2678ac65
Trim/pad channels in VAE code. ( #11406 )
2025-12-18 18:22:38 -05:00
e4fb3a3572
Support loading Wan/Qwen VAEs with different in/out channels. ( #11405 )
2025-12-18 17:45:33 -05:00
bf7dc63bd6
skip_load_model -> force_full_load ( #11390 )
...
This should be a bit more clear and less prone to potential breakage if the
logic of the load models changes a bit.
2025-12-17 23:29:32 -05:00
86dbb89fc9
Resolution bucketing and Trainer implementation refactoring ( #11117 )
2025-12-17 22:15:27 -05:00
5d9ad0c6bf
Fix the last step with non-zero sigma in sa_solver ( #11380 )
2025-12-17 13:57:40 -05:00
827bb1512b
Add exp_heun_2_x0 sampler series ( #11360 )
2025-12-16 23:35:43 -05:00
ffdd53b327
Check state dict key to auto enable the index_timestep_zero ref method. ( #11362 )
2025-12-16 17:03:17 -05:00
bc606d7d64
Add a way to set the default ref method in the qwen image code. ( #11349 )
2025-12-16 01:26:55 -05:00
683569de55
Only enable fp16 on ZImage on newer pytorch. ( #11344 )
2025-12-15 22:33:27 -05:00
ea2c117bc3
[BlockInfo] Wan ( #10845 )
...
* block info
* animate
* tensor
* device
* revert
2025-12-15 17:59:16 -08:00
fc4af86068
[BlockInfo] Lumina ( #11227 )
...
* block info
* device
* Make tensor int again
---------
Co-authored-by: Jedrzej Kosinski <kosinkadink1@gmail.com>
2025-12-15 17:57:28 -08:00
70541d4e77
Support the new qwen edit 2511 reference method. ( #11340 )
...
index_timestep_zero can be selected in the
FluxKontextMultiReferenceLatentMethod now with the display name set to the
more generic "Edit Model Reference Method" node.
2025-12-15 19:20:34 -05:00
77b2f7c228
Add context windows callback for custom cond handling ( #11208 )
...
Co-authored-by: ozbayb <17261091+ozbayb@users.noreply.github.com>
2025-12-15 16:06:32 -08:00
dbd330454a
feat(preview): add per-queue live preview method override ( #11261 )
...
- Add set_preview_method() to override live preview method per queue item
- Read extra_data.preview_method from /prompt request
- Support values: taesd, latent2rgb, none, auto, default
- "default" or unset uses server's CLI --preview-method setting
- Add 44 tests (37 unit + 7 E2E)
2025-12-15 15:57:39 -08:00
5ac3b26a7d
Update warning for old pytorch version. ( #11319 )
...
Versions below 2.4 are no longer supported. We will not break support on purpose but will not fix it if we do.
2025-12-14 04:02:50 -05:00
6592bffc60
seeds_2: add phi_2 variant and sampler node ( #11309 )
...
* Add phi_2 solver type to seeds_2
* Add sampler node of seeds_2
2025-12-14 00:03:29 -05:00
971cefe7d4
Fix pytorch warnings. ( #11314 )
2025-12-13 18:45:23 -05:00
da2bfb5b0a
Basic implementation of z image fun control union 2.0 ( #11304 )
...
The inpaint part is currently missing and will be implemented later.
I think they messed up this model pretty bad. They added some
control_noise_refiner blocks but don't actually use them. There is a typo
in their code so instead of doing control_noise_refiner -> control_layers
it runs the whole control_layers twice.
Unfortunately they trained with this typo so the model works but is kind
of slow and would probably perform a lot better if they corrected their
code and trained it again.
2025-12-13 01:39:11 -05:00
c5a47a1692
Fix bias dtype issue in mixed ops. ( #11293 )
2025-12-12 11:49:35 -05:00
5495589db3
Respect the dtype the op was initialized in for non quant mixed op. ( #11282 )
2025-12-11 23:32:27 -05:00
eeb020b9b7
Better chroma radiance and other models vram estimation. ( #11278 )
2025-12-11 17:33:09 -05:00
ae65433a60
This only works on radiance. ( #11277 )
2025-12-11 17:15:00 -05:00
fdebe18296
Fix regular chroma radiance ( #11276 )
2025-12-11 17:09:35 -05:00
f8321eb57b
Adjust memory usage factor. ( #11257 )
2025-12-11 01:30:31 -05:00
e711aaf1a7
Lower VAE loading requirements：Create a new branch for GPU memory calculations in qwen-image vae ( #11199 )
2025-12-10 22:02:26 -05:00
17c92a9f28
Tweak Z Image memory estimation. ( #11254 )
2025-12-10 19:59:48 -05:00
Jukka Seppänen
comfyanonymous
Markury
Mylo
Ivan Zorin
rkfg
rattus
Silver
kelseyee
DELUXA
Jedrzej Kosinski
mengqin
drozbay
woctordho
BradPepersAMD
Kohaku-Blueleaf
chaObserv
Haoming
Dr.Lt.Data
Farshore