79d5ceae6e
Improved memory management. ( #5450 )
...
* Less fragile memory management.
* Fix issue.
* Remove useless function.
* Prevent and detect some types of memory leaks.
* Run garbage collector when switching workflow if needed.
* Fix issue.
2024-12-02 14:39:34 -05:00
2d5b3e0078
Remove useless code.
2024-12-02 06:49:55 -05:00
8e4118c0de
make dpm_2_ancestral work with rectified flow.
2024-12-01 07:37:41 -05:00
26fb2c68e8
Add a way to disable cropping in the CLIPVisionEncode node.
2024-11-28 20:24:47 -05:00
bf2650a80e
Fast previews for ltxv.
2024-11-28 06:46:15 -05:00
b666539595
Remove print.
2024-11-27 20:28:39 -05:00
95d8713482
Missing parentheses.
2024-11-27 13:45:32 -05:00
497db6212f
Alternative fix for #5767
2024-11-26 17:53:04 -05:00
4c82741b54
Support official SD3.5 Controlnets.
2024-11-26 11:31:25 -05:00
15c39ea757
Support for the official mochi lora format.
2024-11-26 03:34:36 -05:00
b7143b74ce
Flux inpaint model does not work in fp16.
2024-11-26 01:33:01 -05:00
61196d8857
Add option to inference the diffusion model in fp32 and fp64.
2024-11-25 05:00:23 -05:00
b4526d3fc3
Skip layer guidance now works on hydit model.
2024-11-24 05:54:30 -05:00
ab885b33ba
Skip layer guidance node now works on LTX-Video.
2024-11-23 10:33:05 -05:00
839ed3368e
Some improvements to the lowvram unloading.
2024-11-22 20:59:15 -05:00
6e8cdcd3cb
Fix some tiled VAE decoding issues with LTX-Video.
2024-11-22 18:00:34 -05:00
e5c3f4b87f
LTXV lowvram fixes.
2024-11-22 17:17:11 -05:00
bc6be6c11e
Some fixes to the lowvram system.
2024-11-22 16:40:04 -05:00
5818f6cf51
Remove print.
2024-11-22 10:49:15 -05:00
5e16f1d24b
Support Lightricks LTX-Video model.
2024-11-22 08:46:39 -05:00
2fd9c1308a
Fix mask issue in some attention functions.
2024-11-22 02:10:09 -05:00
8f0009aad0
Support new flux model variants.
2024-11-21 08:38:23 -05:00
41444b5236
Add some new weight patching functionality.
...
Add a way to reshape lora weights.
Allow weight patches to all weight not just .weight and .bias
Add a way for a lora to set a weight to a specific value.
2024-11-21 07:19:17 -05:00
07f6eeaa13
Fix mask issue with attention_xformers.
2024-11-20 17:07:46 -05:00
22535d0589
Skip layer guidance now works on stable audio model.
2024-11-20 07:33:06 -05:00
b699a15062
Refactor inpaint/ip2p code.
2024-11-19 03:25:25 -05:00
d9f90965c8
Support block replace patches in auraflow.
2024-11-17 08:19:59 -05:00
41886af138
Add transformer options blocks replace patch to mochi.
2024-11-16 20:48:14 -05:00
3b9a6cf2b1
Fix issue with 3d masks.
2024-11-13 07:18:30 -05:00
8ebf2d8831
Add block replace transformer_options to flux.
2024-11-12 08:00:39 -05:00
eb476e6ea9
Allow 1D masks for 1D latents.
2024-11-11 14:44:52 -05:00
8b275ce5be
Support auto detecting some zsnr anime checkpoints.
2024-11-11 05:34:11 -05:00
2a18e98ccf
Refactor so that zsnr can be set in the sampling_settings.
2024-11-11 04:55:56 -05:00
bdeb1c171c
Fast previews for mochi.
2024-11-10 03:39:35 -05:00
8b90e50979
Properly handle and reshape masks when used on 3d latents.
2024-11-09 15:30:19 -05:00
2865f913f7
Free memory before doing tiled decode.
2024-11-07 04:01:24 -05:00
b49616f951
Make VAEDecodeTiled node work with video VAEs.
2024-11-07 03:47:12 -05:00
5e29e7a488
Remove scaled_fp8 key after reading it to silence warning.
2024-11-06 04:56:42 -05:00
8afb97cd3f
Fix unknown VAE being detected as the mochi VAE.
2024-11-05 03:43:27 -05:00
69694f40b3
fix dynamic shape export ( #5490 )
2024-11-04 14:59:28 -05:00
6c9dbde7de
Fix mochi all in one checkpoint t5xxl key names.
2024-11-03 01:40:42 -05:00
fabf449feb
Mochi VAE encoder.
2024-11-01 17:33:09 -04:00
1c8286a44b
Avoid SyntaxWarning in UniPC docstring ( #5442 )
2024-10-31 15:17:26 -04:00
1af4a47fd1
Bump up mac version for attention upcast bug workaround.
2024-10-31 15:15:31 -04:00
daa1565b93
Fix diffusers flux controlnet regression.
2024-10-30 13:11:34 -04:00
09fdb2b269
Support SD3.5 medium diffusers format weights and loras.
2024-10-30 04:24:00 -04:00
30c0c81351
Add a way to patch blocks in SD3.
2024-10-29 00:48:32 -04:00
13b0ff8a6f
Update SD3 code.
2024-10-28 21:58:52 -04:00
c320801187
Remove useless line.
2024-10-28 17:41:12 -04:00
669d9e4c67
Set default shift on mochi to 6.0
2024-10-27 22:21:04 -04:00
9ee0a6553a
float16 inference is a bit broken on mochi.
2024-10-27 04:56:40 -04:00
5cbb01bc2f
Basic Genmo Mochi video model support.
...
To use:
"Load CLIP" node with t5xxl + type mochi
"Load Diffusion Model" node with the mochi dit file.
"Load VAE" with the mochi vae file.
EmptyMochiLatentVideo node for the latent.
euler + linear_quadratic in the KSampler node.
2024-10-26 06:54:00 -04:00
c3ffbae067
Make LatentUpscale nodes work on 3d latents.
2024-10-26 01:50:51 -04:00
d605677b33
Make euler_ancestral work on flow models (credit: Ashen).
2024-10-25 19:53:44 -04:00
af8cf79a2d
support SimpleTuner lycoris lora for SD3 ( #5340 )
2024-10-24 01:18:32 -04:00
66b0961a46
Fix ControlLora issue with last commit.
2024-10-23 17:02:40 -04:00
754597c8a9
Clean up some controlnet code.
...
Remove self.device which was useless.
2024-10-23 14:19:05 -04:00
915fdb5745
Fix lowvram edge case.
2024-10-22 16:34:50 -04:00
5a8a48931a
remove attention abstraction ( #5324 )
2024-10-22 14:02:38 -04:00
8ce2a1052c
Optimizations to --fast and scaled fp8.
2024-10-22 02:12:28 -04:00
f82314fcfc
Fix duplicate sigmas on beta scheduler.
2024-10-21 20:19:45 -04:00
0075c6d096
Mixed precision diffusion models with scaled fp8.
...
This change allows supports for diffusion models where all the linears are
scaled fp8 while the other weights are the original precision.
2024-10-21 18:12:51 -04:00
83ca891118
Support scaled fp8 t5xxl model.
2024-10-20 22:27:00 -04:00
f9f9faface
Fixed model merging issue with scaled fp8.
2024-10-20 06:24:31 -04:00
471cd3eace
fp8 casting is fast on GPUs that support fp8 compute.
2024-10-20 00:54:47 -04:00
a68bbafddb
Support diffusion models with scaled fp8 weights.
2024-10-19 23:47:42 -04:00
73e3a9e676
Clamp output when rounding weight to prevent Nan.
2024-10-19 19:07:10 -04:00
67158994a4
Use the lowvram cast_to function for everything.
2024-10-17 17:25:56 -04:00
0bedfb26af
Revert "Fix Transformers FutureWarning ( #5140 )"
...
This reverts commit 95b7cf9bbe
2024-10-16 12:36:19 -04:00
f584758271
Cleanup some useless lines.
2024-10-14 21:02:39 -04:00
95b7cf9bbe
Fix Transformers FutureWarning ( #5140 )
...
* Update sd1_clip.py
Fix Transformers FutureWarning
* Update sd1_clip.py
Fix comment
2024-10-14 20:12:20 -04:00
3c60ecd7a8
Fix fp8 ops staying enabled.
2024-10-12 14:10:13 -04:00
7ae6626723
Remove useless argument.
2024-10-12 07:16:21 -04:00
6632365e16
model_options consistency between functions.
...
weight_dtype -> dtype
2024-10-11 20:51:19 -04:00
ad07796777
🐛 Add device to variable c ( #5210 )
2024-10-11 20:37:50 -04:00
1b80895285
Make clip loader nodes support loading sd3 t5xxl in lower precision.
...
Add attention mask support in the SD3 text encoder code.
2024-10-10 15:06:15 -04:00
5f9d5a244b
Hotfix for the div zero occurrence when memory_used_encode is 0 ( #5121 )
...
https://github.com/comfyanonymous/ComfyUI/issues/5069#issuecomment-2382656368
2024-10-09 23:34:34 -04:00
4b2f0d9413
Increase maximum macOS version to 15.0.1 when forcing upcast attention ( #5191 )
2024-10-09 22:21:41 -04:00
e38c94228b
Add a weight_dtype fp8_e4m3fn_fast to the Diffusion Model Loader node.
...
This is used to load weights in fp8 and use fp8 matrix multiplication.
2024-10-09 19:43:17 -04:00
203942c8b2
Fix flux doras with diffusers keys.
2024-10-08 19:03:40 -04:00
8dfa0cc552
Make SD3 fast previews a little better.
2024-10-07 09:19:59 -04:00
e5ecdfdd2d
Make fast previews for SDXL a little better by adding a bias.
2024-10-06 19:27:04 -04:00
7d29fbf74b
Slightly improve the fast previews for flux by adding a bias.
2024-10-06 17:55:46 -04:00
7d2467e830
Some minor cleanups.
2024-10-05 13:22:39 -04:00
6f021d8aa0
Let --verbose have an argument for the log level.
2024-10-04 10:05:34 -04:00
d854ed0bcf
Allow using SD3 type te output on flux model.
2024-10-03 09:44:54 -04:00
abcd006b8c
Allow more permutations of clip/t5 in dual clip loader.
2024-10-03 09:26:11 -04:00
d985d1d7dc
CLIP Loader node now supports clip_l and clip_g only for SD3.
2024-10-02 04:25:17 -04:00
d1cdf51e1b
Refactor some of the TE detection code.
2024-10-01 07:08:41 -04:00
b4626ab93e
Add simpletuner lycoris format for SD unet.
2024-09-30 06:03:27 -04:00
a9e459c2a4
Use torch.nn.functional.linear in RGB preview code.
...
Add an optional bias to the latent RGB preview code.
2024-09-29 11:27:49 -04:00
3bb4dec720
Fix issue with loras, lowvram and --fast fp8.
2024-09-28 14:42:32 -04:00
8733191563
Flux torch.compile fix ( #5082 )
2024-09-27 22:07:51 -04:00
bdd4a22a2e
Fix flux TE not loading t5 embeddings.
2024-09-24 22:57:22 -04:00
479a427a48
Add dpmpp_2m_cfg_pp ( #4992 )
2024-09-24 02:42:56 -04:00
3a0eeee320
Make --listen listen on both ipv4 and ipv6 at the same time by default.
2024-09-23 04:38:19 -04:00
9c41bc8d10
Remove useless line.
2024-09-23 02:32:29 -04:00
7a415f47a9
Add an optional VAE input to the ControlNetApplyAdvanced node.
...
Deprecate the other controlnet nodes.
2024-09-22 01:24:52 -04:00
dc96a1ae19
Load controlnet in fp8 if weights are in fp8.
2024-09-21 04:50:12 -04:00
2d810b081e
Add load_controlnet_state_dict function.
2024-09-21 01:51:51 -04:00
comfyanonymous
comfyanonymous
contentis
Aarni Koskela
PsychoLogicAu
svdc
Kadir Nar
Dr.Lt.Data
Jonathan Avila
City
chaObserv