eda866bf51
Extracted multigpu core code into multigpu.py, added load_balance_devices to get subdivision of work based on available devices and splittable work item count, added MultiGPU Options nodes to set relative_speed of specific devices; does not change behavior yet
2025-01-27 06:25:48 -06:00
e3298b84de
Create proper MultiGPU Initialize node, create gpu_options to create scaffolding for asymmetrical GPU support
2025-01-26 09:34:20 -06:00
c7feef9060
Cast transformer_options for multigpu
2025-01-26 05:29:27 -06:00
51af7fa1b4
Fix multigpu ControlBase get_models and cleanup calls to avoid multiple calls of functions on multigpu_clones versions of controlnets
2025-01-25 06:05:01 -06:00
46969c380a
Initial MultiGPU support for controlnets
2025-01-24 05:39:38 -06:00
5db4277449
Make sure additional_models are unloaded as well when perform
2025-01-23 19:06:05 -06:00
02a4d0ad7d
Added unload_model_and_clones to model_management.py to allow unloading only relevant models
2025-01-23 01:20:00 -06:00
ef137ac0b6
Merge branch 'multigpu_support' of https://github.com/kosinkadink/ComfyUI into multigpu_support
2025-01-20 04:34:39 -06:00
328d4f16a9
Make WeightHooks compatible with MultiGPU, clean up some code
2025-01-20 04:34:26 -06:00
bdbcb85b8d
Merge branch 'multigpu_support' of https://github.com/Kosinkadink/ComfyUI into multigpu_support
2025-01-20 00:51:42 -06:00
6c9e94bae7
Merge branch 'master' into multigpu_support
2025-01-20 00:51:37 -06:00
a00e1489d2
LatentBatch fix for video latents
2025-01-19 06:02:14 -05:00
ebf038d4fa
Use `torch.special.expm1` ( #6388 )
...
* Use `torch.special.expm1`
This function provides greater precision than `exp(x) - 1` for small values of `x`.
Found with TorchFix https://github.com/pytorch-labs/torchfix/
* Use non-alias
2025-01-19 04:54:32 -05:00
b4de04a1c1
Update frontend to v1.7.14 ( #6522 )
...
Co-authored-by: huchenlei <20929282+huchenlei@users.noreply.github.com>
2025-01-18 21:43:37 -05:00
b1a02131c9
Remove comfy.samplers self-import ( #6506 )
2025-01-18 17:49:51 -05:00
3a3910f91d
PromptServer: Return 400 for empty filename param ( #6504 )
2025-01-18 17:47:33 -05:00
507199d9a8
Uni pc sampler now works with audio and video models.
2025-01-18 05:27:58 -05:00
2f3ab40b62
Add warning when using old pytorch versions.
2025-01-17 18:47:27 -05:00
bfce723311
Initial work on multigpu_clone function, which will account for additional_models getting cloned
2025-01-17 03:31:28 -06:00
7fc3ccdcc2
Add that nvidia cosmos is supported to the README.
2025-01-16 21:17:18 -05:00
31f5458938
Merge branch 'master' into multigpu_support
2025-01-16 18:25:05 -06:00
55add50220
Bump ComfyUI version to v0.3.12
2025-01-16 18:11:57 -05:00
0aa2368e46
Fix some cosmos fp8 issues.
2025-01-16 17:45:37 -05:00
cca96a85ae
Fix cosmos VAE failing with videos longer than 121 frames.
2025-01-16 16:30:06 -05:00
619b8cde74
Bump ComfyUI version to 0.3.11
2025-01-16 14:54:48 -05:00
31831e6ef1
Code refactor.
2025-01-16 07:23:54 -05:00
88ceb28e20
Tweak hunyuan memory usage factor.
2025-01-16 06:31:03 -05:00
23289a6a5c
Clean up some debug lines.
2025-01-16 04:24:39 -05:00
9d8b6c1f46
More accurate memory estimation for cosmos and hunyuan video.
2025-01-16 03:48:40 -05:00
6320d05696
Slightly lower hunyuan video memory usage.
2025-01-16 00:23:01 -05:00
25683b5b02
Lower cosmos diffusion model memory usage.
2025-01-15 23:46:42 -05:00
4758fb64b9
Lower cosmos VAE memory usage by a bit.
2025-01-15 22:57:52 -05:00
008761166f
Optimize first attention block in cosmos VAE.
2025-01-15 21:48:46 -05:00
2145a202eb
Merge branch 'master' into multigpu_support
2025-01-15 19:58:28 -06:00
bfd5dfd611
3.13 doesn't work yet.
2025-01-15 20:32:44 -05:00
55ade36d01
Remove python 3.8 from test-build workflow.
2025-01-15 20:24:55 -05:00
2e20e399ea
Add minimum numpy version to requirements.txt
2025-01-15 20:19:56 -05:00
3baf92d120
CosmosImageToVideoLatent batch_size now does something.
2025-01-15 17:19:59 -05:00
1709a8441e
Use latest python 3.12.8 the portable release.
2025-01-15 14:50:40 -05:00
cba58fff0b
Remove unsafe embedding load for very old pytorch.
2025-01-15 04:32:23 -05:00
2feb8d0b77
Force safe loading of files in torch format on pytorch 2.4+
...
If this breaks something for you make an issue.
2025-01-15 03:50:27 -05:00
5b657f8c15
Allow setting start and end image in CosmosImageToVideoLatent.
2025-01-15 00:41:35 -05:00
2cdbaf5169
Add SetFirstSigma node ( #6459 )
...
Useful for models utilizing ztSNR. See: https://arxiv.org/abs/2409.15997
2025-01-14 19:05:45 -05:00
c78a45685d
Rewrite res_multistep sampler and implement res_multistep_cfg_pp sampler. ( #6462 )
2025-01-14 18:20:06 -05:00
25818dc848
Added a 'max_gpus' input
2025-01-14 13:45:14 -06:00
198953cd08
Add nodes_multigpu.py to loaded nodes
2025-01-14 12:24:55 -06:00
3aaabb12d4
Implement Cosmos Image/Video to World (Video) diffusion models.
...
Use CosmosImageToVideoLatent to set the input image/video.
2025-01-14 05:14:10 -05:00
ec16ee2f39
Merge branch 'master' into multigpu_support
2025-01-13 20:21:06 -06:00
d5088072fb
Make test node for multigpu instead of storing it in just a local __init__.py
2025-01-13 20:20:25 -06:00
1f1c7b7b56
Remove useless code.
2025-01-13 03:52:37 -05:00
Jedrzej Kosinski
comfyanonymous
Sergii Dymchenko
Comfy Org PR Bot
catboxanon
Pam