ai-toolkit/toolkit
Jaret Burkett 56d8d6bd81 Capture speed from the timer for the ui 2025-02-23 14:38:46 -07:00
..
data_transfer_object Fixed issue with sizes for some images being loaded sideways resulting in squished images. 2024-10-20 11:51:29 -06:00
keymaps Fixed issue with grad scaling 2024-07-20 08:21:57 -06:00
models Added beginning or lokr 2025-02-20 12:47:42 -07:00
optimizers Experimental features and bug fixes 2025-02-04 13:36:34 -07:00
orig_configs Added refiner fine tuning. Works, but needs some polish. 2023-11-05 17:15:03 -07:00
samplers Imitial lumina3 support 2025-02-08 10:59:53 -07:00
util Added adafactor implementation that handles stochastic rounding of update and accumulation 2024-10-30 05:25:57 -06:00
__init__.py Initial commit 2023-07-05 16:44:58 -06:00
accelerator.py Working multi gpu training. Still need a lot of tweaks and testing. 2025-01-25 16:46:20 -07:00
assistant_lora.py fixed huge flux training bug. Added ability to use an assistatn lora 2024-08-14 10:14:13 -06:00
basic.py Added reference adapters, many bug fixes, more ip adapter work and customizability 2024-01-01 17:15:53 -07:00
buckets.py A lot of pixart sigma training tweaks 2024-07-28 11:23:18 -06:00
civitai.py Added ability to use civit ai url ar model name and built a model downloader and cache manager for it 2023-08-13 13:09:51 -06:00
clip_vision_adapter.py Varous bug fixes 2024-07-10 15:20:04 -06:00
config.py Added specialized scaler training to ip adapters 2024-04-05 08:17:09 -06:00
config_modules.py Added more settings to the training config 2025-02-23 12:34:52 -07:00
cuda_malloc.py Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation 2023-09-12 04:30:23 -06:00
custom_adapter.py Bug fixes and improvements to llmadapter 2025-02-15 07:18:07 -07:00
data_loader.py Working multi gpu training. Still need a lot of tweaks and testing. 2025-01-25 16:46:20 -07:00
dataloader_mixins.py Working multi gpu training. Still need a lot of tweaks and testing. 2025-01-25 16:46:20 -07:00
dequantize.py Improvements for full tuning flux. Added debugging launch config for vscode 2024-10-29 04:54:08 -06:00
ema.py Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) 2024-11-20 09:16:55 -07:00
embedding.py Work on ipadapters and custom adapters 2024-05-13 06:37:54 -06:00
esrgan_utils.py Added training for a custom version of ERSGAN arcitecture. Testing training now 2023-08-07 18:04:23 -06:00
extension.py Added inbuild plugins and made one for image referenced. WIP 2023-08-10 16:02:44 -06:00
guidance.py Small fixed for DFE, polar guidance, and other things 2025-02-12 09:27:44 -07:00
image_utils.py Change img multiplier math 2024-07-30 11:33:41 -06:00
inversion_utils.py Various bug fixes, wip stuff, and tweaks 2023-11-02 18:19:20 -06:00
ip_adapter.py Fixed issue with adapters not providing gradients with new grad activator 2024-10-29 14:22:10 -06:00
job.py Moved the run job command 2023-08-13 10:25:56 -06:00
kohya_model_util.py Hotfix to handle latest transformers clip model missing key suddenly 2023-08-02 12:26:18 -06:00
layers.py Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take 2023-08-05 18:46:08 -06:00
llvae.py Bug fixes. Added some functionality to help with private extensions 2023-10-05 07:09:34 -06:00
logging.py Feat: Wandb logging (#95) 2024-09-19 20:01:01 -06:00
lora_special.py Dataset uploads working 2025-02-20 12:47:01 -07:00
lorm.py Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) 2024-11-20 09:16:55 -07:00
losses.py Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it 2023-09-16 17:41:07 -06:00
lycoris_special.py Improved lorm extraction and training 2023-10-28 08:21:59 -06:00
lycoris_utils.py Updated module names to be compatable with ney koyha unet 2023-07-31 13:16:29 -06:00
metadata.py Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs 2024-01-28 08:20:03 -07:00
network_mixins.py Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) 2024-11-20 09:16:55 -07:00
optimizer.py Initial work on a auto adjusting optimizer 2024-11-29 04:48:58 -07:00
paths.py Added refiner fine tuning. Works, but needs some polish. 2023-11-05 17:15:03 -07:00
photomaker.py Added an experimental clip fusion model that is showing promise for embedding concepts 2024-01-17 13:13:04 -07:00
photomaker_pipeline.py Initial training script for photomaker training. Needs a little more work. 2024-01-15 18:46:26 -07:00
pipelines.py Added v2 of dfp 2025-01-22 16:32:13 -07:00
print.py Working multi gpu training. Still need a lot of tweaks and testing. 2025-01-25 16:46:20 -07:00
progress_bar.py implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar 2023-09-14 08:31:54 -06:00
prompt_utils.py Added training for pixart-a 2024-02-13 16:00:04 -07:00
reference_adapter.py Some work on sd3 training. Not working 2024-06-13 12:19:16 -06:00
resampler.py Added a clip vision adapter trainer. Only works for sd15 for now 2023-12-24 13:26:04 -07:00
sampler.py merged in lumina2 branch 2025-02-12 09:33:03 -07:00
saving.py Added training for pixart-a 2024-02-13 16:00:04 -07:00
scheduler.py Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115) 2024-08-22 21:25:44 -06:00
sd_device_states_presets.py Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications 2024-12-15 08:59:27 -07:00
stable_diffusion_model.py Capture speed from the timer for the ui 2025-02-23 14:38:46 -07:00
style.py Bug fixes and little improvements here and there. 2024-06-08 06:24:20 -06:00
timer.py Capture speed from the timer for the ui 2025-02-23 14:38:46 -07:00
train_pipelines.py Information trainer 2023-07-28 08:16:29 -06:00
train_tools.py Added ability to do prompt attn masking for flux 2024-09-02 17:29:36 -06:00