ai-toolkit/toolkit
Jaret Burkett 8f2d001eae Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video 2026-07-24 12:36:47 -06:00
..
audio Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785) 2026-04-09 15:02:03 -06:00
data_transfer_object Added a flag to keep loading the image when latents are cached. Useful for DFE and other methods that target pixelspace losses. 2026-06-15 05:31:48 -06:00
keymaps Fixed issue with grad scaling 2024-07-20 08:21:57 -06:00
memory_management WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
models Adjust the x0 of some DFEs 2026-07-22 10:38:40 -06:00
optimizers Add min and max LR or automagic to prefent runaway edge cases. 2026-07-17 14:19:53 -06:00
orig_configs Added refiner fine tuning. Works, but needs some polish. 2023-11-05 17:15:03 -07:00
samplers fix custom_flowmatch_sampler (#783) 2026-04-13 09:42:05 -06:00
timestep_weighing Added new timestep weighing strategy 2025-06-04 01:16:02 -06:00
util Fix issue with qwen image edit models. 2026-07-17 09:14:04 -06:00
__init__.py Force HF downloads to show progress bars when output is not a TTY (#909) 2026-06-24 07:55:38 -06:00
accelerator.py Fallback unwrapping logic if fails 2025-05-21 03:10:33 -06:00
advanced_prompt_embeds.py Add support for fine-tuning Hidream O1 (#831) 2026-05-12 11:15:16 -06:00
assistant_lora.py fixed huge flux training bug. Added ability to use an assistatn lora 2024-08-14 10:14:13 -06:00
basic.py Add Mac OS support for Apple Silicon (#770) 2026-03-30 09:37:47 -06:00
buckets.py Fixed issue with new bucket scaler 2026-05-28 11:34:16 -06:00
civitai.py Added ability to use civit ai url ar model name and built a model downloader and cache manager for it 2023-08-13 13:09:51 -06:00
clip_vision_adapter.py Varous bug fixes 2024-07-10 15:20:04 -06:00
config.py Added specialized scaler training to ip adapters 2024-04-05 08:17:09 -06:00
config_modules.py Added validation loss 2026-07-19 19:33:45 -06:00
control_generator.py Add a control generation script. 2026-06-25 10:14:24 -06:00
cuda_malloc.py Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation 2023-09-12 04:30:23 -06:00
custom_adapter.py Prep for future breaking changes in newer versions of transformers library 2026-04-10 12:04:32 -06:00
data_loader.py Add ability to recover from a truncated image file in the dataset 2026-06-22 05:07:30 -06:00
dataloader_mixins.py Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video 2026-07-24 12:36:47 -06:00
dequantize.py Improvements for full tuning flux. Added debugging launch config for vscode 2024-10-29 04:54:08 -06:00
ema.py Increase ema feedback amount. Normalize the dfe 4 image embeds 2025-06-10 08:01:13 -06:00
embedding.py Work on ipadapters and custom adapters 2024-05-13 06:37:54 -06:00
esrgan_utils.py Added training for a custom version of ERSGAN arcitecture. Testing training now 2023-08-07 18:04:23 -06:00
extension.py Added support for finetuning OmniGen2. 2025-06-25 13:58:16 -06:00
guidance.py Add model hooks to polarity loss 2025-04-17 09:00:10 -06:00
ideogram_caption.py Add a fallback bbox adjustment when json parsing fails on ideogram4 captioner 2026-06-19 07:25:54 -06:00
image_utils.py Adjust dataloader tester to handle videos to test them 2025-10-21 14:47:23 -06:00
inversion_utils.py Various bug fixes, wip stuff, and tweaks 2023-11-02 18:19:20 -06:00
ip_adapter.py Prep for future breaking changes in newer versions of transformers library 2026-04-10 12:04:32 -06:00
job.py Moved the run job command 2023-08-13 10:25:56 -06:00
kohya_lora.py Restore device runtime scales for compiled adapters (#963) 2026-07-18 08:19:57 -06:00
kohya_model_util.py Hotfix to handle latest transformers clip model missing key suddenly 2023-08-02 12:26:18 -06:00
layers.py Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take 2023-08-05 18:46:08 -06:00
llvae.py Bug fixes. Added some functionality to help with private extensions 2023-10-05 07:09:34 -06:00
logging_aitk.py Remove future steps from loss log if resuming from an earlier step 2026-05-18 09:23:55 -06:00
lora_special.py Restore device runtime scales for compiled adapters (#963) 2026-07-18 08:19:57 -06:00
lorm.py Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) 2024-11-20 09:16:55 -07:00
losses.py Small updates and bug fixes for various things 2025-06-03 20:08:35 -06:00
lycoris_special.py Restore device runtime scales for compiled adapters (#963) 2026-07-18 08:19:57 -06:00
lycoris_utils.py Updated module names to be compatable with ney koyha unet 2023-07-31 13:16:29 -06:00
metadata.py Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs 2024-01-28 08:20:03 -07:00
network_mixins.py Restore device runtime scales for compiled adapters (#963) 2026-07-18 08:19:57 -06:00
optimizer.py Added Automagic v3 2026-06-07 12:06:42 -06:00
paths.py Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders. 2026-05-20 08:56:16 -06:00
photomaker.py Added an experimental clip fusion model that is showing promise for embedding concepts 2024-01-17 13:13:04 -07:00
photomaker_pipeline.py Initial training script for photomaker training. Needs a little more work. 2024-01-15 18:46:26 -07:00
pipelines.py Change inpainting mask to zero out on latents instead of image for inpaint area. 2025-03-24 14:16:52 -06:00
pixel_shuffle_encoder.py Pixel shuffle adapter. Some bug fixes thrown in 2025-03-29 21:15:01 -06:00
print.py Remove print buffer. Add new line after sampling. 2026-07-16 11:37:23 -06:00
progress_bar.py implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar 2023-09-14 08:31:54 -06:00
prompt_utils.py feat: Add Anima support (#860) 2026-07-15 11:59:01 -06:00
reference_adapter.py Prep for future breaking changes in newer versions of transformers library 2026-04-10 12:04:32 -06:00
resampler.py Added a clip vision adapter trainer. Only works for sd15 for now 2023-12-24 13:26:04 -07:00
sampler.py WIP on mean flow loss. Still a WIP. 2025-06-12 08:00:51 -06:00
saving.py Added training for pixart-a 2024-02-13 16:00:04 -07:00
scheduler.py Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115) 2024-08-22 21:25:44 -06:00
sd_device_states_presets.py Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications 2024-12-15 08:59:27 -07:00
stable_diffusion_model.py Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
style.py Bug fixes and little improvements here and there. 2024-06-08 06:24:20 -06:00
timer.py Show the console log on the job overview in the ui. 2025-03-21 11:45:36 -06:00
train_pipelines.py Information trainer 2023-07-28 08:16:29 -06:00
train_tools.py Added initial support for f-lite model 2025-05-01 11:15:18 -06:00
unloader.py Fix text encoder offload bug when caching embeddings (#868) 2026-06-07 14:09:32 -06:00