Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
Jaret Burkett
|
4ec4025cbb
|
Added adapter modules for text encoders and direct vision
|
2024-02-12 08:46:18 -07:00 |
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
Jaret Burkett
|
177c7130ec
|
improved correction of pred norm by targeting the prior
|
2024-02-01 06:31:04 -07:00 |
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|
Jaret Burkett
|
eeee4a1620
|
Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes
|
2023-12-28 12:20:27 -07:00 |
|
Jaret Burkett
|
05ae95ca89
|
Added a clip vision adapter trainer. Only works for sd15 for now
|
2023-12-24 13:26:04 -07:00 |
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
Jaret Burkett
|
39870411d8
|
More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes
|
2023-12-15 06:02:10 -07:00 |
|
Jaret Burkett
|
eaa0fb6253
|
Tons of bug fixes and improvements to special training. Fixed slider training.
|
2023-12-09 16:38:10 -07:00 |
|
Jaret Burkett
|
bd2bce9b92
|
Switched to trailing timestep spacing to make timesteps for consistant across schedulers. Honed in on targeted guidance. It is finally perfect. (I think)
|
2023-11-29 14:32:48 -07:00 |
|
Jaret Burkett
|
7624241032
|
More fixes for noise schedules and fixed targeted guidance inverted masked prior
|
2023-11-29 10:13:31 -07:00 |
|
Jaret Burkett
|
bef10a639c
|
Merge remote-tracking branch 'origin/development'
# Conflicts:
# toolkit/stable_diffusion_model.py
|
2023-11-28 10:40:05 -07:00 |
|
Jaret Burkett
|
c2a4b8e058
|
More timestep fixes
|
2023-11-28 10:34:08 -07:00 |
|
Jaret Burkett
|
792a5e37e2
|
Numerous fixes for time sampling. Still not perfect
|
2023-11-28 07:34:43 -07:00 |
|
Jaret Burkett
|
fbec68681d
|
Added timestep modifications to lcm scheduler for more evenly spaced timesteps
|
2023-11-17 23:26:52 -07:00 |
|
Jaret Burkett
|
ad50921c41
|
Sampling tests and added fixes for cleanups
|
2023-11-16 08:33:23 -07:00 |
|
Jaret Burkett
|
e47006ed70
|
Added some features for an LCM condenser plugin
|
2023-11-15 08:56:45 -07:00 |
|
Jaret Burkett
|
4f9cdd916a
|
added prompt dropout to happen indempendently on each TE
|
2023-11-14 05:26:51 -07:00 |
|
Jaret Burkett
|
1ee62562a4
|
diffirential guidance is WORKING (from what I can tell)
|
2023-11-07 19:24:12 -07:00 |
|
Jaret Burkett
|
dc8448d958
|
Added a way pass refiner ratio to sample config
|
2023-11-06 09:22:58 -07:00 |
|
Jaret Burkett
|
93ea955d7c
|
Added refiner fine tuning. Works, but needs some polish.
|
2023-11-05 17:15:03 -07:00 |
|
Jaret Burkett
|
d35733ac06
|
Added support for training ssd-1B. Added support for saving models into diffusers format. We can currently save in safetensors format for ssd-1b, but diffusers cannot load it yet.
|
2023-11-03 05:01:16 -06:00 |
|
Jaret Burkett
|
ceaf1d9454
|
Various bug fixes, wip stuff, and tweaks
|
2023-11-02 18:19:20 -06:00 |
|
Jaret Burkett
|
7d707b2fe6
|
Added masking to slider training. Something is still weird though
|
2023-11-01 14:51:29 -06:00 |
|
Jaret Burkett
|
6f3e0d5af2
|
Improved lorm extraction and training
|
2023-10-28 08:21:59 -06:00 |
|
Jaret Burkett
|
0a79ac9604
|
Added lorm. WIP
|
2023-10-26 18:23:51 -06:00 |
|
Jaret Burkett
|
9636194c09
|
Added fuyu captioning
|
2023-10-25 14:14:53 -06:00 |
|
Jaret Burkett
|
002279cec3
|
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
|
2023-10-24 16:02:07 -06:00 |
|
Jaret Burkett
|
9905a1e205
|
Fixes and longer prompts
|
2023-10-22 08:57:37 -06:00 |
|
Jaret Burkett
|
b1cfafa0c6
|
always prompt both even when training only one encoder
|
2023-10-07 11:23:09 -06:00 |
|
Jaret Burkett
|
cac8754399
|
Allow for training loras on onle one text encoder for sdxl
|
2023-10-06 08:11:56 -06:00 |
|
Jaret Burkett
|
f73402473b
|
Bug fixes. Added some functionality to help with private extensions
|
2023-10-05 07:09:34 -06:00 |
|
Jaret Burkett
|
76c764af49
|
Fixed issues with adapter and disabled telementry for now
|
2023-09-24 12:51:29 -06:00 |
|
Jaret Burkett
|
abf7cd221d
|
allow setting adapter weight in prompts
|
2023-09-24 06:51:54 -06:00 |
|
Jaret Burkett
|
830e87cb87
|
Added IP adapter training. Not functioning correctly yet
|
2023-09-24 02:39:43 -06:00 |
|
Jaret Burkett
|
61badf85a7
|
t2i training working from what I can tell at least
|
2023-09-17 15:56:43 -06:00 |
|
Jaret Burkett
|
c698837241
|
Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it
|
2023-09-16 17:41:07 -06:00 |
|
Jaret Burkett
|
27f343fc08
|
Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps.
|
2023-09-16 08:30:38 -06:00 |
|
Jaret Burkett
|
569d7464d5
|
implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar
|
2023-09-14 08:31:54 -06:00 |
|
Jaret Burkett
|
ae70200d3c
|
Bug fixes, speed improvements, compatability adjustments withdiffusers updates
|
2023-09-13 07:03:53 -06:00 |
bendeguzvaradi
|
3d387103cd
|
safety checker to None
|
2023-09-11 17:05:55 +02:00 |
|
Jaret Burkett
|
34bfeba229
|
Massive speed increase. Added latent caching both to disk and to memory
|
2023-09-10 08:54:49 -06:00 |
|
Jaret Burkett
|
cb91b0d6da
|
Changed model download from HF to fp16
|
2023-09-08 07:57:19 -06:00 |
|
Jaret Burkett
|
ce4f9fe02a
|
Bug fixes and improvements to token injection
|
2023-09-08 06:10:59 -06:00 |
|
Jaret Burkett
|
92a086d5a5
|
Fixed issue with token replacements
|
2023-09-07 13:42:39 -06:00 |
|
Jaret Burkett
|
3feb663a51
|
Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see
|
2023-09-07 13:06:18 -06:00 |
|
Jaret Burkett
|
436bf0c6a3
|
Added experimental concept replacer, replicate converter, bucket maker, and other goodies
|
2023-09-06 18:50:32 -06:00 |
|
Jaret Burkett
|
64a5441832
|
Fully tested and now supporting locon on sdxl. If you have the ram
|
2023-09-04 14:05:10 -06:00 |
|
Jaret Burkett
|
2a40937b4f
|
reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl
|
2023-09-03 07:56:09 -06:00 |
|
Jaret Burkett
|
33267e117c
|
Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant
|
2023-08-30 14:52:12 -06:00 |
|
Jaret Burkett
|
836fee47a6
|
Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol
|
2023-08-29 15:20:03 -06:00 |
|
Jaret Burkett
|
14ff51ceb4
|
fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving.
|
2023-08-29 12:31:19 -06:00 |
|
Jaret Burkett
|
b79ced3e10
|
Merge branch 'main' into development
|
2023-08-28 16:21:51 -06:00 |
|
Jaret Burkett
|
bee0b6a235
|
Added converters for all stable diffusion models to convert back to ldm format from diffusers.
|
2023-08-28 16:12:32 -06:00 |
|
Jaret Burkett
|
e866c75638
|
Built base interfaces for a DTO to handle batch infomation transports for the dataloader
|
2023-08-28 12:43:31 -06:00 |
|
Jaret Burkett
|
c446f768ea
|
Huge memory optimizations, many big fixes
|
2023-08-27 17:48:02 -06:00 |
|
Jaret Burkett
|
9b164a8688
|
Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs
|
2023-08-27 09:40:01 -06:00 |
|
Jaret Burkett
|
6bd3851058
|
Fixed issue with prompt token replace adding more than one replacement
|
2023-08-26 18:52:23 -06:00 |
|
Jaret Burkett
|
3367ab6b2c
|
Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling
|
2023-08-26 08:55:00 -06:00 |
|
Jaret Burkett
|
b408f9f3eb
|
Fixed issue with timestep I broke for sliders
|
2023-08-23 16:15:30 -06:00 |
|
Jaret Burkett
|
7157c316af
|
Added support for training lora, dreambooth, and fine tuning. Still need testing and docs
|
2023-08-23 15:37:00 -06:00 |
|
Jaret Burkett
|
d298240cec
|
Tied in ant tested TI script
|
2023-08-23 13:26:28 -06:00 |
|
Jaret Burkett
|
2e6c55c720
|
WIP creating textual inversion training script
|
2023-08-22 21:02:38 -06:00 |
|
Jaret Burkett
|
36ba08d3fa
|
Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly
|
2023-08-21 16:22:01 -06:00 |
|
Jaret Burkett
|
90eedb78bf
|
Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun
|
2023-08-19 05:54:22 -06:00 |
|
Jaret Burkett
|
d51c4ca704
|
Added ability to use two seperate folders for datasets when doing image reference sliders
|
2023-08-18 11:44:33 -06:00 |
|
Jaret Burkett
|
8d09eb44ec
|
Fixed an issue with CFG time embeds on SDXL
|
2023-08-15 18:02:14 -06:00 |
|
Jaret Burkett
|
55a5fcc7d9
|
Added method to get specific keys from model
|
2023-08-15 14:51:04 -06:00 |
|
Jaret Burkett
|
355c80df07
|
Added ability to use civit ai url ar model name and built a model downloader and cache manager for it
|
2023-08-13 13:09:51 -06:00 |
|
Jaret Burkett
|
fd95e7b60c
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2023-08-12 05:59:58 -06:00 |
|
Jaret Burkett
|
379992d89e
|
Various bug fixes and improvements
|
2023-08-12 05:59:50 -06:00 |
|
Jaret Burkett
|
c7054d714f
|
Finally muted the annoying safety checker notification
|
2023-08-12 01:38:18 -06:00 |
|
Jaret Burkett
|
8c90fa86c6
|
Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take
|
2023-08-05 18:46:08 -06:00 |
|
Jaret Burkett
|
7e4e660663
|
Added extensions and an example extension that merges models
|
2023-08-04 09:37:24 -06:00 |
|
Jaret Burkett
|
66c6f0f6f7
|
Big refactor of SD runner and added image generator
|
2023-08-03 14:51:25 -06:00 |
|
Jaret Burkett
|
c7640b0865
|
WIP diffusers pipeline is weird. Starting to hate sdxl
|
2023-07-27 17:35:24 -06:00 |
|
Jaret Burkett
|
6ab8b8b0f1
|
WIP. just need to put it here
|
2023-07-27 01:46:30 -06:00 |
|
Jaret Burkett
|
d3ad195b51
|
Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird
|
2023-07-26 16:19:50 -06:00 |
|
Jaret Burkett
|
cb70c03273
|
SDXL should be working, but I broke something where it is not converging.
|
2023-07-25 13:50:59 -06:00 |