Jaret Burkett
|
c2a4b8e058
|
More timestep fixes
|
2023-11-28 10:34:08 -07:00 |
|
Jaret Burkett
|
792a5e37e2
|
Numerous fixes for time sampling. Still not perfect
|
2023-11-28 07:34:43 -07:00 |
|
Jaret Burkett
|
d7e55b6ad4
|
Bug fixes, negative prompting during training, hardened catching
|
2023-11-24 07:25:11 -07:00 |
|
Jaret Burkett
|
fbec68681d
|
Added timestep modifications to lcm scheduler for more evenly spaced timesteps
|
2023-11-17 23:26:52 -07:00 |
|
Jaret Burkett
|
6280284d8b
|
Fixed cleanup of emebddings.
|
2023-11-16 20:26:11 -07:00 |
|
Jaret Burkett
|
ad50921c41
|
Sampling tests and added fixes for cleanups
|
2023-11-16 08:33:23 -07:00 |
|
Jaret Burkett
|
e47006ed70
|
Added some features for an LCM condenser plugin
|
2023-11-15 08:56:45 -07:00 |
|
Jaret Burkett
|
4f9cdd916a
|
added prompt dropout to happen indempendently on each TE
|
2023-11-14 05:26:51 -07:00 |
|
Jaret Burkett
|
7782caa468
|
Varous bug fixes. Finalized targeted guidance algo
|
2023-11-10 12:18:08 -07:00 |
|
Jaret Burkett
|
fa6d91ba76
|
Diffirential guidance working, but I may have a better way
|
2023-11-09 06:09:36 -07:00 |
|
Jaret Burkett
|
1ee62562a4
|
diffirential guidance is WORKING (from what I can tell)
|
2023-11-07 19:24:12 -07:00 |
|
Jaret Burkett
|
dc8448d958
|
Added a way pass refiner ratio to sample config
|
2023-11-06 09:22:58 -07:00 |
|
Jaret Burkett
|
a8b3b8b8da
|
Fixed weight mapping for refiner
|
2023-11-06 07:37:47 -07:00 |
|
Jaret Burkett
|
93ea955d7c
|
Added refiner fine tuning. Works, but needs some polish.
|
2023-11-05 17:15:03 -07:00 |
|
Jaret Burkett
|
8a9e8f708f
|
Added base for using guidance during training. Still not working right.
|
2023-11-05 04:03:32 -07:00 |
|
Jaret Burkett
|
d35733ac06
|
Added support for training ssd-1B. Added support for saving models into diffusers format. We can currently save in safetensors format for ssd-1b, but diffusers cannot load it yet.
|
2023-11-03 05:01:16 -06:00 |
|
Jaret Burkett
|
ceaf1d9454
|
Various bug fixes, wip stuff, and tweaks
|
2023-11-02 18:19:20 -06:00 |
|
Jaret Burkett
|
7d707b2fe6
|
Added masking to slider training. Something is still weird though
|
2023-11-01 14:51:29 -06:00 |
|
Jaret Burkett
|
a899ec91c8
|
Added some split prompting started code, adamw8bit, replacements improving, learnable snr gos. A lot of good stuff.
|
2023-11-01 06:52:21 -06:00 |
|
Jaret Burkett
|
436a09430e
|
Added flat snr gamma vs min. Fixes timestep timing
|
2023-10-29 15:41:55 -06:00 |
|
Jaret Burkett
|
3097865203
|
Fix llava import.. again
|
2023-10-29 12:52:17 -06:00 |
|
Jaret Burkett
|
b84e3260cb
|
Fix llava import
|
2023-10-29 12:50:54 -06:00 |
|
Jaret Burkett
|
48a9bac22d
|
Added doffusers schedulers
|
2023-10-29 12:39:50 -06:00 |
|
Jaret Burkett
|
298001439a
|
Added gradient accumulation finally
|
2023-10-28 13:14:29 -06:00 |
|
Jaret Burkett
|
6f3e0d5af2
|
Improved lorm extraction and training
|
2023-10-28 08:21:59 -06:00 |
|
Jaret Burkett
|
0a79ac9604
|
Added lorm. WIP
|
2023-10-26 18:23:51 -06:00 |
|
Jaret Burkett
|
9636194c09
|
Added fuyu captioning
|
2023-10-25 14:14:53 -06:00 |
|
Jaret Burkett
|
d742792ee4
|
Fixed issue with not loading short prompt
|
2023-10-24 16:19:32 -06:00 |
|
Jaret Burkett
|
002279cec3
|
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
|
2023-10-24 16:02:07 -06:00 |
|
Jaret Burkett
|
73c8b50975
|
Added ability to use adagrad from transformers
|
2023-10-24 11:16:01 -06:00 |
|
Jaret Burkett
|
34eb563d55
|
Added dataset tagging and management tools using llava
|
2023-10-24 10:11:47 -06:00 |
|
Jaret Burkett
|
dc36bbb3c8
|
Added long prompts to general training
|
2023-10-23 08:12:58 -06:00 |
|
Jaret Burkett
|
9905a1e205
|
Fixes and longer prompts
|
2023-10-22 08:57:37 -06:00 |
|
Jaret Burkett
|
0e9fc42816
|
Allow for inverted masked prior
|
2023-10-21 06:50:17 -06:00 |
|
Jaret Burkett
|
d46112a354
|
Fixes for aug pipeline
|
2023-10-20 13:24:07 -06:00 |
|
Jaret Burkett
|
07bf7bd7de
|
Allow augmentations and targeting different loss types fron the config file
|
2023-10-18 03:04:57 -06:00 |
|
Jaret Burkett
|
da6302ada8
|
added a method to apply multipliers to noise and latents prior to combining
|
2023-10-17 06:09:16 -06:00 |
|
Jaret Burkett
|
a05459afaf
|
Fixed issue with adapters that only had 1 input channel. Added ability to set the percentage chance of adapter matching
|
2023-10-15 15:13:35 -06:00 |
|
Jaret Burkett
|
b1a22d0b3e
|
hardened reading prompts from json
|
2023-10-15 07:20:33 -06:00 |
|
Jaret Burkett
|
7909b50d24
|
Added adapter assistance to SD training
|
2023-10-14 08:44:53 -06:00 |
|
Jaret Burkett
|
38e441a29c
|
allow flipping for point of interesting autocropping. allow num repeats. Fixed some bugs with new free u
|
2023-10-12 21:02:47 -06:00 |
|
Jaret Burkett
|
4e3b2c2569
|
Allow for alpha to be used as a mask
|
2023-10-10 17:08:59 -06:00 |
|
Jaret Burkett
|
239addba51
|
Fixed memory leak when cachine latents to disk
|
2023-10-10 13:31:47 -06:00 |
|
Jaret Burkett
|
63ceffae24
|
Massive speed increases and ram optimizations
|
2023-10-10 06:07:55 -06:00 |
|
Jaret Burkett
|
f4c90bb589
|
Added config to set the min value of a mask
|
2023-10-09 15:47:54 -06:00 |
|
Jaret Burkett
|
bb1d3793e3
|
Added ability to add masks to dataloader and sd trainer to adjust weight of image
|
2023-10-09 11:21:00 -06:00 |
|
Jaret Burkett
|
1d3de678aa
|
fixed bug with trigger word embedding. Allow control images to load from the dataloader or legacy way
|
2023-10-09 06:21:49 -06:00 |
|
Jaret Burkett
|
b1cfafa0c6
|
always prompt both even when training only one encoder
|
2023-10-07 11:23:09 -06:00 |
|
Jaret Burkett
|
cac8754399
|
Allow for training loras on onle one text encoder for sdxl
|
2023-10-06 08:11:56 -06:00 |
|
Jaret Burkett
|
f73402473b
|
Bug fixes. Added some functionality to help with private extensions
|
2023-10-05 07:09:34 -06:00 |