Jaret Burkett
|
fa8fc32c0a
|
Corrected key saving and loading to better match kohya
|
2023-09-04 00:22:34 -06:00 |
|
Jaret Burkett
|
22ed539321
|
Allow special args for schedulers
|
2023-09-03 20:38:44 -06:00 |
|
Jaret Burkett
|
2a40937b4f
|
reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl
|
2023-09-03 07:56:09 -06:00 |
|
Jaret Burkett
|
836fee47a6
|
Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol
|
2023-08-29 15:20:03 -06:00 |
|
Jaret Burkett
|
14ff51ceb4
|
fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving.
|
2023-08-29 12:31:19 -06:00 |
|
Jaret Burkett
|
714854ee86
|
Hude rework to move the batch to a DTO to make it far more modular to the future ui
|
2023-08-29 10:22:19 -06:00 |
|
Jaret Burkett
|
bd758ff203
|
Cleanup and small bug fixes
|
2023-08-29 05:45:49 -06:00 |
|
Jaret Burkett
|
a008d9e63b
|
Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum
|
2023-08-28 17:56:30 -06:00 |
|
Jaret Burkett
|
e866c75638
|
Built base interfaces for a DTO to handle batch infomation transports for the dataloader
|
2023-08-28 12:43:31 -06:00 |
|
Jaret Burkett
|
c446f768ea
|
Huge memory optimizations, many big fixes
|
2023-08-27 17:48:02 -06:00 |
|
Jaret Burkett
|
9b164a8688
|
Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs
|
2023-08-27 09:40:01 -06:00 |
|
Jaret Burkett
|
6bd3851058
|
Fixed issue with prompt token replace adding more than one replacement
|
2023-08-26 18:52:23 -06:00 |
|
Jaret Burkett
|
8105c05c12
|
Added bucketting capabilities to dataloader. Finally have full planned capability. noice
|
2023-08-26 16:36:32 -06:00 |
|
Jaret Burkett
|
3367ab6b2c
|
Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling
|
2023-08-26 08:55:00 -06:00 |
|
Jaret Burkett
|
7157c316af
|
Added support for training lora, dreambooth, and fine tuning. Still need testing and docs
|
2023-08-23 15:37:00 -06:00 |
|
Jaret Burkett
|
d298240cec
|
Tied in ant tested TI script
|
2023-08-23 13:26:28 -06:00 |
|
Jaret Burkett
|
2e6c55c720
|
WIP creating textual inversion training script
|
2023-08-22 21:02:38 -06:00 |
|
Jaret Burkett
|
1a7e346b41
|
Added inbuild plugins and made one for image referenced. WIP
|
2023-08-10 16:02:44 -06:00 |
|
Jaret Burkett
|
df48f0a843
|
Moved some of the job config into base process so it will be easier to extend extensions
|
2023-08-10 12:14:05 -06:00 |
|
Jaret Burkett
|
fbc8a87a05
|
Reworked the sd rescaler script
|
2023-08-09 08:57:27 -06:00 |
|
Jaret Burkett
|
8c90fa86c6
|
Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take
|
2023-08-05 18:46:08 -06:00 |
|
Jaret Burkett
|
66c6f0f6f7
|
Big refactor of SD runner and added image generator
|
2023-08-03 14:51:25 -06:00 |
|
Jaret Burkett
|
1a25b275c8
|
Did some work on SD rescaler. Need to run a long test on it eventually.
|
2023-08-02 07:59:27 -06:00 |
|
Jaret Burkett
|
8b8d53888d
|
Added Model rescale and prepared a release upgrade
|
2023-08-01 13:49:54 -06:00 |
|
Jaret Burkett
|
c01673f1b5
|
Added random weight adjuster to prevent overfitting
|
2023-07-29 19:30:14 -06:00 |
|
Jaret Burkett
|
8ba1b11557
|
Merge branch 'sdxl' into WIP
# Conflicts:
# jobs/process/BaseSDTrainProcess.py
# jobs/process/TrainSliderProcess.py
|
2023-07-29 14:29:18 -06:00 |
|
Jaret Burkett
|
9cdf2dd6e4
|
Bug fixes
|
2023-07-29 13:39:57 -06:00 |
|
Jaret Burkett
|
1e50b39442
|
Work on slider rework
|
2023-07-28 18:11:10 -06:00 |
|
Jaret Burkett
|
5fc2bb5d9c
|
Information trainer
|
2023-07-28 08:16:29 -06:00 |
|
Jaret Burkett
|
b2e2e4bf47
|
Added sd1.5 and 2.1 do the diffusers pipeline flow
|
2023-07-27 12:34:48 -06:00 |
|
Jaret Burkett
|
596e57a6a6
|
Pipelines working on SDXL for noise prediction
|
2023-07-27 11:24:33 -06:00 |
|
Jaret Burkett
|
6ab8b8b0f1
|
WIP. just need to put it here
|
2023-07-27 01:46:30 -06:00 |
|
Jaret Burkett
|
2305e55c82
|
Moving over to a highly difussers flow for xl
|
2023-07-26 18:25:01 -06:00 |
|
Jaret Burkett
|
d3ad195b51
|
Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird
|
2023-07-26 16:19:50 -06:00 |
|
Jaret Burkett
|
40e60fa021
|
Finially found that bug. ugh
|
2023-07-25 15:28:20 -06:00 |
|
Jaret Burkett
|
cb70c03273
|
SDXL should be working, but I broke something where it is not converging.
|
2023-07-25 13:50:59 -06:00 |
|
Jaret Burkett
|
61dd818608
|
Added anchors to regulate the lora
|
2023-07-24 14:59:16 -06:00 |
|
Jaret Burkett
|
390192c6a1
|
Moved the base SD training process to a parent class so we can do some more creative stuff without copy pasta
|
2023-07-24 11:29:39 -06:00 |