Jaret Burkett
|
408c50ead1
|
actually got gradient checkpointing working, again, again, maybe
|
2023-09-09 11:27:42 -06:00 |
|
Jaret Burkett
|
b01ab5d375
|
FINALLY fixed gradient checkpointing issue. Big batches baby.
|
2023-09-08 15:21:46 -06:00 |
|
Jaret Burkett
|
ce4f9fe02a
|
Bug fixes and improvements to token injection
|
2023-09-08 06:10:59 -06:00 |
|
Jaret Burkett
|
3feb663a51
|
Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see
|
2023-09-07 13:06:18 -06:00 |
|
Jaret Burkett
|
436bf0c6a3
|
Added experimental concept replacer, replicate converter, bucket maker, and other goodies
|
2023-09-06 18:50:32 -06:00 |
|
Jaret Burkett
|
a4c3507a62
|
Added LoCON from LyCORIS
|
2023-09-04 08:48:07 -06:00 |
|
Jaret Burkett
|
7cd6945082
|
Added my annotator/preprocessor and improved network jitter on reference trainer
|
2023-09-03 16:43:51 -06:00 |
|
Jaret Burkett
|
33267e117c
|
Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant
|
2023-08-30 14:52:12 -06:00 |
|
Jaret Burkett
|
714854ee86
|
Hude rework to move the batch to a DTO to make it far more modular to the future ui
|
2023-08-29 10:22:19 -06:00 |
|
Jaret Burkett
|
a008d9e63b
|
Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum
|
2023-08-28 17:56:30 -06:00 |
|
Jaret Burkett
|
c446f768ea
|
Huge memory optimizations, many big fixes
|
2023-08-27 17:48:02 -06:00 |
|
Jaret Burkett
|
3367ab6b2c
|
Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling
|
2023-08-26 08:55:00 -06:00 |
|
Jaret Burkett
|
7157c316af
|
Added support for training lora, dreambooth, and fine tuning. Still need testing and docs
|
2023-08-23 15:37:00 -06:00 |
|
Jaret Burkett
|
e2c547f6c2
|
Fixed typo
|
2023-08-23 13:33:48 -06:00 |
|
Jaret Burkett
|
f200cf36c5
|
Added train example to ti
|
2023-08-23 13:30:29 -06:00 |
|
Jaret Burkett
|
d298240cec
|
Tied in ant tested TI script
|
2023-08-23 13:26:28 -06:00 |
|
Jaret Burkett
|
2e6c55c720
|
WIP creating textual inversion training script
|
2023-08-22 21:02:38 -06:00 |
|
Jaret Burkett
|
36ba08d3fa
|
Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly
|
2023-08-21 16:22:01 -06:00 |
|
Jaret Burkett
|
bef5551ea5
|
Ultimate slider training built, still needs tuning
|
2023-08-19 18:54:34 -06:00 |
|
Jaret Burkett
|
b77b9acc0b
|
Added base for ultimate slider. WIP
|
2023-08-19 15:35:24 -06:00 |
|
Jaret Burkett
|
90eedb78bf
|
Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun
|
2023-08-19 05:54:22 -06:00 |
|
Jaret Burkett
|
d51c4ca704
|
Added ability to use two seperate folders for datasets when doing image reference sliders
|
2023-08-18 11:44:33 -06:00 |
|
Jaret Burkett
|
196b693cf0
|
Worked on reference slider script. It is working well currently. Still going to tune it a bit before a writeup though
|
2023-08-12 17:59:24 -06:00 |
|
Jaret Burkett
|
379992d89e
|
Various bug fixes and improvements
|
2023-08-12 05:59:50 -06:00 |
|
Jaret Burkett
|
67dfd9ced0
|
Added inbuild plugins and made one for image referenced. WIP
|
2023-08-10 16:20:38 -06:00 |
|
Jaret Burkett
|
1a7e346b41
|
Added inbuild plugins and made one for image referenced. WIP
|
2023-08-10 16:02:44 -06:00 |