Jaret Burkett
|
6e92922c14
|
Add a mergable linear to the mid of ilora
|
2024-07-20 21:17:53 -06:00 |
|
Jaret Burkett
|
c51235c486
|
Fixed misnamed var
|
2024-07-20 23:00:20 +00:00 |
|
Jaret Burkett
|
c2c4e8cf34
|
Added ability to target parts of lora for ilora
|
2024-07-20 22:45:52 +00:00 |
|
Jaret Burkett
|
4c249cf607
|
Added ilora2
|
2024-07-20 16:40:57 -06:00 |
|
Jaret Burkett
|
c2d5f712a3
|
Reworked ilora arch
|
2024-07-20 15:35:59 -06:00 |
|
Jaret Burkett
|
22d2f6e28f
|
Fixed issue with grad scaling
|
2024-07-20 08:21:57 -06:00 |
|
Jaret Burkett
|
a2301cf28c
|
Amall bug fixes
|
2024-07-18 10:39:55 -06:00 |
|
Jaret Burkett
|
11e426fdf1
|
Various features and fixes. Too much brain fog to do a proper description
|
2024-07-18 07:34:14 -06:00 |
|
Jaret Burkett
|
58dffd43a8
|
Added caching to image sizes so we dont do it every time.
|
2024-07-15 19:07:41 -06:00 |
|
Jaret Burkett
|
e4558dff4b
|
Partial implementation for training auraflow.
|
2024-07-12 12:11:38 -06:00 |
|
Jaret Burkett
|
c062b7716c
|
Varous bug fixes
|
2024-07-10 15:20:04 -06:00 |
|
Jaret Burkett
|
93e5df1d59
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2024-07-07 07:56:56 -06:00 |
|
Jaret Burkett
|
045e4a6e15
|
Save entire pixart model again
|
2024-07-07 07:56:48 -06:00 |
|
Jaret Burkett
|
76f225a467
|
Fixed issue with TE adapter caption projection
|
2024-07-06 19:09:58 +00:00 |
|
Jaret Burkett
|
cab8a1c7b8
|
WIP to add the caption_proj weight to pixart sigma TE adapter
|
2024-07-06 13:00:21 -06:00 |
|
Jaret Burkett
|
acb06d6ff3
|
Bug fixes
|
2024-07-03 10:56:34 -06:00 |
|
Jaret Burkett
|
bb57623a35
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2024-06-29 15:53:40 -06:00 |
|
Jaret Burkett
|
3072d20f17
|
Add ability to include conv_in and conv_out to full train when doing a lora
|
2024-06-29 14:54:50 -06:00 |
|
Jaret Burkett
|
f6b21f47bb
|
Increased the number of heads for ip adapters.
|
2024-06-28 16:09:52 +00:00 |
|
Jaret Burkett
|
603ceca3ca
|
added ema
|
2024-06-28 10:03:26 -06:00 |
|
Jaret Burkett
|
657fd09f25
|
Added more control over Sigma sizes
|
2024-06-26 08:57:53 -06:00 |
|
Jaret Burkett
|
8407c4deea
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2024-06-23 14:47:43 -06:00 |
|
Jaret Burkett
|
64f2b085b7
|
Minor fixes
|
2024-06-23 14:47:40 -06:00 |
|
Jaret Burkett
|
7165f2d25a
|
Work to omprove pixart training
|
2024-06-23 20:46:48 +00:00 |
|
Jaret Burkett
|
5d47244c57
|
Added support for pixart sigma loras
|
2024-06-16 11:56:30 -06:00 |
|
Jaret Burkett
|
ada722c9e4
|
Fixed issue with heads not being added
|
2024-06-15 08:34:33 -06:00 |
|
Jaret Burkett
|
696f73c30d
|
Removed variant
|
2024-06-14 17:09:47 -06:00 |
|
Jaret Burkett
|
e3410413b9
|
Rework head on ilora
|
2024-06-14 16:21:26 -06:00 |
|
Jaret Burkett
|
37cebd9458
|
WIP Ilora
|
2024-06-14 09:31:01 -06:00 |
|
Jaret Burkett
|
bd10d2d668
|
Some work on sd3 training. Not working
|
2024-06-13 12:19:16 -06:00 |
|
Jaret Burkett
|
cb5d28cba9
|
Added working ilora trainer
|
2024-06-12 09:33:45 -06:00 |
|
Jaret Burkett
|
3f3636b788
|
Bug fixes and little improvements here and there.
|
2024-06-08 06:24:20 -06:00 |
|
Jaret Burkett
|
833c833f28
|
WIP on SAFE encoder. Work on fp16 training improvements. Various other tweaks and improvements
|
2024-05-27 10:50:24 -06:00 |
|
Jaret Burkett
|
68b7e159bc
|
Bug Fixes
|
2024-05-17 08:41:20 -06:00 |
|
Jaret Burkett
|
5a45c709cd
|
Work on ipadapters and custom adapters
|
2024-05-13 06:37:54 -06:00 |
|
Jaret Burkett
|
10e1ecf1e8
|
Added single value adapter training
|
2024-04-28 06:04:47 -06:00 |
|
Jaret Burkett
|
b96913d73c
|
Improvements to dataloader
|
2024-04-27 09:28:28 -06:00 |
|
Jaret Burkett
|
5da3613e0b
|
Bug fixes and minor features
|
2024-04-25 06:14:31 -06:00 |
|
Jaret Burkett
|
5a70b7f38d
|
Added pixart sigma support, but it wont work until i address breaking changes with lora code in diffusers so it can be upgraded.
|
2024-04-20 10:46:56 -06:00 |
|
Jaret Burkett
|
377b81ee3e
|
Adjustments to guidance
|
2024-04-19 15:00:35 -06:00 |
|
Jaret Burkett
|
2d0a1be59d
|
Bug fixes
|
2024-04-16 03:48:13 -06:00 |
|
Jaret Burkett
|
7284aab7c0
|
Added specialized scaler training to ip adapters
|
2024-04-05 08:17:09 -06:00 |
|
Jaret Burkett
|
427847ac4c
|
Small tweaks and fixes for specialized ip adapter training
|
2024-03-26 11:35:26 -06:00 |
|
Jaret Burkett
|
9c1cc9641e
|
Added keep tokens to keep so many tokens in a prompt when dropping
|
2024-03-18 13:18:25 -06:00 |
|
Jaret Burkett
|
016687bda1
|
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
|
2024-03-17 10:21:47 -06:00 |
|
Jaret Burkett
|
72de68d8aa
|
WIP on clip vision encoder
|
2024-03-13 07:24:08 -06:00 |
|
Jaret Burkett
|
d87b49882c
|
Work on embedding adapters
|
2024-03-11 15:18:42 -06:00 |
|
Jaret Burkett
|
b01e8d889a
|
Added stochastic rounding to adafactor. ILora adjustments
|
2024-03-05 07:07:09 -07:00 |
|
Jaret Burkett
|
1325613583
|
rework ilora
|
2024-02-29 07:55:52 -07:00 |
|
Jaret Burkett
|
337945de9a
|
Added this not that guidance. Added ability to replace prompts.
|
2024-02-28 20:10:14 -07:00 |
|
Jaret Burkett
|
561914d8e6
|
Removed old code for fixing multistep sampler that is no longer needed
|
2024-02-25 11:53:35 -07:00 |
|
Jaret Burkett
|
b0a0f28191
|
Bug fixes
|
2024-02-25 08:28:29 -07:00 |
|
Jaret Burkett
|
f965a1299f
|
Fixed Dora implementation. Still highly experimental
|
2024-02-24 10:26:01 -07:00 |
|
Jaret Burkett
|
1bd94f0f01
|
Added early DoRA support, but will change shortly. Dont use right now.
|
2024-02-23 05:55:41 -07:00 |
|
Jaret Burkett
|
b68c3ef734
|
Added te aug adapter
|
2024-02-21 21:30:26 -07:00 |
|
Jaret Burkett
|
49c41e6a5f
|
Bug fixes. allow for random negative prompts
|
2024-02-21 04:51:52 -07:00 |
|
Jaret Burkett
|
2478554c95
|
Bug fixes. Added IP adapter training for Pixart
|
2024-02-17 10:06:57 -07:00 |
|
Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
Jaret Burkett
|
4ec4025cbb
|
Added adapter modules for text encoders and direct vision
|
2024-02-12 08:46:18 -07:00 |
|
Jaret Burkett
|
e074058faa
|
Work on additional image embedding methods. Finalized zipper resampler. It works amazing
|
2024-02-10 09:00:05 -07:00 |
|
Jaret Burkett
|
a8481c1670
|
randomly adjust scale of unconditional noise on ip adapters if training with cfg
|
2024-02-06 03:44:54 -07:00 |
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
Jaret Burkett
|
177c7130ec
|
improved correction of pred norm by targeting the prior
|
2024-02-01 06:31:04 -07:00 |
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
Jaret Burkett
|
92b9c71d44
|
Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs
|
2024-01-28 08:20:03 -07:00 |
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
Jaret Burkett
|
86c70a2a1f
|
Added an experimental clip fusion model that is showing promise for embedding concepts
|
2024-01-17 13:13:04 -07:00 |
|
Jaret Burkett
|
655533d4c7
|
More work on custom adapter
|
2024-01-16 17:41:26 -07:00 |
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
e190fbaeb8
|
Prepwork for ilora
|
2024-01-12 06:41:15 -07:00 |
|
Jaret Burkett
|
290393f7ae
|
Imporvements to ip weight adaptation. Bug fixes. Added masking to direct guidance loss. Allow importing a file for random triggers. Handle bas meta images with improper sizing.
|
2024-01-11 12:22:16 -07:00 |
|
Jaret Burkett
|
b2a54c8f36
|
Added siglip support
|
2024-01-09 20:52:21 -07:00 |
|
Jaret Burkett
|
b767d29b3c
|
Adjustments to the clip preprocessor. Allow merging in new weights for ip adapters so you can change the arcitecture while maintaining as much data as possible
|
2024-01-06 11:56:53 -07:00 |
|
Jaret Burkett
|
645b27f97a
|
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
|
2024-01-04 12:59:38 -07:00 |
|
Jaret Burkett
|
65c08b09c3
|
Added ability to do cfg during training. Various bug fixes
|
2024-01-02 11:29:57 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|
Jaret Burkett
|
0892dec4a5
|
Fixed some new bugs i added. woops
|
2023-12-28 14:03:42 -07:00 |
|
Jaret Burkett
|
eeee4a1620
|
Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes
|
2023-12-28 12:20:27 -07:00 |
|
Jaret Burkett
|
d11ed7f66c
|
Big fixes and added method to standardize values in both latent and pixel space before feeding into the network. Target values were determined over huge generated regularization sets.
|
2023-12-26 06:19:48 -07:00 |
|
Jaret Burkett
|
27ad79053e
|
Added SDXL support for clip vision embedder trainer
|
2023-12-24 14:31:29 -07:00 |
|
Jaret Burkett
|
05ae95ca89
|
Added a clip vision adapter trainer. Only works for sd15 for now
|
2023-12-24 13:26:04 -07:00 |
|
Jaret Burkett
|
0f8daa5612
|
Bug fixes, work on maing IP adapters more customizable.
|
2023-12-24 08:32:39 -07:00 |
|
Jaret Burkett
|
7703e3a15e
|
Fixes for sdxl ip adapter training. Bug fixes
|
2023-12-21 11:15:58 -07:00 |
|
Jaret Burkett
|
0f597f453e
|
Switched ip adapter dataloader to clip_image paths so the control paths can be used for training assistant adapters while training ip adapters
|
2023-12-20 10:32:24 -07:00 |
|
Jaret Burkett
|
dfb64b5957
|
Allow ip adapters to be much more variable in their creation
|
2023-12-20 06:18:33 -07:00 |
|
Jaret Burkett
|
82098e5d6e
|
Added more functionality for ip adapters
|
2023-12-19 09:54:56 -07:00 |
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
Jaret Burkett
|
13d32423f6
|
Added a polarity balancer to guidance
|
2023-12-15 15:19:14 -07:00 |
|
Jaret Burkett
|
39870411d8
|
More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes
|
2023-12-15 06:02:10 -07:00 |
|
Jaret Burkett
|
e5177833b2
|
Targeted guidance work
|
2023-12-09 19:06:18 -07:00 |
|
Jaret Burkett
|
eaa0fb6253
|
Tons of bug fixes and improvements to special training. Fixed slider training.
|
2023-12-09 16:38:10 -07:00 |
|
Jaret Burkett
|
eaec2f5a52
|
Added guidance mentiods. WIP
|
2023-12-08 08:39:21 -07:00 |
|
Jaret Burkett
|
bd2bce9b92
|
Switched to trailing timestep spacing to make timesteps for consistant across schedulers. Honed in on targeted guidance. It is finally perfect. (I think)
|
2023-11-29 14:32:48 -07:00 |
|
Jaret Burkett
|
7624241032
|
More fixes for noise schedules and fixed targeted guidance inverted masked prior
|
2023-11-29 10:13:31 -07:00 |
|
Jaret Burkett
|
bef10a639c
|
Merge remote-tracking branch 'origin/development'
# Conflicts:
# toolkit/stable_diffusion_model.py
|
2023-11-28 10:40:05 -07:00 |
|
Jaret Burkett
|
c2a4b8e058
|
More timestep fixes
|
2023-11-28 10:34:08 -07:00 |
|
Jaret Burkett
|
792a5e37e2
|
Numerous fixes for time sampling. Still not perfect
|
2023-11-28 07:34:43 -07:00 |
|
Jaret Burkett
|
d7e55b6ad4
|
Bug fixes, negative prompting during training, hardened catching
|
2023-11-24 07:25:11 -07:00 |