Jaret Burkett
|
5906a76666
|
Fixed issue with flux kontext forcing generation image sizes
|
2025-06-29 05:38:20 -06:00 |
|
Jaret Burkett
|
57a81bc0db
|
Update base model version for kontext meta
|
2025-06-28 14:48:36 -06:00 |
|
Jaret Burkett
|
01a3c8a9b1
|
Fix device issue
|
2025-06-26 19:14:25 -06:00 |
|
Jaret Burkett
|
4f91cb7148
|
Fix issue with gradient checkpointing and flux kontext
|
2025-06-26 19:03:12 -06:00 |
|
Jaret Burkett
|
446b0b6989
|
Remove revision for kontext
|
2025-06-26 16:46:58 -06:00 |
|
Jaret Burkett
|
60ef2f1df7
|
Added support for FLUX.1-Kontext-dev
|
2025-06-26 15:24:37 -06:00 |
|
Jaret Burkett
|
8d9c47316a
|
Work on mean flow. Minor bug fixes. Omnigen improvements
|
2025-06-26 13:46:20 -06:00 |
|
Jaret Burkett
|
84c6edca7e
|
Merge branch 'main' into dev
|
2025-06-25 14:10:25 -06:00 |
|
Jaret Burkett
|
19ea8ecc38
|
Added support for finetuning OmniGen2.
|
2025-06-25 13:58:16 -06:00 |
|
Jaret Burkett
|
18513ec866
|
Merged in from main
|
2025-06-24 10:56:54 -06:00 |
|
Jaret Burkett
|
f3eb1dff42
|
Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss
|
2025-06-24 08:51:29 -06:00 |
|
Jaret Burkett
|
ba1274d99e
|
Added a guidance burning loss. Modified DFE to work with new model. Bug fixes
|
2025-06-23 08:38:27 -06:00 |
|
Jaret Burkett
|
8602470952
|
Updated diffusion feature extractor
|
2025-06-19 15:36:10 -06:00 |
|
Jaret Burkett
|
1cc663a664
|
Performance optimizations for pre processing the batch
|
2025-06-17 07:37:41 -06:00 |
|
Jaret Burkett
|
1c2b7298dd
|
More work on mean flow loss. Moved it to an adapter. Still not functioning properly though.
|
2025-06-16 07:17:35 -06:00 |
|
Jaret Burkett
|
c0314ba325
|
Fixed some issues with training mean flow algo. Still testing WIP
|
2025-06-16 07:14:59 -06:00 |
|
Jaret Burkett
|
cbf04b8d53
|
Fixed some issues with training mean flow algo. Still testing WIP
|
2025-06-14 12:24:00 -06:00 |
|
Jaret Burkett
|
fc83eb7691
|
WIP on mean flow loss. Still a WIP.
|
2025-06-12 08:00:51 -06:00 |
|
Jaret Burkett
|
eefa93f16e
|
Various code to support experiments.
|
2025-06-09 11:19:21 -06:00 |
|
Jaret Burkett
|
22cdfadab6
|
Added new timestep weighing strategy
|
2025-06-04 01:16:02 -06:00 |
|
Jaret Burkett
|
adc31ec77d
|
Small updates and bug fixes for various things
|
2025-06-03 20:08:35 -06:00 |
|
Jaret Burkett
|
ffaf2f154a
|
Fix issue with the way chroma handled gradient checkpointing.
|
2025-05-28 08:41:47 -06:00 |
|
Jaret Burkett
|
79bb9be92b
|
Fix issue with saving chroma full finetune.
|
2025-05-28 07:42:30 -06:00 |
|
Jaret Burkett
|
79499fa795
|
Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed.
|
2025-05-21 07:02:50 -06:00 |
|
Jaret Burkett
|
e5181d23cd
|
Added some experimental training techniques. Ignore for now. Still in testing.
|
2025-05-21 02:19:54 -06:00 |
|
Jaret Burkett
|
6174ba474e
|
Fixed issue with chroma sampling
|
2025-05-10 18:30:23 +00:00 |
|
Jaret Burkett
|
43cb5603ad
|
Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models
|
2025-05-07 12:06:30 -06:00 |
|
Jaret Burkett
|
d9700bdb99
|
Added initial support for f-lite model
|
2025-05-01 11:15:18 -06:00 |
|
Jaret Burkett
|
5890e67a46
|
Various bug fixes
|
2025-04-29 09:30:33 -06:00 |
|
Jaret Burkett
|
add83df5cc
|
Fixed issue with training hidream when batch size is larger than 1
|
2025-04-21 17:26:29 +00:00 |
|
Jaret Burkett
|
77001ee77f
|
Upodate model tag on loras
|
2025-04-19 10:41:27 -06:00 |
|
Jaret Burkett
|
0f99fce004
|
Adjust hidream lora names to work with comfy
|
2025-04-16 09:24:23 -06:00 |
|
Jaret Burkett
|
524bd2edfc
|
Make flash attn optional. Handle larger batch sizes.
|
2025-04-14 14:34:46 +00:00 |
|
Jaret Burkett
|
3a5ea2c742
|
Remove some moe stuff for finetuning. Drastically reduces vram usage
|
2025-04-14 00:57:34 +00:00 |
|
Jaret Burkett
|
f80cf99f40
|
Hidream is training, but has a memory leak
|
2025-04-13 23:28:18 +00:00 |
|
Jaret Burkett
|
594e166ca3
|
Initial support for hidream. Still a WIP
|
2025-04-13 13:50:11 -06:00 |
|
Jaret Burkett
|
6fb44db6a0
|
Finished up first frame for i2v adapter
|
2025-04-12 17:13:04 -06:00 |
|
Jaret Burkett
|
cd37ccfc2e
|
Use gradient checkpointing on DFE models if set
|
2025-04-11 10:45:39 -06:00 |
|
Jaret Burkett
|
059155174a
|
Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter
|
2025-04-10 11:50:01 -06:00 |
|
Jaret Burkett
|
a8680c75eb
|
Added initial support for finetuning wan i2v WIP
|
2025-04-07 20:34:38 -06:00 |
|
Jaret Burkett
|
7c21eac1b3
|
Added support for Lodestone Rock's Chroma model
|
2025-04-05 13:21:36 -06:00 |
|
Jaret Burkett
|
2b901cca39
|
Small tweaks and bug fixes and future proofing
|
2025-04-05 12:39:45 -06:00 |
|
Jaret Burkett
|
ac1ee559c5
|
Added bluring to mask for flex2
|
2025-04-02 07:55:51 -06:00 |
|
Jaret Burkett
|
a42c5a1de5
|
Adjust buckets for flex2
|
2025-04-02 06:47:41 -06:00 |
|
Jaret Burkett
|
c083a0e5ea
|
Allow DFE to not have a VAE
|
2025-03-30 09:23:01 -06:00 |
|
Jaret Burkett
|
5365200da1
|
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
|
2025-03-27 16:07:00 -06:00 |
|
Jaret Burkett
|
ce4c5291a0
|
Added experimental wavelet loss
|
2025-03-26 18:11:23 -06:00 |
|
Jaret Burkett
|
45be82d5d6
|
Handle inpainting training for control_lora adapter
|
2025-03-24 13:17:47 -06:00 |
|
Jaret Burkett
|
f10937e6da
|
Handle multi control inputs for control lora training
|
2025-03-23 07:37:08 -06:00 |
|
Jaret Burkett
|
9a902c067f
|
Show the console log on the job overview in the ui.
|
2025-03-21 11:45:36 -06:00 |
|
Jaret Burkett
|
3a6b24f4c8
|
Added a way to secure the UI. Plus various bug fixes and quality of life updates
|
2025-03-20 08:07:09 -06:00 |
|
Jaret Burkett
|
3812957bc9
|
Added ability to train control loras. Other important bug fixes thrown in
|
2025-03-14 18:03:00 -06:00 |
|
Jaret Burkett
|
242c04a0b8
|
Fix error with training video models with batch greater than 1
|
2025-03-08 18:47:27 -07:00 |
|
Jaret Burkett
|
6f6fb90812
|
Added cogview4. Loss still needs work.
|
2025-03-04 18:43:52 -07:00 |
|
Jaret Burkett
|
60539c0b0f
|
Allow using prior loss with a custom adapter
|
2025-03-01 08:01:14 -07:00 |
|
Jaret Burkett
|
d360e76661
|
fixed issue with dop prompt replacement
|
2025-02-26 13:35:18 -07:00 |
|
Jaret Burkett
|
6ec23ed226
|
Fixed issue when doing inverted masked prior with flowmatching algos
|
2025-02-26 12:12:32 -07:00 |
|
Jaret Burkett
|
f6e16e582a
|
Added Differential Output Preservation Loss to trainer and ui
|
2025-02-25 20:12:36 -07:00 |
|
Jaret Burkett
|
440ba5fb3d
|
Spawn windows in an cmd terminal. Should be working now, but not sure on my system
|
2025-02-24 08:54:56 -07:00 |
|
Jaret Burkett
|
56d8d6bd81
|
Capture speed from the timer for the ui
|
2025-02-23 14:38:46 -07:00 |
|
Jaret Burkett
|
3e49337a58
|
Set step to the last step saved at when exiting
|
2025-02-23 13:21:22 -07:00 |
|
Jaret Burkett
|
60f848a877
|
Send more data when loading the model to the ui
|
2025-02-23 12:49:54 -07:00 |
|
Jaret Burkett
|
ad87f72384
|
Start, stop, monitor jobs from ui working.
|
2025-02-21 09:49:28 -07:00 |
|
Jaret Burkett
|
adcf884c0f
|
Built out the ui trainer plugin with db comminication
|
2025-02-21 05:53:35 -07:00 |
|
Jaret Burkett
|
7679105d52
|
Added llm text encoder adapter
|
2025-02-13 08:28:32 -07:00 |
|
Jaret Burkett
|
0b8a32def7
|
merged in lumina2 branch
|
2025-02-12 09:33:03 -07:00 |
|
Jaret Burkett
|
787bb37e76
|
Small fixed for DFE, polar guidance, and other things
|
2025-02-12 09:27:44 -07:00 |
|
Jaret Burkett
|
d138f07365
|
Imitial lumina3 support
|
2025-02-08 10:59:53 -07:00 |
|
Jaret Burkett
|
ff3d54bb5b
|
Make the mean of the mask multiplier be 1.0 for a more balanced loss.
|
2025-02-06 10:57:06 +00:00 |
|
Jaret Burkett
|
15a57bc89f
|
Add new version of DFE. Kitchen sink
|
2025-01-31 11:42:27 -07:00 |
|
Jaret Burkett
|
5e663746b8
|
Working multi gpu training. Still need a lot of tweaks and testing.
|
2025-01-25 16:46:20 -07:00 |
|
Jaret Burkett
|
bbfba0c188
|
Added v2 of dfp
|
2025-01-22 16:32:13 -07:00 |
|
Jaret Burkett
|
04abe57c76
|
Added weighing to DFE
|
2025-01-22 08:50:57 -07:00 |
|
Jaret Burkett
|
29122b1a54
|
Added code to handle diffusion feature extraction loss
|
2025-01-21 14:21:34 -07:00 |
|
Jaret Burkett
|
8ef07a9c36
|
Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications
|
2024-12-15 08:59:27 -07:00 |
|
Jaret Burkett
|
473d455f44
|
Process empty clip image if there is not one for reg images when training a custom adapter
|
2024-10-15 08:28:04 -06:00 |
|
Jaret Burkett
|
ab22674980
|
Allow for a default caption file in the folder. Minor bug fixes.
|
2024-10-10 07:31:33 -06:00 |
|
Jaret Burkett
|
2776221497
|
Added option to cache empty prompt or trigger and unload text encoders while training
|
2024-09-21 20:54:09 -06:00 |
Plat
|
79b4e04b80
|
Feat: Wandb logging (#95)
* wandb logging
* fix: start logging before train loop
* chore: add wandb dir to gitignore
* fix: wrap wandb functions
* fix: forget to send last samples
* chore: use valid type
* chore: use None when not type-checking
* chore: resolved complicated logic
* fix: follow log_every
---------
Co-authored-by: Plat <github@p1at.dev>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
|
2024-09-19 20:01:01 -06:00 |
|
Jaret Burkett
|
3a1f464132
|
Added support for training vision direct weight adapters
|
2024-09-05 10:11:44 -06:00 |
|
Jaret Burkett
|
5c8fcc8a4e
|
Fix bug with zeroing out gradients when accumulating
|
2024-09-03 08:29:15 -06:00 |
|
Jaret Burkett
|
121a760c19
|
Added proper grad accumulation
|
2024-09-03 07:24:18 -06:00 |
|
Jaret Burkett
|
d44d4eb61a
|
Added a new experimental linear weighing technique
|
2024-09-02 09:22:13 -06:00 |
|
Jaret Burkett
|
60232def91
|
Made peleminary arch for flux ip adapter training
|
2024-08-28 08:55:39 -06:00 |
|
Jaret Burkett
|
3843e0d148
|
Added support for vision direct adapter for flux
|
2024-08-26 16:27:28 -06:00 |
|
Jaret Burkett
|
e07a98a50c
|
Bugfixes for full finetuning at bf16
|
2024-08-22 05:15:33 -06:00 |
|
Jaret Burkett
|
165510ace2
|
Dumb typo
|
2024-08-15 12:59:32 -06:00 |
|
Jaret Burkett
|
b99d36dfdb
|
fixed issue with batch sizes larget than 1
|
2024-08-15 12:21:38 -06:00 |
|
Jaret Burkett
|
9ee1ef2a0a
|
Added experimental modified sigma sqrt weight mapping for linear timestep scheduling for flowmatching
|
2024-08-12 17:03:09 -06:00 |
|
Jaret Burkett
|
653fe60f16
|
Updates to flow matching algo
|
2024-08-07 15:04:17 +00:00 |
|
Jaret Burkett
|
c2424087d6
|
8 bit training working on flux
|
2024-08-06 11:53:27 -06:00 |
|
Jaret Burkett
|
edb7e827ee
|
Adjusted flow matching so target noise multiplier works properly with it.
|
2024-08-05 11:40:05 -06:00 |
|
Jaret Burkett
|
f321de7bdb
|
Setup to retrain guidance embedding for flux. Use defualt timestep distribution for flux
|
2024-08-04 10:37:23 -06:00 |
|
Jaret Burkett
|
9beea1c268
|
Flux training should work now... maybe
|
2024-08-03 09:17:34 -06:00 |
|
Jaret Burkett
|
47744373f2
|
Change img multiplier math
|
2024-07-30 11:33:41 -06:00 |
|
Jaret Burkett
|
443c996e7f
|
Do a noisy unconsitional for vision direct
|
2024-07-29 15:42:26 -06:00 |
|
Jaret Burkett
|
e81e19fd0f
|
Added target_norm_std which is a game changer
|
2024-07-28 16:08:33 -06:00 |
|
Jaret Burkett
|
0bc4d555c7
|
A lot of pixart sigma training tweaks
|
2024-07-28 11:23:18 -06:00 |
|
Jaret Burkett
|
80aa2dbb80
|
New image generation img2img. various tweaks and fixes
|
2024-07-24 04:13:41 -06:00 |
|
Jaret Burkett
|
8d799031cf
|
Remove reg as prior pred
|
2024-07-21 02:34:12 -06:00 |
|
Jaret Burkett
|
22d2f6e28f
|
Fixed issue with grad scaling
|
2024-07-20 08:21:57 -06:00 |
|
Jaret Burkett
|
11e426fdf1
|
Various features and fixes. Too much brain fog to do a proper description
|
2024-07-18 07:34:14 -06:00 |
|
Jaret Burkett
|
e4558dff4b
|
Partial implementation for training auraflow.
|
2024-07-12 12:11:38 -06:00 |
|
Jaret Burkett
|
c062b7716c
|
Varous bug fixes
|
2024-07-10 15:20:04 -06:00 |
|
Jaret Burkett
|
603ceca3ca
|
added ema
|
2024-06-28 10:03:26 -06:00 |
|
Jaret Burkett
|
657fd09f25
|
Added more control over Sigma sizes
|
2024-06-26 08:57:53 -06:00 |
|
Jaret Burkett
|
37cebd9458
|
WIP Ilora
|
2024-06-14 09:31:01 -06:00 |
|
Jaret Burkett
|
bd10d2d668
|
Some work on sd3 training. Not working
|
2024-06-13 12:19:16 -06:00 |
|
Jaret Burkett
|
cb5d28cba9
|
Added working ilora trainer
|
2024-06-12 09:33:45 -06:00 |
|
Jaret Burkett
|
3f3636b788
|
Bug fixes and little improvements here and there.
|
2024-06-08 06:24:20 -06:00 |
|
Jaret Burkett
|
833c833f28
|
WIP on SAFE encoder. Work on fp16 training improvements. Various other tweaks and improvements
|
2024-05-27 10:50:24 -06:00 |
|
Jaret Burkett
|
68b7e159bc
|
Bug Fixes
|
2024-05-17 08:41:20 -06:00 |
|
Jaret Burkett
|
5a45c709cd
|
Work on ipadapters and custom adapters
|
2024-05-13 06:37:54 -06:00 |
|
Jaret Burkett
|
10e1ecf1e8
|
Added single value adapter training
|
2024-04-28 06:04:47 -06:00 |
|
Jaret Burkett
|
5a70b7f38d
|
Added pixart sigma support, but it wont work until i address breaking changes with lora code in diffusers so it can be upgraded.
|
2024-04-20 10:46:56 -06:00 |
|
Jaret Burkett
|
377b81ee3e
|
Adjustments to guidance
|
2024-04-19 15:00:35 -06:00 |
|
Jaret Burkett
|
2d0a1be59d
|
Bug fixes
|
2024-04-16 03:48:13 -06:00 |
|
Jaret Burkett
|
7284aab7c0
|
Added specialized scaler training to ip adapters
|
2024-04-05 08:17:09 -06:00 |
|
Jaret Burkett
|
427847ac4c
|
Small tweaks and fixes for specialized ip adapter training
|
2024-03-26 11:35:26 -06:00 |
|
Jaret Burkett
|
016687bda1
|
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
|
2024-03-17 10:21:47 -06:00 |
|
Jaret Burkett
|
72de68d8aa
|
WIP on clip vision encoder
|
2024-03-13 07:24:08 -06:00 |
|
Jaret Burkett
|
f1cb87fe9e
|
fixed bug the kept learning rates the same
|
2024-03-06 09:23:32 -07:00 |
|
Jaret Burkett
|
b01e8d889a
|
Added stochastic rounding to adafactor. ILora adjustments
|
2024-03-05 07:07:09 -07:00 |
|
Jaret Burkett
|
337945de9a
|
Added this not that guidance. Added ability to replace prompts.
|
2024-02-28 20:10:14 -07:00 |
|
Jaret Burkett
|
1bd94f0f01
|
Added early DoRA support, but will change shortly. Dont use right now.
|
2024-02-23 05:55:41 -07:00 |
|
Jaret Burkett
|
9ffa8c3711
|
Fixed issue when there is no adapter
|
2024-02-22 02:59:59 -07:00 |
|
Jaret Burkett
|
b68c3ef734
|
Added te aug adapter
|
2024-02-21 21:30:26 -07:00 |
|
Jaret Burkett
|
49c41e6a5f
|
Bug fixes. allow for random negative prompts
|
2024-02-21 04:51:52 -07:00 |
|
Jaret Burkett
|
2478554c95
|
Bug fixes. Added IP adapter training for Pixart
|
2024-02-17 10:06:57 -07:00 |
|
Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
Jaret Burkett
|
4ec4025cbb
|
Added adapter modules for text encoders and direct vision
|
2024-02-12 08:46:18 -07:00 |
|
Jaret Burkett
|
e074058faa
|
Work on additional image embedding methods. Finalized zipper resampler. It works amazing
|
2024-02-10 09:00:05 -07:00 |
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
Jaret Burkett
|
177c7130ec
|
improved correction of pred norm by targeting the prior
|
2024-02-01 06:31:04 -07:00 |
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
Jaret Burkett
|
92b9c71d44
|
Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs
|
2024-01-28 08:20:03 -07:00 |
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
290393f7ae
|
Imporvements to ip weight adaptation. Bug fixes. Added masking to direct guidance loss. Allow importing a file for random triggers. Handle bas meta images with improper sizing.
|
2024-01-11 12:22:16 -07:00 |
|
Jaret Burkett
|
645b27f97a
|
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
|
2024-01-04 12:59:38 -07:00 |
|
Jaret Burkett
|
65c08b09c3
|
Added ability to do cfg during training. Various bug fixes
|
2024-01-02 11:29:57 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|
Jaret Burkett
|
0892dec4a5
|
Fixed some new bugs i added. woops
|
2023-12-28 14:03:42 -07:00 |
|
Jaret Burkett
|
eeee4a1620
|
Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes
|
2023-12-28 12:20:27 -07:00 |
|
Jaret Burkett
|
05ae95ca89
|
Added a clip vision adapter trainer. Only works for sd15 for now
|
2023-12-24 13:26:04 -07:00 |
|
Jaret Burkett
|
0f8daa5612
|
Bug fixes, work on maing IP adapters more customizable.
|
2023-12-24 08:32:39 -07:00 |
|
Jaret Burkett
|
7703e3a15e
|
Fixes for sdxl ip adapter training. Bug fixes
|
2023-12-21 11:15:58 -07:00 |
|
Jaret Burkett
|
0f597f453e
|
Switched ip adapter dataloader to clip_image paths so the control paths can be used for training assistant adapters while training ip adapters
|
2023-12-20 10:32:24 -07:00 |
|
Jaret Burkett
|
dfb64b5957
|
Allow ip adapters to be much more variable in their creation
|
2023-12-20 06:18:33 -07:00 |
|
Jaret Burkett
|
82098e5d6e
|
Added more functionality for ip adapters
|
2023-12-19 09:54:56 -07:00 |
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
Jaret Burkett
|
39870411d8
|
More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes
|
2023-12-15 06:02:10 -07:00 |
|
Jaret Burkett
|
eaa0fb6253
|
Tons of bug fixes and improvements to special training. Fixed slider training.
|
2023-12-09 16:38:10 -07:00 |
|
Jaret Burkett
|
92cb5ae096
|
Reworked targeted guidance algo
|
2023-12-01 06:30:52 -07:00 |
|
Jaret Burkett
|
bd2bce9b92
|
Switched to trailing timestep spacing to make timesteps for consistant across schedulers. Honed in on targeted guidance. It is finally perfect. (I think)
|
2023-11-29 14:32:48 -07:00 |
|
Jaret Burkett
|
7624241032
|
More fixes for noise schedules and fixed targeted guidance inverted masked prior
|
2023-11-29 10:13:31 -07:00 |
|
Jaret Burkett
|
792a5e37e2
|
Numerous fixes for time sampling. Still not perfect
|
2023-11-28 07:34:43 -07:00 |
|
Jaret Burkett
|
d7e55b6ad4
|
Bug fixes, negative prompting during training, hardened catching
|
2023-11-24 07:25:11 -07:00 |
|
Jaret Burkett
|
4f9cdd916a
|
added prompt dropout to happen indempendently on each TE
|
2023-11-14 05:26:51 -07:00 |
|
Jaret Burkett
|
7782caa468
|
Varous bug fixes. Finalized targeted guidance algo
|
2023-11-10 12:18:08 -07:00 |
|
Jaret Burkett
|
fa6d91ba76
|
Diffirential guidance working, but I may have a better way
|
2023-11-09 06:09:36 -07:00 |
|
Jaret Burkett
|
1ee62562a4
|
diffirential guidance is WORKING (from what I can tell)
|
2023-11-07 19:24:12 -07:00 |
|
Jaret Burkett
|
93ea955d7c
|
Added refiner fine tuning. Works, but needs some polish.
|
2023-11-05 17:15:03 -07:00 |
|
Jaret Burkett
|
8a9e8f708f
|
Added base for using guidance during training. Still not working right.
|
2023-11-05 04:03:32 -07:00 |
|
Jaret Burkett
|
ceaf1d9454
|
Various bug fixes, wip stuff, and tweaks
|
2023-11-02 18:19:20 -06:00 |
|
Jaret Burkett
|
7d707b2fe6
|
Added masking to slider training. Something is still weird though
|
2023-11-01 14:51:29 -06:00 |
|
Jaret Burkett
|
a899ec91c8
|
Added some split prompting started code, adamw8bit, replacements improving, learnable snr gos. A lot of good stuff.
|
2023-11-01 06:52:21 -06:00 |
|
Jaret Burkett
|
436a09430e
|
Added flat snr gamma vs min. Fixes timestep timing
|
2023-10-29 15:41:55 -06:00 |
|
Jaret Burkett
|
3097865203
|
Fix llava import.. again
|
2023-10-29 12:52:17 -06:00 |
|
Jaret Burkett
|
b84e3260cb
|
Fix llava import
|
2023-10-29 12:50:54 -06:00 |
|
Jaret Burkett
|
298001439a
|
Added gradient accumulation finally
|
2023-10-28 13:14:29 -06:00 |
|
Jaret Burkett
|
6f3e0d5af2
|
Improved lorm extraction and training
|
2023-10-28 08:21:59 -06:00 |
|
Jaret Burkett
|
9636194c09
|
Added fuyu captioning
|
2023-10-25 14:14:53 -06:00 |
|
Jaret Burkett
|
002279cec3
|
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
|
2023-10-24 16:02:07 -06:00 |
|
Jaret Burkett
|
34eb563d55
|
Added dataset tagging and management tools using llava
|
2023-10-24 10:11:47 -06:00 |
|
Jaret Burkett
|
dc36bbb3c8
|
Added long prompts to general training
|
2023-10-23 08:12:58 -06:00 |
|
Jaret Burkett
|
9905a1e205
|
Fixes and longer prompts
|
2023-10-22 08:57:37 -06:00 |
|
Jaret Burkett
|
0e9fc42816
|
Allow for inverted masked prior
|
2023-10-21 06:50:17 -06:00 |
|
Jaret Burkett
|
d46112a354
|
Fixes for aug pipeline
|
2023-10-20 13:24:07 -06:00 |
|
Jaret Burkett
|
07bf7bd7de
|
Allow augmentations and targeting different loss types fron the config file
|
2023-10-18 03:04:57 -06:00 |
|
Jaret Burkett
|
a05459afaf
|
Fixed issue with adapters that only had 1 input channel. Added ability to set the percentage chance of adapter matching
|
2023-10-15 15:13:35 -06:00 |
|
Jaret Burkett
|
7909b50d24
|
Added adapter assistance to SD training
|
2023-10-14 08:44:53 -06:00 |
|
Jaret Burkett
|
63ceffae24
|
Massive speed increases and ram optimizations
|
2023-10-10 06:07:55 -06:00 |
|
Jaret Burkett
|
bb1d3793e3
|
Added ability to add masks to dataloader and sd trainer to adjust weight of image
|
2023-10-09 11:21:00 -06:00 |
|
Jaret Burkett
|
1d3de678aa
|
fixed bug with trigger word embedding. Allow control images to load from the dataloader or legacy way
|
2023-10-09 06:21:49 -06:00 |
|
Jaret Burkett
|
f73402473b
|
Bug fixes. Added some functionality to help with private extensions
|
2023-10-05 07:09:34 -06:00 |
|
Jaret Burkett
|
c5d49ba661
|
Allow adapter image to be cropped to match bucket cropping
|
2023-09-25 10:38:54 -06:00 |
|
Jaret Burkett
|
e5153d87c9
|
Fixed issues with dataloader bucketing. Allow using standard base image for t2i adapters.
|
2023-09-24 05:19:57 -06:00 |
|
Jaret Burkett
|
830e87cb87
|
Added IP adapter training. Not functioning correctly yet
|
2023-09-24 02:39:43 -06:00 |
|
Jaret Burkett
|
61badf85a7
|
t2i training working from what I can tell at least
|
2023-09-17 15:56:43 -06:00 |
|
Jaret Burkett
|
27f343fc08
|
Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps.
|
2023-09-16 08:30:38 -06:00 |
|
Jaret Burkett
|
569d7464d5
|
implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar
|
2023-09-14 08:31:54 -06:00 |
|
Jaret Burkett
|
e8583860ad
|
Upgraded to dev for t2i on diffusers. Minor migrations to make it work.
|
2023-09-11 14:46:06 -06:00 |
|
Jaret Burkett
|
083cefa78c
|
Bugfixes for slider reference
|
2023-09-10 18:36:23 -06:00 |
|
Jaret Burkett
|
b5ec8e4eb1
|
Improve reference slider memory and speed
|
2023-09-10 18:26:44 -06:00 |
|
Jaret Burkett
|
34bfeba229
|
Massive speed increase. Added latent caching both to disk and to memory
|
2023-09-10 08:54:49 -06:00 |
|
Jaret Burkett
|
626ed2939a
|
bug fixes
|
2023-09-09 15:04:44 -06:00 |
|
Jaret Burkett
|
be804c9cf5
|
Save embeddings as their trigger to match auto and comfy style loading. Also, FINALLY found why gradients were wonkey and fixed it. The root problem is dropping out of network state before backward pass.
|
2023-09-09 12:02:07 -06:00 |
|
Jaret Burkett
|
408c50ead1
|
actually got gradient checkpointing working, again, again, maybe
|
2023-09-09 11:27:42 -06:00 |
|
Jaret Burkett
|
b01ab5d375
|
FINALLY fixed gradient checkpointing issue. Big batches baby.
|
2023-09-08 15:21:46 -06:00 |
|
Jaret Burkett
|
ce4f9fe02a
|
Bug fixes and improvements to token injection
|
2023-09-08 06:10:59 -06:00 |
|
Jaret Burkett
|
3feb663a51
|
Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see
|
2023-09-07 13:06:18 -06:00 |
|
Jaret Burkett
|
436bf0c6a3
|
Added experimental concept replacer, replicate converter, bucket maker, and other goodies
|
2023-09-06 18:50:32 -06:00 |
|
Jaret Burkett
|
a4c3507a62
|
Added LoCON from LyCORIS
|
2023-09-04 08:48:07 -06:00 |
|
Jaret Burkett
|
7cd6945082
|
Added my annotator/preprocessor and improved network jitter on reference trainer
|
2023-09-03 16:43:51 -06:00 |
|
Jaret Burkett
|
33267e117c
|
Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant
|
2023-08-30 14:52:12 -06:00 |
|
Jaret Burkett
|
714854ee86
|
Hude rework to move the batch to a DTO to make it far more modular to the future ui
|
2023-08-29 10:22:19 -06:00 |
|
Jaret Burkett
|
a008d9e63b
|
Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum
|
2023-08-28 17:56:30 -06:00 |
|
Jaret Burkett
|
c446f768ea
|
Huge memory optimizations, many big fixes
|
2023-08-27 17:48:02 -06:00 |
|
Jaret Burkett
|
3367ab6b2c
|
Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling
|
2023-08-26 08:55:00 -06:00 |
|
Jaret Burkett
|
7157c316af
|
Added support for training lora, dreambooth, and fine tuning. Still need testing and docs
|
2023-08-23 15:37:00 -06:00 |
|
Jaret Burkett
|
e2c547f6c2
|
Fixed typo
|
2023-08-23 13:33:48 -06:00 |
|
Jaret Burkett
|
f200cf36c5
|
Added train example to ti
|
2023-08-23 13:30:29 -06:00 |
|
Jaret Burkett
|
d298240cec
|
Tied in ant tested TI script
|
2023-08-23 13:26:28 -06:00 |
|
Jaret Burkett
|
2e6c55c720
|
WIP creating textual inversion training script
|
2023-08-22 21:02:38 -06:00 |
|
Jaret Burkett
|
36ba08d3fa
|
Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly
|
2023-08-21 16:22:01 -06:00 |
|
Jaret Burkett
|
bef5551ea5
|
Ultimate slider training built, still needs tuning
|
2023-08-19 18:54:34 -06:00 |
|
Jaret Burkett
|
b77b9acc0b
|
Added base for ultimate slider. WIP
|
2023-08-19 15:35:24 -06:00 |
|
Jaret Burkett
|
90eedb78bf
|
Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun
|
2023-08-19 05:54:22 -06:00 |
|
Jaret Burkett
|
d51c4ca704
|
Added ability to use two seperate folders for datasets when doing image reference sliders
|
2023-08-18 11:44:33 -06:00 |
|
Jaret Burkett
|
196b693cf0
|
Worked on reference slider script. It is working well currently. Still going to tune it a bit before a writeup though
|
2023-08-12 17:59:24 -06:00 |
|
Jaret Burkett
|
379992d89e
|
Various bug fixes and improvements
|
2023-08-12 05:59:50 -06:00 |
|
Jaret Burkett
|
67dfd9ced0
|
Added inbuild plugins and made one for image referenced. WIP
|
2023-08-10 16:20:38 -06:00 |
|
Jaret Burkett
|
1a7e346b41
|
Added inbuild plugins and made one for image referenced. WIP
|
2023-08-10 16:02:44 -06:00 |