ai-toolkit/toolkit/optimizers
Jaret Burkett dd700f70b3 Avoid loading state dict for automagic for now until I can sort out some issues 2025-02-26 17:03:14 -07:00
..
adafactor.py Experimental features and bug fixes 2025-02-04 13:36:34 -07:00
adam8bit.py Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) 2024-11-20 09:16:55 -07:00
automagic.py Avoid loading state dict for automagic for now until I can sort out some issues 2025-02-26 17:03:14 -07:00
optimizer_utils.py Fixed saving and displaying for automagic 2024-11-29 08:00:22 -07:00
prodigy_8bit.py Added adafactor implementation that handles stochastic rounding of update and accumulation 2024-10-30 05:25:57 -06:00