Jaret Burkett 2b4c525489 Reworked automagic optimizer and did more testing. Starting to really like it. Working well.		2025-04-28 08:01:10 -06:00
..
adafactor.py	Experimental features and bug fixes	2025-02-04 13:36:34 -07:00
adam8bit.py	Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)	2024-11-20 09:16:55 -07:00
automagic.py	Reworked automagic optimizer and did more testing. Starting to really like it. Working well.	2025-04-28 08:01:10 -06:00
optimizer_utils.py	Fixed saving and displaying for automagic	2024-11-29 08:00:22 -07:00
prodigy_8bit.py	Added adafactor implementation that handles stochastic rounding of update and accumulation	2024-10-30 05:25:57 -06:00