4 Commits

Author	SHA1	Message	Date
Jaret Burkett	894374b2e9	Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)	2024-11-20 09:16:55 -07:00
Jaret Burkett	9f94c7b61e	Added experimental param multiplier to the ema module	2024-10-22 09:25:52 -06:00
Jaret Burkett	acafe9984f	Adjustments to loading of flux. Added a feedback to ema	2024-08-07 13:17:26 -06:00
Jaret Burkett	603ceca3ca	added ema	2024-06-28 10:03:26 -06:00