4 Commits

Author	SHA1	Message	Date
Jaret Burkett	894374b2e9	Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)	2024-11-20 09:16:55 -07:00
Jaret Burkett	298001439a	Added gradient accumulation finally	2023-10-28 13:14:29 -06:00
Jaret Burkett	6f3e0d5af2	Improved lorm extraction and training	2023-10-28 08:21:59 -06:00
Jaret Burkett	0a79ac9604	Added lorm. WIP	2023-10-26 18:23:51 -06:00