Jaret Burkett
|
e28727d5cb
|
Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16.
|
2026-07-15 10:24:52 -06:00 |
|
Jaret Burkett
|
cf0db39ede
|
Fix some errors for specific quants. Enable saving quantizations.
|
2026-07-14 07:25:09 -06:00 |
|
Jaret Burkett
|
28b05ee4ed
|
Added convrotbitnet 1.58 bit quantization
|
2026-07-13 07:52:48 -06:00 |
|
Jaret Burkett
|
b6ff367633
|
Convrot improvements. Add argitrary bit packed byte quantizations.
|
2026-07-13 06:33:54 -06:00 |
|
Jaret Burkett
|
095d6e7418
|
Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods.
|
2026-07-11 13:49:41 -06:00 |
|
Jaret Burkett
|
933ca1c517
|
Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak.
|
2026-07-11 10:53:50 -06:00 |
|
Jaret Burkett
|
065ac27353
|
Fix issue with compiling convrot on some models
|
2026-07-11 09:26:12 -06:00 |
|
Jaret Burkett
|
96a3a06111
|
Added initial experimental support for convrot4 and convrot8 quantization.
|
2026-07-10 11:01:14 -06:00 |