Jaret Burkett
|
323b4aaf5a
|
Do not copy pin memory if it fails, just move
|
2025-11-17 18:04:00 +00:00 |
Jaret Burkett
|
0d8a33dc16
|
Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support
|
2025-10-21 06:03:27 -06:00 |
Jaret Burkett
|
55b8b0e23e
|
Fix issue where ARA was not working when using memory manager
|
2025-10-07 13:39:44 -06:00 |
Jaret Burkett
|
c9f982af83
|
Add support for using quantized models with ramtorch
|
2025-10-06 13:46:57 -06:00 |
Jaret Burkett
|
4e5707854f
|
Initial support for RamTorch. Still a WIP
|
2025-10-05 13:03:26 -06:00 |