Gate supports_nvfp4_compute on CUDA 13+ build (fixes #11864)

cuBLAS FP4 matmul kernels (cublasLtMatmulAlgoGetHeuristic) require
CUDA 13.0+. On Blackwell GPUs with torch built against CUDA <13
(e.g. cu128), the previous check only looked at compute capability
and let native NVFP4 through, causing CUBLAS_STATUS_NOT_SUPPORTED
errors or VRAM blowups at matmul time. Now falls back to the
regular quantized-storage path when the CUDA build is too old.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Alan Li 2026-07-24 16:01:01 -04:00
parent 2eb609766a
commit 868c29cff3
1 changed files with 8 additions and 0 deletions

View File

@ -1963,6 +1963,14 @@ def supports_nvfp4_compute(device=None):
if props.major < 10:
return False
# cuBLAS FP4 matmul kernels require CUDA 13+, see #11864
try:
cuda_version_major = int(torch.version.cuda.split(".")[0])
except:
return False
if cuda_version_major < 13:
return False
return True
def supports_mxfp8_compute(device=None):