Skip to content

Commit 566f3b8

Browse files
mgoinYuqi Zhang
authored andcommitted
Check if bitblas is installed during support check (vllm-project#17572)
Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
1 parent 853ded0 commit 566f3b8

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

vllm/model_executor/layers/quantization/utils/bitblas_utils.py

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -71,6 +71,15 @@ def _check_bitblas_supported(
7171
f"Only group_sizes = {BITBLAS_SUPPORTED_GROUP_SIZES} "
7272
"are supported.")
7373

74+
# Finally, check if bitblas is installed
75+
try:
76+
import bitblas
77+
if bitblas.__version__ < MINIMUM_BITBLAS_VERSION:
78+
raise ImportError("bitblas version is wrong. Please "
79+
f"install bitblas>={MINIMUM_BITBLAS_VERSION}")
80+
except ImportError:
81+
return False, "BitBLAS is not installed."
82+
7483
return True, None
7584

7685

0 commit comments

Comments
 (0)