Skip to content

[Kernel] Pass a device pointer into the quantize kernel for the scales#5159

Merged
simon-mo merged 3 commits intovllm-project:mainfrom neuralmagic:tms/quantize_kernel_scale_ptrJun 3, 2024
+16-11

Commits