Skip to content

[Bug] [Critical] [ROCm]: Compilation error during vLLM package installation #20882

New issue
New issue
Closed
#20883
Closed
[Bug] [Critical] [ROCm]: Compilation error during vLLM package installation#20882
#20883
Labels
bugSomething isn't working
@tjtanaa

Description

@tjtanaa
tjtanaa
opened on Jul 13, 2025

Your current environment

The output of python collect_env.py 
==============================
        System Info
==============================
OS                           : Ubuntu 22.04.5 LTS (x86_64)
GCC version                  : (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version                : Could not collect
CMake version                : version 3.26.4
Libc version                 : glibc-2.35

==============================
       PyTorch Info
==============================
PyTorch version              : 2.7.0+git6fd4078
Is debug build               : False
CUDA used to build PyTorch   : N/A
ROCM used to build PyTorch   : 6.4.43483-a187df25c

==============================
      Python Environment
==============================
Python version               : 3.10.12 (main, Feb  4 2025, 14:57:36) [GCC 11.4.0] (64-bit runtime)
Python platform              : Linux-5.15.0-116-generic-x86_64-with-glibc2.35

==============================
       CUDA / GPU Info
==============================
Is CUDA available            : True
CUDA runtime version         : Could not collect
CUDA_MODULE_LOADING set to   : LAZY
GPU models and configuration : AMD Instinct MI300X (gfx942:sramecc+:xnack-)
Nvidia driver version        : Could not collect
cuDNN version                : Could not collect
HIP runtime version          : 6.4.43483
MIOpen runtime version       : 3.4.0
Is XNNPACK available         : True

==============================
Versions of relevant libraries
==============================
[pip3] conch-triton-kernels==1.2.1
[pip3] numpy==2.2.6
[pip3] pyzmq==26.4.0
[pip3] torch==2.7.0+git6fd4078
[pip3] torchao==0.11.0
[pip3] torchaudio==2.7.0a0+654fee8
[pip3] torchvision==0.22.0+9eb57cd
[pip3] transformers==4.52.4
[pip3] triton==3.3.0
[conda] Could not collect

==============================
         vLLM Info
==============================
ROCM Version                 : 6.4.43483-a187df25c
Neuron SDK Version           : N/A
vLLM Version                 : 0.1.dev7675+gf184e89 (git sha: f184e89)

==============================
     Environment Variables
==============================
TORCHINDUCTOR_MAX_AUTOTUNE_POINTWISE=1
NCCL_MIN_NCHANNELS=112
TORCHINDUCTOR_MAX_AUTOTUNE=1
PYTORCH_ROCM_ARCH=gfx942
TORCH_BLAS_PREFER_HIPBLASLT=1
LD_LIBRARY_PATH=/opt/rocm-6.4.1/lib:/usr/local/lib:
VLLM_USE_TRITON_FLASH_ATTN=0
NCCL_CUMEM_ENABLE=0
PYTORCH_NVML_BASED_CUDA_CHECK=1
TORCHINDUCTOR_COMPILE_THREADS=1
CUDA_MODULE_LOADING=LAZY

🐛 Describe the bug

This commit [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#… · vllm-project/vllm@2c11a73 break mamba support on ROCm and vllm is not able to compile successfully during installation step python3 setup.py develop

[4/5] Building HIP object CMakeFiles/_C.dir/csrc/mamba/mamba_ssm/selective_scan_fwd.hip.o
FAILED: CMakeFiles/_C.dir/csrc/mamba/mamba_ssm/selective_scan_fwd.hip.o 
/opt/rocm-6.4.1/lib/llvm/bin/clang++ -DCUTLASS_ENABLE_DIRECT_CUDA_DRIVER_CALL=1 -DPy_LIMITED_API=3 -DTORCH_EXTENSION_NAME=_C -DUSE_C10D_GLOO -DUSE_C10D_NCCL -DUSE_DISTRIBUTED -DUSE_PROF_API=1 -DUSE_RPC -DUSE_TENSORPIPE -D_C_EXPORTS -D__HIP_PLATFORM_AMD__ -D__HIP_PLATFORM_AMD__=1 -D__HIP_ROCclr__=1 -I/app/upstreamupgradeaiter/mtp-v1/csrc -isystem /usr/include/python3.10 -isystem /usr/local/lib/python3.10/dist-packages/torch/include -isystem /usr/local/lib/python3.10/dist-packages/torch/include/torch/csrc/api/include -isystem /opt/rocm-6.4.1/include/hiprand -isystem /opt/rocm-6.4.1/include/rocrand -Wno-unused-result -O2 -g -DNDEBUG --offload-arch=gfx942 -fPIC -fPIC -D__HIP_PLATFORM_AMD__=1 -DUSE_ROCM=1 -DHIPBLAS_V2 -DCUDA_HAS_FP16=1 -D__HIP_NO_HALF_OPERATORS__=1 -D__HIP_NO_HALF_CONVERSIONS__=1 -DHIP_ENABLE_WARP_SYNC_BUILTINS=1 -DUSE_ROCM -DENABLE_FP8 -U__HIP_NO_HALF_CONVERSIONS__ -U__HIP_NO_HALF_OPERATORS__ -Werror=unused-variable -fno-gpu-rdc -D_GLIBCXX_USE_CXX11_ABI=1 -DTORCH_HIP_VERSION=604 -Wno-shift-count-negative -Wno-shift-count-overflow -Wno-duplicate-decl-specifier -DCAFFE2_USE_MIOPEN -DTHRUST_DEVICE_SYSTEM=THRUST_DEVICE_SYSTEM_HIP -std=c++17 -DHIPBLASLT_VEC_EXT -DHIP_ENABLE_WARP_SYNC_BUILTINS -MD -MT CMakeFiles/_C.dir/csrc/mamba/mamba_ssm/selective_scan_fwd.hip.o -MF CMakeFiles/_C.dir/csrc/mamba/mamba_ssm/selective_scan_fwd.hip.o.d -o CMakeFiles/_C.dir/csrc/mamba/mamba_ssm/selective_scan_fwd.hip.o -x hip -c /app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:325:35: error: no matching function for call to 'hipFuncSetAttribute'
  325 |                     C10_HIP_CHECK(hipFuncSetAttribute(
      |                                   ^~~~~~~~~~~~~~~~~~~
/usr/local/lib/python3.10/dist-packages/torch/include/c10/hip/HIPException.h:30:30: note: expanded from macro 'C10_HIP_CHECK'
   30 |     const hipError_t __err = EXPR;                                 \
      |                              ^~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:78: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |                                                                              ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:13: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:58: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |                                                          ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:9: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |         ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:77: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |                                                                             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:5: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |     ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:352:13: note: in instantiation of function template specialization 'selective_scan_fwd_launch<64, 4, c10::BFloat16, float>' requested here
  352 |             selective_scan_fwd_launch<64, 4, input_t, weight_t>(params, stream);
      |             ^
/opt/rocm-6.4.1/include/hip/hip_runtime_api.h:2397:12: note: candidate function not viable: no known conversion from 'void (*)(SSMParamsBase)' to 'const void *' for 1st argument
 2397 | hipError_t hipFuncSetAttribute(const void* func, hipFuncAttribute attr, int value);
      |            ^                   ~~~~~~~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:325:35: error: no matching function for call to 'hipFuncSetAttribute'
  325 |                     C10_HIP_CHECK(hipFuncSetAttribute(
      |                                   ^~~~~~~~~~~~~~~~~~~
/usr/local/lib/python3.10/dist-packages/torch/include/c10/hip/HIPException.h:30:30: note: expanded from macro 'C10_HIP_CHECK'
   30 |     const hipError_t __err = EXPR;                                 \
      |                              ^~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:26:14: note: expanded from macro 'BOOL_SWITCH'
   26 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:78: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |                                                                              ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:13: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:58: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |                                                          ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:9: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |         ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:77: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |                                                                             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:5: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |     ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:352:13: note: in instantiation of function template specialization 'selective_scan_fwd_launch<64, 4, c10::BFloat16, float>' requested here
  352 |             selective_scan_fwd_launch<64, 4, input_t, weight_t>(params, stream);
      |             ^
/opt/rocm-6.4.1/include/hip/hip_runtime_api.h:2397:12: note: candidate function not viable: no known conversion from 'void (*)(SSMParamsBase)' to 'const void *' for 1st argument
 2397 | hipError_t hipFuncSetAttribute(const void* func, hipFuncAttribute attr, int value);
      |            ^                   ~~~~~~~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:325:35: error: no matching function for call to 'hipFuncSetAttribute'
  325 |                     C10_HIP_CHECK(hipFuncSetAttribute(
      |                                   ^~~~~~~~~~~~~~~~~~~
/usr/local/lib/python3.10/dist-packages/torch/include/c10/hip/HIPException.h:30:30: note: expanded from macro 'C10_HIP_CHECK'
   30 |     const hipError_t __err = EXPR;                                 \
      |                              ^~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:26:14: note: expanded from macro 'BOOL_SWITCH'
   26 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:78: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |                                                                              ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:13: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:58: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |                                                          ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:9: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |         ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:77: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |                                                                             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:5: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |     ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:352:13: note: in instantiation of function template specialization 'selective_scan_fwd_launch<64, 4, c10::BFloat16, float>' requested here
  352 |             selective_scan_fwd_launch<64, 4, input_t, weight_t>(params, stream);
      |             ^
/opt/rocm-6.4.1/include/hip/hip_runtime_api.h:2397:12: note: candidate function not viable: no known conversion from 'void (*)(SSMParamsBase)' to 'const void *' for 1st argument
 2397 | hipError_t hipFuncSetAttribute(const void* func, hipFuncAttribute attr, int value);
      |            ^                   ~~~~~~~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:325:35: error: no matching function for call to 'hipFuncSetAttribute'
  325 |                     C10_HIP_CHECK(hipFuncSetAttribute(
      |                                   ^~~~~~~~~~~~~~~~~~~
/usr/local/lib/python3.10/dist-packages/torch/include/c10/hip/HIPException.h:30:30: note: expanded from macro 'C10_HIP_CHECK'
   30 |     const hipError_t __err = EXPR;                                 \
      |                              ^~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:26:14: note: expanded from macro 'BOOL_SWITCH'
   26 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:26:14: note: expanded from macro 'BOOL_SWITCH'
   26 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:23:14: note: expanded from macro 'BOOL_SWITCH'
   23 |       return __VA_ARGS__();                \
      |              ^~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:78: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |                                                                              ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:319:13: note: while substituting into a lambda expression here
  319 |             BOOL_SWITCH(params.query_start_loc_ptr != nullptr , kVarlen, [&] {
      |             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:58: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |                                                          ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:318:9: note: while substituting into a lambda expression here
  318 |         BOOL_SWITCH(params.z_ptr != nullptr , kHasZ, [&] {
      |         ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:77: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |                                                                             ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:317:5: note: while substituting into a lambda expression here
  317 |     BOOL_SWITCH(params.seqlen % (kNThreads * kNItems) == 0, kIsEvenLen, [&] {
      |     ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/static_switch.h:20:7: note: expanded from macro 'BOOL_SWITCH'
   20 |   [&] {                                    \
      |       ^
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:352:13: note: in instantiation of function template specialization 'selective_scan_fwd_launch<64, 4, c10::BFloat16, float>' requested here
  352 |             selective_scan_fwd_launch<64, 4, input_t, weight_t>(params, stream);
      |             ^
/opt/rocm-6.4.1/include/hip/hip_runtime_api.h:2397:12: note: candidate function not viable: no known conversion from 'void (*)(SSMParamsBase)' to 'const void *' for 1st argument
 2397 | hipError_t hipFuncSetAttribute(const void* func, hipFuncAttribute attr, int value);
      |            ^                   ~~~~~~~~~~~~~~~~
/app/upstreamupgradeaiter/mtp-v1/build/temp.linux-x86_64-cpython-310/csrc/mamba/mamba_ssm/selective_scan_fwd.hip:325:35: error: no matching function for call to 'hipFuncSetAttribute'
  325 |                     C10_HIP_CHECK(hipFuncSetAttribute(
      |                                   ^~~~~~~~~~~~~~~~~~~
/usr/local/lib/python3.10/dist-packages/torch/include/c10/hip/HIPException.h:30:30: note: expanded from macro 'C10_HIP_CHECK'
   30 |     const hipError_t __err = EXPR;                                 \
      |             
fatal error: too many errors emitted, stopping now [-ferror-limit=]
20 errors generated when compiling for gfx942.
ninja: build stopped: subcommand failed.

Full log file.
upstreamerrorlog.txt

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions