Skip to content

Commit 781ed18

Browse files
committed
Fix missing symbols in trtllm_utils.so
The `trtllm_utils` library also needs symbols from common files, e.g. the `llmException`. Extend the dependencies to link `trtllm_utils.so` with common helpers. ```python >>> flashinfer.utils.get_trtllm_utils_module() Traceback (most recent call last): ... OSError: ...flashinfer/data/aot/trtllm_utils/trtllm_utils.so: undefined symbol: _ZTIN12tensorrt_llm6common13TllmExceptionE ``` Fixes: #1167 Signed-off-by: Christian Heimes <christian@python.org>
1 parent bc50f1a commit 781ed18

File tree

2 files changed

+12
-0
lines changed

2 files changed

+12
-0
lines changed

flashinfer/aot.py

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -545,6 +545,14 @@ def main():
545545
/ "tensorrt_llm"
546546
/ "kernels"
547547
/ "delayStream.cu",
548+
jit_env.FLASHINFER_CSRC_DIR
549+
/ "nv_internal/cpp/kernels/quantization.cu",
550+
jit_env.FLASHINFER_CSRC_DIR / "nv_internal/cpp/common/envUtils.cpp",
551+
jit_env.FLASHINFER_CSRC_DIR / "nv_internal/cpp/common/logger.cpp",
552+
jit_env.FLASHINFER_CSRC_DIR
553+
/ "nv_internal/cpp/common/stringUtils.cpp",
554+
jit_env.FLASHINFER_CSRC_DIR
555+
/ "nv_internal/cpp/common/tllmException.cpp",
548556
],
549557
extra_include_paths=[
550558
jit_env.FLASHINFER_CSRC_DIR / "nv_internal",

flashinfer/utils.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -478,6 +478,10 @@ def get_trtllm_utils_module():
478478
[
479479
jit_env.FLASHINFER_CSRC_DIR
480480
/ "nv_internal/tensorrt_llm/kernels/delayStream.cu",
481+
jit_env.FLASHINFER_CSRC_DIR / "nv_internal/cpp/common/envUtils.cpp",
482+
jit_env.FLASHINFER_CSRC_DIR / "nv_internal/cpp/common/logger.cpp",
483+
jit_env.FLASHINFER_CSRC_DIR / "nv_internal/cpp/common/stringUtils.cpp",
484+
jit_env.FLASHINFER_CSRC_DIR / "nv_internal/cpp/common/tllmException.cpp",
481485
],
482486
extra_include_paths=[
483487
jit_env.FLASHINFER_CSRC_DIR / "nv_internal",

0 commit comments

Comments
 (0)