Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment! #116

Open
cnahmgx opened this issue Mar 31, 2023 · 9 comments

Comments

@cnahmgx
Copy link

cnahmgx commented Mar 31, 2023

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so
CUDA SETUP: Highest compute capability among GPUs detected: 7.5
CUDA SETUP: Detected CUDA version 117
CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
/lib64/libstdc++.so.6: version CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so) CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so CUDA SETUP: Highest compute capability among GPUs detected: 7.5 CUDA SETUP: Detected CUDA version 117 CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so... /lib64/libstdc++.so.6: version CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so)
CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so
CUDA SETUP: Highest compute capability among GPUs detected: 7.5
CUDA SETUP: Detected CUDA version 117
CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
/lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so)
CUDA SETUP: Something unexpected happened. Please compile from source:
git clone git@github.com:TimDettmers/bitsandbytes.git
cd bitsandbytes
CUDA_VERSION=117 make cuda11x
python setup.py install
Traceback (most recent call last):
File "/root/magaoxiang/finetune.py", line 9, in
from peft import get_peft_model, LoraConfig, TaskType
File "/usr/local/lib/python3.9/site-packages/peft/init.py", line 22, in
from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING, PEFT_TYPE_TO_CONFIG_MAPPING, get_peft_config, get_peft_model
File "/usr/local/lib/python3.9/site-packages/peft/mapping.py", line 16, in
from .peft_model import (
File "/usr/local/lib/python3.9/site-packages/peft/peft_model.py", line 31, in
from .tuners import LoraModel, PrefixEncoder, PromptEmbedding, PromptEncoder
File "/usr/local/lib/python3.9/site-packages/peft/tuners/init.py", line 20, in
from .lora import LoraConfig, LoraModel
File "/usr/local/lib/python3.9/site-packages/peft/tuners/lora.py", line 36, in
import bitsandbytes as bnb
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/init.py", line 7, in
from .autograd._functions import (
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/autograd/init.py", line 1, in
from ._functions import undo_layout, get_inverse_transform_indices
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/autograd/_functions.py", line 9, in
import bitsandbytes.functional as F
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/functional.py", line 17, in
from .cextension import COMPILED_WITH_CUDA, lib
File "/usr/local/lib/python3.9/site-packages/bitsandbytes/cextension.py", line 22, in
raise RuntimeError('''
RuntimeError:
CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!
If you cannot find any issues and suspect a bug, please open an issue with detals about your environment:
https://github.com/TimDettmers/bitsandbytes/issues

@cnahmgx
Copy link
Author

cnahmgx commented Mar 31, 2023

有人遇到过这种问题么

@walker83
Copy link

问题不太一样,用另外的方案绕过了

@xpeter80
Copy link

xpeter80 commented Apr 2, 2023

问题不太一样,用另外的方案绕过了

什么方案?

@luohm111
Copy link

luohm111 commented Apr 3, 2023

我也遇到了这个问题,请问什么方案可以绕过?

@luohm111
Copy link

luohm111 commented Apr 3, 2023

问题不太一样,用另外的方案绕过了

请问什么方案可以绕过?

@walker83
Copy link

walker83 commented Apr 4, 2023

问题不太一样,用另外的方案绕过了

请问什么方案可以绕过?
我的问题类似,用这个办法解决的:
#117

@cutelitchi
Copy link

你这个117也没解决啊

@magicleo
Copy link

export LD_LIBRARY_PATH=/mnt/storage/anaconda3/lib:$LD_LIBRARY_PATH
ubuntu在环境中增加这个可解决。路径酌情修改

@GromZhang
Copy link

我觉得问题的核心在这里
CUDA SETUP: Loading binary /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
/lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /usr/local/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cuda117.so)
可以通过更新libstdc++.so.6的版本,来解决上述问题
亲测,可用

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants