Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

import thunderkittens error #74

Open
klxy0304 opened this issue Dec 5, 2024 · 0 comments
Open

import thunderkittens error #74

klxy0304 opened this issue Dec 5, 2024 · 0 comments

Comments

@klxy0304
Copy link

klxy0304 commented Dec 5, 2024

Hey, really awesome repo, I followed the steps in the README to install the pre-existing kernels. After executing python setup.py install, the output was as follows:

Installed /opt/conda/lib/python3.11/site-packages/thunderkittens-0.0.0-py3.11-linux-x86_64.egg
Processing dependencies for thunderkittens==0.0.0
Finished processing dependencies for thunderkittens==0.0.0

However, when I tried to import thunderkittens as tk, I received the following error:

ImportError: /opt/conda/lib/python3.11/site-packages/thunderkittens.cpython-311-x86_64-linux-gnu.so: undefined symbol: _Z17attention_forwardN2at6TensorES0_S0_b

My env is torch==2.5.0, cuda==12.4, GPU: 4090.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant