Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python 3.12 support, v0.0.7 #25

Merged
merged 1 commit into from
Jul 22, 2024
Merged

Python 3.12 support, v0.0.7 #25

merged 1 commit into from
Jul 22, 2024

Conversation

casper-hansen
Copy link
Owner

No description provided.

@casper-hansen casper-hansen merged commit 3da9d7f into main Jul 22, 2024
@wasertech
Copy link
Contributor

wasertech commented Aug 3, 2024

Hey @casper-hansen,

I have tried to build AWQ kernels on py312 from main since its not prebuilt on pypi yet but I get the following error while doing so.

pip install "git+https://github.com/casper-hansen/AutoAWQ_kernels.git" > awq_kernel_build.logs 2>&1
...
RuntimeError: Error compiling objects for extension

awq_kernel_build.logs can be found here as a gist

Do you want me to open an issue or provide more information?

PS: I've also tried cloning the repo manually and using pip install -e . but the result is the same.

EDIT: Nevermind, my default version of GCC is 14.1.1 which isn't supported by CUDA 12.5. Using GCC 13.3 and Torch 2.4.0 built with CUDA 12.4 (because my installed version of CUDA is 12.5) fixed this issue.
To do so I had to edit lines 8 and 9 of the setup.py file to use g++-13 (in my case - on arch/manjaro) and set requirements on lines 58-60 to torch==2.4.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants