Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

load_in_8bit=True` requires Accelerate: #1

Open
andsty opened this issue Aug 19, 2023 · 3 comments
Open

load_in_8bit=True` requires Accelerate: #1

andsty opened this issue Aug 19, 2023 · 3 comments

Comments

@andsty
Copy link

andsty commented Aug 19, 2023

ImportError: Using load_in_8bit=True requires Accelerate: pip install accelerate and the latest version of bitsandbytes pip install -i https://test.pypi.org/simple/ bitsandbytes or pip install bitsandbytes`
Any help is apprecoated

@andsty andsty changed the title Error on Tokenizer load_in_8bit=True` requires Accelerate: Aug 20, 2023
@andsty
Copy link
Author

andsty commented Aug 20, 2023

I have everything installed

@vvhanxing
Copy link

I have everything installed
I meet this error too,even though i install every thing include accelerate and bitsandbytes

@yruslan
Copy link

yruslan commented Oct 10, 2023

Downgrading transformers (from this SO answer https://stackoverflow.com/a/76976563/1038282) helped solve the issue:

pip install transformers==4.30

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants