-
Notifications
You must be signed in to change notification settings - Fork 132
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Getting OOM #46
Comments
Same. This didn't use to happen.
|
My case was the bitsandbytes error. Referring to the issue below, using the bitsandbytes==0.37.2 version, the problem does not occur. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Training on T4:
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 44.00 MiB (GPU 0; 14.56 GiB total capacity; 13.25 GiB already allocated; 10.44 MiB free; 13.83 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
I suspect a change of verisons in peft or transformers ... Does it make sense ?
The text was updated successfully, but these errors were encountered: