Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GPU Memroy #23

Open
irfanfadhullah opened this issue May 11, 2024 · 2 comments
Open

GPU Memroy #23

irfanfadhullah opened this issue May 11, 2024 · 2 comments

Comments

@irfanfadhullah
Copy link

Hello, I just wondering how manu GPU that we need to run this model?
And is it support quantization method?

@Mikael17125
Copy link

yes, it support quantization, you can modify this part

use_gpu_initialization=True if torch.cuda.is_available() else False,

@PhamQuocHuy1101
Copy link

Hello, and to re-produce model, how many GPU need for training?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants