New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

llama-2-13b的模型用单卡跑lora就会报错 #95

Open

Enoch202 opened this issue Oct 24, 2023 · 1 comment

Enoch202 commented Oct 24, 2023

用单卡跑就会显示“NotImplementedError: Cannot copy out of meta tensor； no data!”
用双卡跑就正常，但是占用显存很大。两张48G的A6000，每张都会占用35G左右

Enoch202 changed the title ~~跑llama-13b的模型用单卡跑lora就会报错~~ 跑llama-2-13b的模型用单卡跑lora就会报错

Enoch202 changed the title ~~跑llama-2-13b的模型用单卡跑lora就会报错~~ llama-2-13b的模型用单卡跑lora就会报错

Owner

jianzhnie commented Dec 8, 2023

试一下用微软的 deepspeed 呢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment