New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

indices should be either on cpu or on the same device as the indexed tensor (cpu) #508

Open

zzisbeauty opened this issue Sep 11, 2023 · 0 comments

zzisbeauty commented Sep 11, 2023 •

edited

Loading

标题的错误出现的代码文件：train/src/models/llama/modeling_llama.py
出错行：cos = cos[position_ids].unsqueeze(1)

请问这是什么问题；使用的 lora 微调，单机3 4090卡

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment