Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

为什么在跑rlhf过程中既没有报错也没输出rlhf结果 #10

Open
qilele00 opened this issue Sep 18, 2024 · 7 comments
Open

为什么在跑rlhf过程中既没有报错也没输出rlhf结果 #10

qilele00 opened this issue Sep 18, 2024 · 7 comments

Comments

@qilele00
Copy link

No description provided.

@AI-Study-Han
Copy link
Owner

有打印日志吗

@qilele00
Copy link
Author

qilele00 commented Sep 19, 2024 via email

@qilele00
Copy link
Author

qilele00 commented Sep 19, 2024 via email

@AI-Study-Han
Copy link
Owner

你可以看看显卡的显存和计算核心有没有用起来，国产卡我就不太了解了……

@qilele00
Copy link
Author

qilele00 commented Sep 19, 2024 via email

@qilele00
Copy link
Author

qilele00 commented Sep 19, 2024 via email

@AI-Study-Han
Copy link
Owner

我就是看是占了一部分显存，但是卡的利用率全是零，所以说任务根本没跑起来，哎国产卡适配到nvidia A100系列那个程度不知何时才可以；咱们这个任务量单跑一个rlhf大概需要大多显存
…
-----原始邮件----- 发件人:MultimodalHan @.> 发送时间:2024-09-19 09:25:16 (星期四) 收件人: AI-Study-Han/Zero-Chatgpt @.> 抄送: qilele00 @.>, Author @.> 主题: Re: [AI-Study-Han/Zero-Chatgpt] 为什么在跑rlhf过程中既没有报错也没输出rlhf结果 (Issue #10) 你可以看看显卡的显存和计算核心有没有用起来，国产卡我就不太了解了…… — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

我记得大概是60G左右

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@AI-Study-Han @qilele00