Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

想问一下,想在Chinese-LLaMA-7B基础上继续指令微调,是用finetune.py吗,因为我看inference_hf.py只是推理,没有loss反向传播,梯度下降的部分 #1

Open
hangzeli08 opened this issue Apr 22, 2023 · 1 comment

Comments

@hangzeli08
Copy link

我看你写的指令微调用的是inference_hf.py,这只是推断啊,它loss不反向传播他怎么微调啊,这个项目支持在Chinese-LLaMA-7B基础上继续指令微调继续指令微调吗,支持断点继续训练吗

@zhangnn520
Copy link
Owner

这就是推理的代码inference_hf.py,微调的不是这个代码,你自己找吧。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants