-
Notifications
You must be signed in to change notification settings - Fork 149
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fine tuning and --evaluation_strategy argument #122
Comments
This error is usually caused by in-complete environement install. Please follow the instruction in |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I'm trying to get fine-tuning working through the 3_sft.sh script but am encountering an error:
I tried commenting out the seqlens_in_batch argument where self.llm.forward() is called and the script will work, but when i try to get the validation scores by setting --evaluation_strategy to something other than "no" I get a bunch of errors related to the dataloader and the dataset 'inputs':
Any suggestions?
The text was updated successfully, but these errors were encountered: