Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Figure issue about your paper (Figure 4 and Figure 15) #7

Open
MatthewYZhang opened this issue Jun 4, 2023 · 1 comment
Open

Figure issue about your paper (Figure 4 and Figure 15) #7

MatthewYZhang opened this issue Jun 4, 2023 · 1 comment

Comments

@MatthewYZhang
Copy link

Hi,

I am reading your paper and I have noticed that figure 4 and figure 15 are exactly the same. Are they meant to be the same? I believe that figure 4 shows the result of models trained on a different training set rather than OSCAR corpus (because you mentioned in Appendix I that 'To ensure our findings are not dataset-dependent, we train models with the same configurations from Figure 4 on the OSCAR corpus'). I wonder if you placed a wrong figure here.

Appreciate your work! I believe this work will definitely give researchers and engineers more insights when training and developing LLMs.

Matthew

@Muennighoff
Copy link
Collaborator

Muennighoff commented Jun 4, 2023

You're right, thanks a lot for noting! Attached is the correct OSCAR graph. I will update the paper soon.

validation_oscar.pdf

Edit: The paper has been updated :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants