-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to identify positive samples and negative samples? #9
Comments
Yes, you are correct.
Yes. I found it to be more intuitive to explain with probability instead of logprobs.... It means the same thing.
We just take the top-5 as positive and the bottom-5 as negative. |
In the paper, it mentions that the score is defined as follow. Is that calculated by summing the logprob of each token of the ground true y conditioned on (e,x)? If that were right, the score would not be between 0 and 1 as shown in the pic. In that case, what is the threshold used for identifying pos&neg samples? Appreciate it!
The text was updated successfully, but these errors were encountered: