You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The perplexity results can be exactly reproduced by my experiments. However, the accuracies for zero-shot tasks differs from your reported results, sometimes better sometimes worse. A more interesting thing is that when I use a new server to run this code, the accuracies changed. Do you have any idea about this phenomenon?
The text was updated successfully, but these errors were encountered:
The perplexity results can be exactly reproduced by my experiments. However, the accuracies for zero-shot tasks differs from your reported results, sometimes better sometimes worse. A more interesting thing is that when I use a new server to run this code, the accuracies changed. Do you have any idea about this phenomenon?
The text was updated successfully, but these errors were encountered: