Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A question about the reported performance without task alignment #11

Open
pkuxmq opened this issue Sep 9, 2024 · 0 comments
Open

A question about the reported performance without task alignment #11

pkuxmq opened this issue Sep 9, 2024 · 0 comments

Comments

@pkuxmq
Copy link

pkuxmq commented Sep 9, 2024

Hi, I note that in Table 1, the performance on SST2 without task alignment is 79.2, but in the original MeZO paper, the performance is 51.9 (almost random, i.e., the model can hardly be trained). Why the reported number is much higher in this paper?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant