Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Winogrande task #996

Merged
merged 10 commits into from
Feb 3, 2020
Merged

Winogrande task #996

merged 10 commits into from
Feb 3, 2020

Conversation

HaokunLiu
Copy link
Member

@HaokunLiu HaokunLiu commented Jan 27, 2020

This PR adds Winogrande v1.1 beta task.
Reported dev set acc. for XL training size using roberta-large 0.793
dev set acc. (batch size = 4, dropout and lr as shown below) from our implementation

  dropout=0.2 dropout=0.1
lr=2e-5 0.515 0.517
lr=1e-5 0.513 0.528
lr=5e-6 0.791 0.791
lr=3e-6 0.526 0.800

@sleepinyourhat
Copy link
Contributor

Neat, thanks! @pyeres, mind taking this on?

@pep8speaks
Copy link

Hello @HaokunLiu! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

Line 2729:99: W291 trailing whitespace

You can repair most issues by installing black and running: black -l 100 ./*. If you contribute often, have a look at the 'Contributing' section of the README for instructions on doing this automatically.

Copy link
Contributor

@pyeres pyeres left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@pyeres pyeres merged commit 4666ed5 into master Feb 3, 2020
@pyeres pyeres deleted the winogrande branch February 3, 2020 23:43
phu-pmh pushed a commit that referenced this pull request Apr 17, 2020
add winogrande
@jeswan jeswan added the jiant-v1-legacy Relevant to versions <= v1.3.2 label Sep 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
jiant-v1-legacy Relevant to versions <= v1.3.2
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants