Skip to content

Adding GEM Simplification prompts. Includes challenge sets, and add… #740

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

jordiclive
Copy link
Contributor

@jordiclive jordiclive commented Apr 26, 2022

…itional prompts for Turk & ASSET.

May need to download dataset from HF datasets manually.

@jordiclive jordiclive changed the title Adding GEM Simplification prompts. To include challenge sets, and add… Adding GEM Simplification prompts. Includes challenge sets, and add… Apr 26, 2022
@jzf2101 jzf2101 self-requested a review April 26, 2022 22:17
@jzf2101 jzf2101 self-assigned this Apr 26, 2022
@jzf2101 jzf2101 changed the base branch from main to eval-hackathon April 26, 2022 23:30
get rid of Accuracy (Non original task—creates added complications)
Adding Multiple Prompts + PALM , commenting out non-original tasks.
@sebastianGehrmann
Copy link

What's up with all the commented out things here?

@jordiclive
Copy link
Contributor Author

jordiclive commented May 3, 2022

What's up with all the commented out things here?

These were prompts that were based on those already in promptsource for just ASSET. But not for the original task. e.g. "Make the text more verbose". Or "choose which is the simplified sentence A or B".

@jordiclive jordiclive merged commit dfbb18c into bigscience-workshop:eval-hackathon May 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants