Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

[ACUTE] Add Knowledge Question #4416

Merged
merged 1 commit into from
Mar 14, 2022
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions parlai/crowdsourcing/tasks/acute_eval/fast_eval.py
Original file line number Diff line number Diff line change
Expand Up @@ -77,6 +77,11 @@
"s1_choice": "<Speaker 1> talks about the image better",
"s2_choice": "<Speaker 2> talks about the image better",
},
'knowledge': {
'question': 'If you had to say that one speaker is more knowledgeable and one is more ignorant, who is more knowledgeable?',
's1_choice': '<Speaker 1> is more knowledgeable',
's2_choice': '<Speaker 2> is more knowledgeable',
},
}


Expand Down