-
Notifications
You must be signed in to change notification settings - Fork 2.1k
[Empathetic Dialogues] Switch to DialogTeacher #4405
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
very nice! great cleanup and faster to boot!
experiencer_text_dialogue, responder_text_dialogue | ||
) | ||
|
||
for episode in data: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
in an ideal world we would make this entire function an iterator that didn't explicitly load data into memory, which speeds up parlai dd
and lowers peak memory usage.
it's fine for this PR
Make sure you merge in master to get the fixes to CI, and check |
Co-authored-by: Stephen Roller <roller@fb.com>
Co-authored-by: Stephen Roller <roller@fb.com>
…lAI into ed-teacher-overhaul
Good point, checked |
|
||
|
||
class EmpatheticDialoguesTeacher(FixedDialogTeacher): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ImportError: cannot import name 'EmpatheticDialoguesTeacher' from 'parlai.core.teachers'
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you paste the command that gives that error?
Patch description
DialogTeacher
to allow for efficient eval of this dataset in distributed modeMessage
keysEDPersonaTopicifierTeacher
, a version of EmpatheticDialogues that includes personas, over toDialogTeacher
Testing steps
pytest tests/tasks/test_empathetic_dialogues.py
pytest parlai/tasks/empathetic_dialogues/test.py
pytest parlai/tasks/blended_skill_talk/test.py
pytest tests/tasks/test_style_gen_teachers.py
parlai dd -t empathetic_dialogues -v
andparlai dd -t parlai.tasks.blended_skill_talk.agents:EDPersonaTopicifierTeacher
before and after this PR