Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

[BB2] BlenderBot FiD agent that uses Wizard of Internet's original retrieved docs #4163

Merged
merged 3 commits into from
Nov 12, 2021

Conversation

mojtaba-komeili
Copy link
Contributor

Patch description

BlenderBot 2 FiD model with gold retrieved documents (documents that were shown to the crowdsourcing agents during data collection). It uses the ObservationEchoRetriever retriever for reading the observed messages from the content of the message from the Wizard of Internet teacher.

Test

Running a few steps of training

parlai train -t wizard_of_internet \
--model projects.blenderbot2.agents.blenderbot2:BlenderBot2WizIntGoldDocRetrieverFiDAgent \
--batchsize 4 --dict-file zoo:blender/reddit_3B/model.dict -tr 32

Screen Shot 2021-11-11 at 1 21 01 PM

Note

  • There was a nit change on the wizard of internet task for consistency.
  • Training with this agent doesn't require using search engine.
  • This knowledge retriever part of this agent only works with Wizard of Internet dataset, or any dataset that has similar messages (the content under knowledge component keys).

@mojtaba-komeili mojtaba-komeili merged commit 1874977 into main Nov 12, 2021
@mojtaba-komeili mojtaba-komeili deleted the bb2-gold-retrieved branch November 12, 2021 03:42
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants