Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

[WizInt OSS] data compiler using Mephisto data browser #4034

Merged
merged 1 commit into from
Sep 22, 2021

Conversation

mojtaba-komeili
Copy link
Contributor

Patch description
Added compile_results.py: It retrieves the Wizard of Internet task's crowdsourced data from Mephisto and stores it in a josn file.

Testing steps
Running the data compiler with a subset of the data in Mephisto.

@mojtaba-komeili mojtaba-komeili changed the title data compiler [WizInt OSS] data compiler using Mephisto data browser Sep 21, 2021
Copy link
Contributor

@EricMichaelSmith EricMichaelSmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah this seems like a reasonable subclassing of AbstractResultsCompiler! No real comments, because this is code going into a projects/ folder, but happy to review anything in more depth if desired :)

@mojtaba-komeili
Copy link
Contributor Author

Yeah this seems like a reasonable subclassing of AbstractResultsCompiler! No real comments, because this is code going into a projects/ folder, but happy to review anything in more depth if desired :)

Thanks Eric. Yeah, this code is not going to be reused very often and I tested it with my data. Its best use might be for having the complete code reproducing the Wizard of Internet dataset and more importantly providing a real world example of using the new AbstractResultsCompiler. At its current state it is perfectly fine for that purpose.

@mojtaba-komeili mojtaba-komeili merged commit edb19d3 into main Sep 22, 2021
@mojtaba-komeili mojtaba-komeili deleted the wizint-data-compile branch September 22, 2021 20:21
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants