Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Refactor analysis for per turn eval #3780

Merged
merged 8 commits into from
Jul 15, 2021

Conversation

mus1cholic
Copy link
Contributor

Patch description
Refactors code for processing left_pane_text so code injections can be made on other crowdsourcing tasks

Testing steps
See CircleCI tests

Copy link
Contributor

@EricMichaelSmith EricMichaelSmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Orion! This is a great idea - but I think there's a slightly different setup that will lead to even less code-reuse :)

parlai/crowdsourcing/tasks/model_chat/conf/example.yaml Outdated Show resolved Hide resolved
@@ -253,6 +251,11 @@ def __init__(
}
)

def process_left_pane_text(self, args: "DictConfig") -> str:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm, honestly, I think that these 3 lines of code will probably be the same for all subclasses of model_chat, meaning that the lines will need to get repeated in all subclasses. I think it'll lead to less duplicated code if, instead, there's a method called something like format_left_pane_text(), which you just define as pass for this superclass

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Resolved

@@ -1,2 +1,3 @@
blender_90M: >
--model-file zoo:blender/blender_90M/model

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: extra space

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Resolved

Copy link
Contributor

@stephenroller stephenroller left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I concur with Eric's comments

Copy link
Contributor

@EricMichaelSmith EricMichaelSmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks! But make sure to wait until all CI checks pass before merging in :)

@mus1cholic
Copy link
Contributor Author

CI tests passed, merging in now

@mus1cholic mus1cholic merged commit d17e512 into master Jul 15, 2021
@mus1cholic mus1cholic deleted the refactor-analysis-for-per-turn-eval branch July 15, 2021 19:36
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants