Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Static turn annotations analysis test fix #3374

Merged
merged 2 commits into from
Jan 14, 2021

Conversation

EricMichaelSmith
Copy link
Contributor

Patch description
One of today's 4 flaky crowdsourcing tests, visible at https://app.circleci.com/pipelines/github/facebookresearch/ParlAI/8401/workflows/fc283fc3-a00e-4bbf-b816-e407f67f03b5/jobs/68298/steps , occurred when some progress bar appended itself to the actual stdout, meaning that one of the expected lines of output was not an exact match to any of the actual stdout lines. This fix softens that check to just make sure that all of the expected output lines are at least substrings of the actual stdout lines.

Testing steps
pytest tests/crowdsourcing/tasks/turn_annotations_static/test_turn_annotations_static_analysis.py

Copy link
Contributor

@JackUrb JackUrb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@EricMichaelSmith EricMichaelSmith merged commit d5de5b8 into master Jan 14, 2021
@EricMichaelSmith EricMichaelSmith deleted the friendlier-analysis-test branch January 14, 2021 17:54
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants