Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_archive.test_roundtrip_archive is flaky #41

Open
jdpage opened this issue Aug 6, 2018 · 0 comments
Open

test_archive.test_roundtrip_archive is flaky #41

jdpage opened this issue Aug 6, 2018 · 0 comments
Labels

Comments

@jdpage
Copy link
Collaborator

jdpage commented Aug 6, 2018

Specifically, it's flaky because sometimes examples generate too slowly, causing Hypothesis to fail it due to not passing health checks. Rerunning the build usually fixes it.

Tried to fix it in 154dde7 by decreasing the maximum example size, but that hasn't worked. At this point I suspect that it's due to using hypothesis' example-generation facilities in a pathological way, which is going to require digging into the docs to see if there's a better way to do it.

To make things worse, re-using the seed that hypothesis gives for reproduction in the error message doesn't always reproduce the error. However, it may result in higher error rates than random seeds, so it's probably a good place to start.

@jdpage jdpage added the bug label Aug 6, 2018
jdpage added a commit that referenced this issue Sep 18, 2018
See #41. Hopefully it won't slow things down too much.
jdpage added a commit that referenced this issue Sep 18, 2018
* Update Pipfile.lock to latest dependencies

* Suppress the too_slow healthcheck for test_roundtrip_archive

See #41. Hopefully it won't slow things down too much.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant