You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Although the linkcheck builder unit tests pass fairly reliably in the GitHub Actions continuous integration we have configured, they are less reliable when run using a random unit test ordering.
Ideally unit tests should be able to run independently of each other; as reported in #11285, we do have some side-effects within our test suite, and it is possible that side-effects are a factor here too.
Describe the bug
Although the
linkcheck
builder unit tests pass fairly reliably in the GitHub Actions continuous integration we have configured, they are less reliable when run using a random unit test ordering.Ideally unit tests should be able to run independently of each other; as reported in #11285, we do have some side-effects within our test suite, and it is possible that side-effects are a factor here too.
How to Reproduce
Using the
pytest-randomly
plugin is a straightforward way to replicate this problem.From a checkout of bf0bec3 I'm able to see the problem occur fairly reliably with
pytest==8.1.1
andpytest-randomly==3.15.0
by running:Environment Information
Sphinx extensions
Additional context
No response
The text was updated successfully, but these errors were encountered: