-
-
Notifications
You must be signed in to change notification settings - Fork 729
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add timepicker helper with added expectation to reduce flakiness #13029
Add timepicker helper with added expectation to reduce flakiness #13029
Conversation
0a6892e
to
203ddf7
Compare
0005079
to
4163b33
Compare
It makes it easier to understand. It didn't improve stability.
4163b33
to
c1f8d30
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This may still fail if CI is having a bad day and is very slow but then we can just increase the sleep time. It's only a fraction of a second and not noticeable by a human at the moment.
# 50ms -> 87% success | ||
# 100ms -> 100% success in 112 runs | ||
# Let's double that to reduce flakiness even further. | ||
sleep 0.2 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It'd be great if we could find an expectation for when Flatpickr has updated. But in the meantime this is a very reasonable fix!
Thank for fixing this, I hope this is the last we see of it! |
I changed the CI script to run only the one test case. The existing matrix for Knapsack ran that 14 times. Example: I then created an empty commit locally and pushed to Github. That triggered 14 runs in my repo on the branch and 14 in the OFN repo on the pull request. That's 28 in total. I repeated that a few times and I easily got to 100 hundred. In the end, I removed the commit above, I could have reverted it for transparency. |
What? Why?
What should we test?
Release notes
Changelog Category (reviewers may add a label for the release notes):
The title of the pull request will be included in the release notes.
Dependencies
Documentation updates