You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
privateconststringWorkFlowComment=@"Please use this workflow to address this flaky test issue, including checking applicable checkboxes and filling in the applicable ""TODO"" entries:
48
-
49
-
* Is this actually a flaky test?
50
-
* No, this is a regular test failure, fix the test/product (TODO: Link to commit/PR)
51
-
* Yes, proceed below...
52
-
53
-
* Is this test failure caused by product code flakiness? (Either this product, or another product this test depends on.)
54
-
* [ ] File a bug against the product (TODO: Link to other bug)
55
-
* Is it possible to change the test to avoid the flakiness?
56
-
* Yes? Go to the ""Change the test!"" section.
57
-
* No?
58
-
* [ ] Disable the test (TODO: Link to PR/commit)
59
-
* [ ] Wait for other bug to be resolved
60
-
* [ ] Wait for us to get build that has the fix
61
-
* [ ] Re-enable our test (TODO: Link to PR/commit)
62
-
* [ ] Close this bug
63
-
64
-
* Is it that the test itself is flaky? This includes external transient problems (e.g. remote server problems, file system race condition, etc.)
65
-
* Is there is a way to change our test to avoid this flakiness?
66
-
* Yes? Change the test!
67
-
* [ ] Change the test to avoid the flakiness, for example by using a different test strategy, or by adding retries w/ timeouts (TODO: Link to PR/commit)
68
-
* [ ] Run the test 100 times locally as a sanity check.
69
-
* [ ] Close this bug
70
-
* No?
71
-
* Is there any logging or extra information that we could add to make this more diagnosable when it happens again?
72
-
* Yes?
73
-
* [ ] Add the logging (TODO: Link to PR/commit)
74
-
* No?
75
-
* [ ] Delete the test because flaky tests are not useful (TODO: Link to PR/commit)";
0 commit comments