Solving flakey integration tests in OpenSearch

[dblock]

Describe the blog post your would like to write

We've inherited at least 27 known flakey integration tests that constantly need to be retried by doing start gradle check's. This blog post will call attention to this problem, highlight how some of these tests are being fixed, e.g. opensearch-project/OpenSearch#2110, and ask for community help.

What is the title of the blog post?

Improving the reliability and predictability of integration tests

Who are the authors?

@jainankitk
@dblock

What is the proposed posting date?

TBD

[andrross]

opensearch-project/OpenSearch#1925 is an example of a non-deterministic test bug that had a simple fix but took a lot of effort to track down

[stockholmux]

Hey @dblock - is fixing the tests part of a campaign? If so what's the timeline on that campaign?

[dblock]

Hey @dblock - is fixing the tests part of a campaign? If so what's the timeline on that campaign?

Not really. This affects OpenSearch Engine and not the entire suite, so this is something the engine team has constantly on its radar because it significantly slows velocity.

[stockholmux]

Sounds interesting @dblock. Let me know when you have a timeline for just the post then.