Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Onboard distribution level BWC bundle test #787

Open
zelinh opened this issue Jul 17, 2024 · 2 comments
Open

[FEATURE] Onboard distribution level BWC bundle test #787

zelinh opened this issue Jul 17, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@zelinh
Copy link
Member

zelinh commented Jul 17, 2024

Currently asynchronous repo has BWC test on plugin level and only tested within the repo. We have a framework for BWC distribution level test available and you could utilize it and enable distribution level BWC test.

With this framework, you would be able to spin up the test cluster with the latest distribution bundle that engineering effectiveness team generated that installs all the other components. This test will be more comprehensive as it will test the exact product we ship to the customers.

Onboarding this distribution level BWC test can also enable engineering effectiveness team to run BWC tests every time ee team generates a new bundle distribution across each of the plugin through CI

More onboarding info can be found here:
https://github.com/opensearch-project/opensearch-plugins/blob/main/TESTING.md#bwc-tests-on-distribution-bundle-level

What solution would you like?
Similar to what we did to the anomaly-detection plugin. opensearch-project/anomaly-detection#766
Enable bundle level BWC test based on the BWC test you already have.

@dbwiddis
Copy link
Member

@zelinh thanks for this!

We already know we need to improve our BWC, see #710 ... this will probably make that process easier!

@zelinh
Copy link
Member Author

zelinh commented Aug 14, 2024

@dbwiddis Do we have a plan to onboard to this distribution level BWC test? We are planning to add BWC tests as mandatory exit criteria in future releases.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants