[META] Run integ tests with every build of OpenSearch and OpenSearch Dashboards and publish test results

[dblock]

Is your feature request related to a problem? Please describe

Coming from #123, the CI workflow produces builds. Next, run integ tests and publish test results.

Describe the solution you'd like

• Added Test Publisher #464
• Determine the correct parameters to run an integration test locally, see [RELEASE] Release version 1.2.2 #1333 (comment)
• Update the existing workflow as a new jenkins workflow off of jenkins/opensearch called integ-test.jenkinsfile that spins up a node of arm/x64 arch and then runs the tests against it
  • Build the test execution logic into the existing src/var/...groovy files, jenkins file should be
• Update the opensearch\distribution.jenkinsfile workflow to trigger the integration tests
  • After the build is complete the pipeline triggers a test pipeline
  • The test pipeline gets all information needed to spin up test workers
  • The test pipeline triggers notifications on success/failure that are actionable
  • Links to the test publisher results are consumable by receivers of the notification
• [META] After tests are complete there should be a test-run manifest that allows for finding all related test artifacts #1274
• Support integTests for OpenSearch core in OpenSearch integ-test workflow OpenSearch#1768
• Dockerize integration testing #202
• Automate integration tests for OpenSearch Dashboards #704
• [IntegTest] Onboard all plugins into automated integration tests for the distribution #58
• Supporting running integ tests on multiple JDKs #1495
• Parallelize integration testing for plugins

[owaiskazi19]

Test Publisher is covered as a part of #341

[peternied]

@ohltyler Lets have you start with this issue

[abhinavGupta16]

Is this a META issue? It looks like this is holding a lot of issues.

[gaiksaya]

@ohltyler Can you check this and other #124 issue and see if you can combine them into one and close the duplicates?
Thanks!

[ohltyler]

@gaiksaya we have been using this one as the latest meta issue for tracking integ test progress. I'm ok to move the remaining P1 tasks in #124 to this repo but don't have permission to edit the issues.

@dblock can you help add the open tasks from there to this issue, and close out #124?

[ohltyler]

Can I get permissions to edit issues? I'd like to add #1495 to this list

[dblock]

Can I get permissions to edit issues? I'd like to add #1495 to this list

I added it to the list in the meantime.

[peternied]

Can I get permissions to edit issues? I'd like to add #1495 to this list

Done!

[gaiksaya]

Hi @dblock Can you check or update this issue and close if required? We have most of the things. We are running integration tests for all plugins in test manifest as a part of every build now.

[gaiksaya]

Closing this issue! We current have each distribution build triggering the integration and BWC test and publishing results.
Thanks!