[Meta] OpenSearch Dashboards Build / Release Process

[peternied]

With the OpenSearch service distribution being built and validated, our desire is to adopt the same process with the OpenSearch Dashboards.

• Create Dashboards Manifest
  • Create OpenSearch Dashboards 1.1 Distribution #158
• Automation build process
  • Create OpenSearch Dashboards 1.1 Distribution #158
• Add all missing dashboards plugins into the OpenSearch Dashboards manifest #652
• Run OpenSearch Dashboards build in Jenkins #620
  • [Bug]: Distribution builds can have path collisions #669
• Add Jenkins job to pick up Dashboard build Jenkinsfile #624
• Validate the distribution
• Automate new Dashboards versions
• Automate release guidelines for Dashboards and components
• Documentation for release process
• Documentation for onboarding
• Integrate OSD release functional tests into CI process Integrate OpenSearch Dashboards release functional tests into CI process #604
• Automate integration tests for OpenSearch Dashboards #704
• Dashboards automate backwards compatibility tests #705
• Automate performance tests for OpenSearch Dashboards #706
• Record logs when Dashboards plugin integration test fails #1124
• Plugin owners define their variables in docker entrypoint
  • [BUG] Not all dashboards settings (e.g. opensearch_security) can be specified as env vars with dashboards container image #369
• Build snapshot
  • [Enhancement] Dashboards build pipeline on jenkins does not have snapshots builds #1577
• [Code cleanup] Component iteration in test runners #1604

Tenets:

• Always be committing, pull request small(est) functional functions
• High quality delivery, add more ci workflows and unit tests
• Clean roadmap, create issues on everything to to help encourage contributions
• Reproducible, minimize the number of dependencies and data that needs to be passed around the system.

[kavilla]

Can't check off.

Build & bundle: #590
Cleanup & verification: #601

[tianleh]

#604

[dblock]

I checked off the first two boxes, but we still need all the other components to come in and add themselves to check the rest.

[peternied]

Can't check off.

Fixed, @opensearch-project/opensearch-test has access to edit/update issues

[dblock]

Manifest auto-creation is #729.

[tmarkley]

@peternied very minor, but can we be consistent with the OpenSearch Dashboards name?

[peternied]

@kavilla Is this meta issue up to date?

[peternied]

@tianleh @kavilla We have an over arching automation tracking issue, #1361 please let me know if there are other items that you think should be promoted into that tracking issue or this one.

[peternied]

@seraphjiang @kavilla How is this meta issue trending, is it still useful?

[bbarani]

@seraphjiang @kavilla Can you update this META issue with current status?

[tianleh]

For the status of "Integrate OpenSearch Dashboards release functional tests into CI process" #604 , we have finished

1. support running OSD integ test from test.sh
2. onboard all Dashboards plugin teams to the functional test repo
3. run OSD integ test from Jenkins bundle build job

There is a few stability issue when running the Cypress tests from the Jenkins job. We are working with infra team to address these. See the "Fast Followups" section of #604

[bbarani]

@seraphjiang @kavilla Can you update this issue with current status?