Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RELEASE] Release version 2.16.0 #4771

Closed
67 of 74 tasks
github-actions bot opened this issue Jun 13, 2024 · 73 comments
Closed
67 of 74 tasks

[RELEASE] Release version 2.16.0 #4771

github-actions bot opened this issue Jun 13, 2024 · 73 comments

Comments

@github-actions
Copy link
Contributor

github-actions bot commented Jun 13, 2024

Release OpenSearch and OpenSearch Dashboards 2.16.0

I noticed that a manifest was automatically created in manifests/2.16.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria Status Description  Comments
Documentation draft PRs are up and in tech review for all component changes 🟢
Sanity testing is done for all components 🟢
Code coverage has not decreased (all new code has tests) 🟢
Release notes are ready and available for all components 🟢 Missing Release Notes OS and OSD components
Roadmap is up-to-date (information is available to create release highlights) 🟢 2.16.0 Roadmap
Release ticket is cut, and there's a forum post announcing the start of the window 🟢
Any necessary security reviews are complete 🟢

OpenSearch 2.16.0 exit criteria status:

Criteria Status Description  Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions 🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🟢 Coming from PA-RCA Fix in RC6, scan_docker_image.txt
Documentation has been fully reviewed and signed off by the documentation community. 🟢
All integration tests are passing 🟢 Current Status: #4771 (comment) as of 2024/08/07
Release blog is ready 🟢 Related PR's opensearch-project/project-website#3140

OpenSearch-Dashboards 2.16.0 exit criteria status:

Criteria Status Description  Comments
Documentation has been fully reviewed and signed off by the documentation community 🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days 🟢 scan_docker_image.txt
All integration tests are passing 🟢 Current Status: #4771 (comment) of 2024/08/07
Release blog is ready 🟢 Related PR's opensearch-project/project-website#3140

Preparation

Campaigns

Release Branch and Version Increment - Starts 2024/07/19

Feature Freeze - Ends 2024/07/22

  • OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - Ends 2024/07/22 Ends 2024/07/23

Release Candidate Creation and Testing - Starts 2024/07/23 Starts 2024/07/24 after 4PM PDT

Performance testing validation - Starts 2024/07/23

  • Post the benchmark-tests
  • Longevity tests do not show any issues.

Pre Release - 2024/08/05 2024/08/07

Release - 2024/08/05 2024/08/07

Release Checklist.


Release Checklist

Pre-Release activities

Part of the central promotion workflow, Related build link

  • Promote Repos.
      • OS
      • OSD
  • Promote Artifacts.
      • Windows
      • Linux Debian
      • Linux RPM
      • Linux TAR
  • Consolidated Release Notes.

Release activities

Post-Release activities


Post Release

Components

OpenSearch

Component Issues tagged with 2.16.0
opensearch-project/OpenSearch#13547
opensearch-project/common-utils#652
opensearch-project/job-scheduler#627
opensearch-project/security#4318
opensearch-project/k-NN#1690
opensearch-project/geospatial#656
opensearch-project/cross-cluster-replication#1384
opensearch-project/ml-commons#2406
opensearch-project/neural-search#732
opensearch-project/notifications#919
opensearch-project/observability#1827
opensearch-project/reporting#997
opensearch-project/sql#2656
opensearch-project/asynchronous-search#570
opensearch-project/anomaly-detection#1204
opensearch-project/alerting#1545
opensearch-project/security-analytics#1018
opensearch-project/index-management#1170
opensearch-project/performance-analyzer#653
opensearch-project/performance-analyzer-rca#550
opensearch-project/custom-codecs#143
opensearch-project/flow-framework#706
opensearch-project/skills#312

OpenSearch Dashboards

Component Issues tagged with 2.16.0
opensearch-project/OpenSearch-Dashboards#6718
opensearch-project/opensearch-dashboards-functional-test#1269
opensearch-project/dashboards-observability#1820
opensearch-project/dashboards-reporting#352
opensearch-project/dashboards-visualizations#366
opensearch-project/dashboards-query-workbench#322
opensearch-project/dashboards-maps#619
opensearch-project/anomaly-detection-dashboards-plugin#756
opensearch-project/ml-commons-dashboards#327
opensearch-project/index-management-dashboards-plugin#1059
opensearch-project/dashboards-notifications#204
opensearch-project/alerting-dashboards-plugin#948
opensearch-project/security-analytics-dashboards-plugin#1005
opensearch-project/security-dashboards-plugin#1938
opensearch-project/dashboards-search-relevance#393
opensearch-project/dashboards-assistant#189

Documentation

Component Issues tagged with 2.16.0
https://github.com/opensearch-project/documentation-website/
Legend

Symbol Meaning
🟢 On track with overall release
🟡 Missed last milestone
🔴 Missed multiple milestones

Related Issues and PR's

@github-actions github-actions bot added release untriaged Issues that have not yet been triaged v2.16.0 labels Jun 13, 2024
This was referenced Jun 13, 2024
@prudhvigodithi
Copy link
Collaborator

prudhvigodithi commented Aug 5, 2024

RC8 Build and Integration Test Results (Started at 2024/08/5 3:50 PM PST)

Coming from RC8

RC8 OpenSearch 10150 / OpenSearch Dashboards 7858 is ready for your test.

OpenSearch - Build 10150
OpenSearch Dashboards - Build 7858

  • Use the following Docker-Compose to setup a cluster

    docker-compose.yml

      
    version: '3'
    services:
      opensearch-node1:
        image: opensearchstaging/opensearch:2.16.0.10150
        container_name: opensearch-node1
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node1
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
            hard: 65536
        volumes:
          - opensearch-data1:/usr/share/opensearch/data
        ports:
          - 9200:9200
          - 9600:9600 # required for Performance Analyzer
        networks:
          - opensearch-net
      opensearch-node2:
        image: opensearchstaging/opensearch:2.16.0.10150
        container_name: opensearch-node2
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node2
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536
            hard: 65536
        volumes:
          - opensearch-data2:/usr/share/opensearch/data
        networks:
          - opensearch-net
      opensearch-dashboards:
        image: opensearchstaging/opensearch-dashboards:2.16.0.7858
        container_name: opensearch-dashboards
        ports:
          - 5601:5601
        expose:
          - "5601"
        environment:
          OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
        networks:
          - opensearch-net
    volumes:
      opensearch-data1:
      opensearch-data2:
    

    networks:
    opensearch-net:

    • Download the above docker-compose.yml on your machine.
    • Get latest image versions docker-compose pull.
    • Start the cluster docker-compose up.
  • OpenSearch docker 2.16.0.10150

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch:2.16.0.10150 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.16.0.10150
      • Connect command curl http://localhost:9200/
    • Start with security
      • Docker command
      docker pull opensearchstaging/opensearch:2.16.0.10150 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' opensearchstaging/opensearch:2.16.0.10150
      
      • Connect command curl --insecure 'https://admin:myStrongPassword123!@localhost:9200/'
  • OpenSearch-Dashboards docker 2.16.0.7858

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:2.16.0.7858 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.16.0.7858
      • URL http://localhost:5601/
    • Start with security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:2.16.0.7858 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.16.0.7858
      • URL http://localhost:5601/
  • Use TARs to deploy OpenSearch Manually

Check how to install opensearch and dashboards on different platforms

Integration Test Results

  • For the detailed integration test failures for RC7, OpenSearch Dashboards (7858) Use this Metrics Dashboard Link.

  • For thethe detailed integration test failures for RC8, OpenSearch (10150) Use this Metrics Dashboard Link.

Screenshot 2024-08-05 at 4 05 09 PM

Note: For the index-management failure the re-try build passed, Dashboard looks green as well.

Thank you

@prudhvigodithi
Copy link
Collaborator

prudhvigodithi commented Aug 6, 2024

Current Release Status: 2024/08/06

Thank you

@prudhvigodithi
Copy link
Collaborator

prudhvigodithi commented Aug 6, 2024

Release Update (2024/08/06)

Based on the votes from GO/NO-GO voting call it is a NO-GO for 2.16 today. The current blocker identified is the Manual Sign-off for the Alerting Plugin.The decision from the meeting was to delay the release by one day, setting the new target release date for OS 2.16 to August 7th 2024.
Thank you

@prudhvigodithi
Copy link
Collaborator

prudhvigodithi commented Aug 6, 2024

@prudhvigodithi
Copy link
Collaborator

prudhvigodithi commented Aug 6, 2024

OpenSearch RC9 2024/08/6 Started at 1:25 PM PST

OS (10154):

Triggered the OpenSearch build with a commit change from alerting, Related PR.
https://build.ci.opensearch.org/blue/organizations/jenkins/distribution-build-opensearch/detail/distribution-build-opensearch/10154/pipeline/

OSD (7858):

Using the same RC7 build for OpenSearch Dashboards as there is no change with components.

Thank you

@prudhvigodithi
Copy link
Collaborator

RC9 Build and Integration Test Results (Started at 2024/08/06 5:00 PM PST)

Coming from RC9

RC9 OpenSearch 10154 / OpenSearch Dashboards 7858 is ready for your test.

OpenSearch - Build 10154
OpenSearch Dashboards - Build 7858

  • Use the following Docker-Compose to setup a cluster

    docker-compose.yml

      
    version: '3'
    services:
      opensearch-node1:
        image: opensearchstaging/opensearch:2.16.0.10154
        container_name: opensearch-node1
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node1
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
            hard: 65536
        volumes:
          - opensearch-data1:/usr/share/opensearch/data
        ports:
          - 9200:9200
          - 9600:9600 # required for Performance Analyzer
        networks:
          - opensearch-net
      opensearch-node2:
        image: opensearchstaging/opensearch:2.16.0.10154
        container_name: opensearch-node2
        environment:
          - cluster.name=opensearch-cluster
          - node.name=opensearch-node2
          - discovery.seed_hosts=opensearch-node1,opensearch-node2
          - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
          - bootstrap.memory_lock=true
          - OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
        ulimits:
          memlock:
            soft: -1
            hard: -1
          nofile:
            soft: 65536
            hard: 65536
        volumes:
          - opensearch-data2:/usr/share/opensearch/data
        networks:
          - opensearch-net
      opensearch-dashboards:
        image: opensearchstaging/opensearch-dashboards:2.16.0.7858
        container_name: opensearch-dashboards
        ports:
          - 5601:5601
        expose:
          - "5601"
        environment:
          OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
        networks:
          - opensearch-net
    volumes:
      opensearch-data1:
      opensearch-data2:
    

    networks:
    opensearch-net:

    • Download the above docker-compose.yml on your machine.
    • Get latest image versions docker-compose pull.
    • Start the cluster docker-compose up.
  • OpenSearch docker 2.16.0.10154

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch:2.16.0.10154 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.16.0.10154
      • Connect command curl http://localhost:9200/
    • Start with security
      • Docker command
      docker pull opensearchstaging/opensearch:2.16.0.10154 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e 'OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!' opensearchstaging/opensearch:2.16.0.10154
      
      • Connect command curl --insecure 'https://admin:myStrongPassword123!@localhost:9200/'
  • OpenSearch-Dashboards docker 2.16.0.7858

    • Start without security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:2.16.0.7858 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.16.0.7858
      • URL http://localhost:5601/
    • Start with security
      • Docker command docker pull opensearchstaging/opensearch-dashboards:2.16.0.7858 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.16.0.7858
      • URL http://localhost:5601/
  • Use TARs to deploy OpenSearch Manually

Check how to install opensearch and dashboards on different platforms

Integration Test Results

Thank you

@prudhvigodithi
Copy link
Collaborator

Current Release Status: 2024/08/07

Thank you

@prudhvigodithi
Copy link
Collaborator

Release Update (2024/08/07)

Thanks everyone for joining the call, based on the votes from GO/NO-GO voting call it is a GO for 2.16 release today. During the meeting we discussed the concerns on CCR Plugin integration tests due to current hard limitation on how rpm/deb runs, posted the same details on the status comment. More details on this topic opensearch-project/cross-cluster-replication#1414 (comment).

The following report is download from Metrics Dashboard .

On_demand_report_2024-08-07T16_18_01 583Z_9e36b7f0-54d8-11ef-9edd-77ed1f54fbda

Thank you

@prudhvigodithi
Copy link
Collaborator

prudhvigodithi commented Aug 7, 2024

Release Update (2024/08/07)

Started the Central Promotion Workflow (Started at ~2:00 PM PST):

https://build.ci.opensearch.org/blue/organizations/jenkins/central-release-promotion/detail/central-release-promotion/11/pipeline/

Docker and ECR validation results

`Pulling public.ecr.aws/opensearchproject/opensearch:2.16.0 from the ecr
2024-08-07 15:35:26 INFO     Image is pulled at local : sha256:85073dd56eee37daea3fcca9b73760320bb937545877883067ecfe97d6433003
 : public.ecr.aws/opensearchproject/opensearch : 2.16.0
2024-08-07 15:35:26 INFO     Image does not exist at local, proceed with Pull from the ecr
2024-08-07 15:35:26 INFO     Pulling public.ecr.aws/opensearchproject/opensearch-dashboards:2.16.0 from the ecr
2024-08-07 15:35:26 INFO     Image is pulled at local : sha256:c8825d47a3634040043f5a95cb30a97d326d37cce0dd586234f3f244e2906d4e`

`Pulling opensearchproject/opensearch:2.16.0 from the dockerhub
2024-08-07 15:31:39 INFO     Image is pulled at local : sha256:85073dd56eee37daea3fcca9b73760320bb937545877883067ecfe97d6433003
 : opensearchproject/opensearch : 2.16.0
2024-08-07 15:31:39 INFO     Image does not exist at local, proceed with Pull from the dockerhub
2024-08-07 15:31:39 INFO     Pulling opensearchproject/opensearch-dashboards:2.16.0 from the dockerhub
2024-08-07 15:33:24 INFO     Image is pulled at local : sha256:c8825d47a3634040043f5a95cb30a97d326d37cce0dd586234f3f244e2906d4e`

` Fetching mainfest from DockerHub
2024-08-07 15:35:27 INFO     "sha256:bd8c6fae35754f0fbb8fd83f30b7aa6e15b3a3a80d413f9ec9ca8abd3a4166e4" <-- DockerHub image repon digest opensearchstaging/opensearch:2.16.0
2024-08-07 15:35:27 INFO     Fetching mainfest from local
2024-08-07 15:35:27 INFO     "sha256:bd8c6fae35754f0fbb8fd83f30b7aa6e15b3a3a80d413f9ec9ca8abd3a4166e4" <-- local image repo digest opensearchproject/opensearch:2.16.0
2024-08-07 15:35:27 INFO     Fetching access token from dockerHub
2024-08-07 15:35:27 INFO     Fetching mainfest from DockerHub
2024-08-07 15:35:28 INFO     "sha256:bc7732427d5988e819be7329e26ba222fcfda1edeae54412724ab9e2b09b2b64" <-- DockerHub image repon digest opensearchstaging/opensearch-dashboards:2.16.0
2024-08-07 15:35:28 INFO     Fetching mainfest from local
2024-08-07 15:35:28 INFO     "sha256:bc7732427d5988e819be7329e26ba222fcfda1edeae54412724ab9e2b09b2b64" <-- local image repo digest opensearchproject/opensearch-dashboards:2.16.0
2024-08-07 15:35:28 INFO     Image digest is validated.

Maven Promotion (Started at ~3:10 PM PST):

https://build.ci.opensearch.org/job/publish-to-maven/37/console

Release Tag Creation (Started at ~3:10 PM PST):

OpenSearch: https://build.ci.opensearch.org/job/distribution-release-tag-creation/115/console
OpenSearch Dashboards: https://build.ci.opensearch.org/job/distribution-release-tag-creation/116/console

Manifests Update to Tags: (Started at ~3:15 PM PST):

Related Workflow: https://build.ci.opensearch.org/job/release-manifest-commit-lock/49/
Related PR: #4928

@prudhvigodithi
Copy link
Collaborator

The release process is now complete and the OpenSearch 2.16.0 has been released to the public! 🎉
A big thank you to all the maintainers, contributors, and everyone who participated in this release and made it successful!

@prudhvigodithi
Copy link
Collaborator

Hi All,
Thank you for all your support on the 2.16.0 release. We have a retrospective meeting today (August 13th 2024 - 9:00AM PDT). I’ve added some discussion points to the retro board, which can be accessed here. Please feel free to review and contribute additional items based on the release.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ✅ Done
Development

No branches or pull requests