Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[RELEASE] Release version 2.9.0 #3616

Closed
26 of 42 tasks
github-actions bot opened this issue Jun 10, 2023 · 44 comments
Closed
26 of 42 tasks

[RELEASE] Release version 2.9.0 #3616

github-actions bot opened this issue Jun 10, 2023 · 44 comments
Assignees
@prudhvigodithi @peterzhuamazon
Labels
release v2.9.0

Comments

@github-actions
Copy link
Contributor

github-actions bot commented Jun 10, 2023 •
edited by prudhvigodithi
Loading

Release OpenSearch and OpenSearch Dashboards 2.9.0

I noticed that a manifest was automatically created in manifests/2.9.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. More details are included in the Maintainers Release owner section.

Release Steps

There are several steps to the release process, these steps are completed as the whole release and components that are behind present risk to the release. The release owner completes the tasks in this ticket, whereas component owners resolve tasks on their ticket in their repositories.

Steps have completion dates for coordinating efforts between the components of a release; components can start as soon as they are ready far in advance of a future release.

Component List

To aid in understanding the state of the release there is a table with status indicating each component state. This is updated based on the status of the component issues.

Preparation

  • Assign this issue to a release owner.
  • Declare a pencils down date for new features to be merged.
  • REPLACE_RELEASE-minus-14-days is pencils down date for feature freeze.
  • Update the Campaigns section to include monitoring campaigns during this release.
  • Update this issue so all __REPLACE_RELEASE-__ placeholders have actual dates.
  • Document any new quality requirements or changes.
  • Finalize scope and feature set and update the Public Roadmap.
  • Create a release issue in every component repo based on component release issue template and link back to this issue, update Components section with these links.
  • Ensure the label is created in each component repo for this new version, and the next minor release. Create a version label
  • Ensure that all release issues created above are assigned to an owner in the component team.
  • Increase the build frequency for the this release from once a day (H 1 * * *) to once every hour (H/60 * * * *) in jenkinsFile.

Campaigns

REPLACE with OpenSearch wide initiatives to improve quality and consistency.

Release Branch - July 10 2023

  • Component versions are auto-incremented to 2.9.0 version.
  • Plugins team to ensure working CI in component repositories and merge the version increment PRs.
  • OpenSearch / OpenSearch-Dashboards core cut branch <MajorVersion>.<MinorVersion> early.
  • All component repos create <MajorVersion>.<MinorVersion> branch for the release.

Feature Freeze - Ends - July 11 2023

Code Complete - _Ends _ - July 11 2023

Release testing - July 12 2023 - July 14 2023 End of July 18, 2023

  • Declare a release candidate build, and provide the instructions with the release candidates for teams on testing
  • Stop builds for this version of OpenSearch and/or OpenSearch Dashboards in order to avoid accidental commits going in unknowingly. Restart only if necessary else manually run the build workflow and declare new release candidate.
  • After generate the release candidates, raise PR to lock input manifest refs of both OS and OSD builds with the commit ids from distribution manifest of the release candidates.
  • Sanity Testing : Sanity testing and fixing of critical issues found by teams. Teams test their components within the distribution, ensuring integration, backwards compatibility, and perf tests pass.
  • Publish all test results in the comments of this issue.

Performance testing validation - July 13 2023 - July 14 2023 End of July 19, 2023

  • Performance tests do not show a regression.
  • Longevity tests do not show any issues.

Release - July 18 2023 End of July 20, 2023 July 24th 2023 at 11.30 am PT

Post Release - July 18 2023 End of July 20, 2023 End of July 24th 2023

  • Create release tags for each component (Jenkins job name: release-tag-creation).
  • Replace refs in manifests/2.9.0 with tags and remove checks.
  • If this is a major or minor version release, stop building previous patch version.
  • Generate distribution release notes reviewed by PM team for opensearch-build repository.
  • Increment version for Helm Charts (sample PR) for the 2.9.0 release.
  • Increment version for Ansible Charts (sample PR) for the 2.9.0 release.
  • Prepare for next patch release by incrementing patch versions for each component.
  • Update this template with any new or missed steps.
  • Create an issue for a retrospective, solicit feedback, and publish a summary.

Documentation Issues

Components

GitHub issue custom search

OpenSearch

Component Issues tagged with 2.9.0
opensearch-project/OpenSearch#8417
opensearch-project/OpenSearch-Dashboards#4486
opensearch-project/common-utils#467
opensearch-project/k-NN#944
opensearch-project/geospatial#344
opensearch-project/security#2907
opensearch-project/cross-cluster-replication#1005
opensearch-project/ml-commons#1020
opensearch-project/neural-search#203
opensearch-project/notifications#695
opensearch-project/observability#1558
opensearch-project/reporting#717
opensearch-project/sql#1786
opensearch-project/asynchronous-search#299
opensearch-project/anomaly-detection#934
opensearch-project/alerting#972
opensearch-project/security-analytics#471
opensearch-project/index-management#826
opensearch-project/performance-analyzer#488

OpenSearch Dashboards

Component Issues tagged with 2.9.0
opensearch-project/OpenSearch-Dashboards#4486
opensearch-project/opensearch-dashboards-functional-test#732
opensearch-project/dashboards-observability#579
opensearch-project/dashboards-reporting#130
opensearch-project/dashboards-visualizations#193
opensearch-project/dashboards-query-workbench#86
opensearch-project/dashboards-maps#427
opensearch-project/anomaly-detection-dashboards-plugin#517
opensearch-project/ml-commons-dashboards#223
opensearch-project/index-management-dashboards-plugin#796
opensearch-project/dashboards-notifications#62
opensearch-project/alerting-dashboards-plugin#584
opensearch-project/security-analytics-dashboards-plugin#637
opensearch-project/security-dashboards-plugin#1489
opensearch-project/dashboards-search-relevance#225
Legend

Symbol Meaning
🟢 On track with overall release
🟡 Missed last milestone
🔴 Missed multiple milestones

@github-actions github-actions bot added release untriaged Issues that have not yet been triaged v2.9.0 labels Jun 10, 2023
@gaiksaya gaiksaya removed the untriaged Issues that have not yet been triaged label Jun 19, 2023
@gaiksaya gaiksaya mentioned this issue Jun 21, 2023
Merged
@peterzhuamazon peterzhuamazon self-assigned this Jun 22, 2023
@peterzhuamazon peterzhuamazon moved this from Backlog to In Progress in OpenSearch Engineering Effectiveness Jun 22, 2023
@peterzhuamazon peterzhuamazon mentioned this issue Jun 22, 2023
Merged
@peterzhuamazon
Copy link
Member

peterzhuamazon commented Jun 22, 2023 •
edited
Loading

Status Updates:

Campaigns:

Issues:

PRs:

@prudhvigodithi
Copy link
Member

Thanks @peterzhuamazon I will keep editing your comment as we go through the release.

@prudhvigodithi prudhvigodithi mentioned this issue Jun 27, 2023
Merged
@gaiksaya gaiksaya mentioned this issue Jun 30, 2023
Merged
This was referenced Jul 3, 2023
Closed
Closed
Closed
@MaxKsyunz MaxKsyunz mentioned this issue Jul 5, 2023
Closed
23 tasks
@gaiksaya gaiksaya pinned this issue Jul 6, 2023
This was referenced Jul 6, 2023
Merged
Merged
Closed
Closed
Closed
Closed
Closed
Closed
Closed
@prudhvigodithi prudhvigodithi mentioned this issue Jul 20, 2023
Merged
This was referenced Jul 19, 2023
Merged
Merged
@prudhvigodithi
Copy link
Member

prudhvigodithi commented Jul 20, 2023 •
edited
Loading

We have a PR out for OSD that we will backport to 2.9 and is needed for the 2.9 release.
Additionally, we are going to have another fix in related to this for Alerting Dashboards plugin and Anomaly Detection Dashboards plugin. These fixes are very isolated and would not affect other plugins.

New OSD RC 6391 generated on 07/20/2023, the OS RC is still the same as the build 8184

OSD: https://build.ci.opensearch.org/blue/organizations/jenkins/distribution-build-opensearch-dashboards/detail/distribution-build-opensearch-dashboards/6391/

Integ:

Tar arm64

2023-07-20 17:09:16 INFO     | OpenSearch-Dashboards | without-security     | PASS  |
2023-07-20 17:43:53 ERROR    | alertingDashboards   | with-security        | FAIL  |
2023-07-20 17:43:53 ERROR    | alertingDashboards   | without-security     | FAIL  |
2023-07-20 16:46:56 ERROR    | queryWorkbenchDashboards | with-security        | FAIL  |
2023-07-20 16:46:56 ERROR    | queryWorkbenchDashboards | without-security     | FAIL  |
2023-07-20 17:48:03 ERROR    | securityAnalyticsDashboards | with-security        | FAIL  |
2023-07-20 17:48:03 ERROR    | securityAnalyticsDashboards | without-security     | FAIL  |

Tar x64

2023-07-20 17:23:01 ERROR    | alertingDashboards   | with-security        | FAIL  |
2023-07-20 17:23:01 ERROR    | alertingDashboards   | without-security     | FAIL  |
2023-07-20 17:03:20 ERROR    | observabilityDashboards | with-security        | FAIL  |
2023-07-20 17:03:20 ERROR    | observabilityDashboards | without-security     | FAIL  |
2023-07-20 16:42:49 ERROR    | queryWorkbenchDashboards | with-security        | FAIL  |
2023-07-20 16:42:49 ERROR    | queryWorkbenchDashboards | without-security     | FAIL  |
2023-07-20 17:00:35 ERROR    | reportsDashboards    | without-security     | FAIL  |
2023-07-20 17:32:26 ERROR    | securityAnalyticsDashboards | with-security        | FAIL  |
2023-07-20 17:32:26 ERROR    | securityAnalyticsDashboards | without-security     | FAIL  |

RPM arm64:

2023-07-20 18:22:32 ERROR    | OpenSearch-Dashboards | with-security        | FAIL  |
2023-07-20 18:56:57 ERROR    | alertingDashboards   | with-security        | FAIL  |
2023-07-20 18:56:57 ERROR    | alertingDashboards   | without-security     | FAIL  |
2023-07-20 18:09:19 ERROR    | notificationsDashboards | without-security     | FAIL  |
2023-07-20 18:23:04 ERROR    | observabilityDashboards | with-security        | FAIL  |
2023-07-20 17:59:56 ERROR    | queryWorkbenchDashboards | with-security        | FAIL  |
2023-07-20 17:59:56 ERROR    | queryWorkbenchDashboards | without-security     | FAIL  |
2023-07-20 18:59:00 ERROR    | securityAnalyticsDashboards | with-security        | FAIL  |
2023-07-20 18:59:00 ERROR    | securityAnalyticsDashboards | without-security     | FAIL  |

RPM x64:

2023-07-20 18:36:58 ERROR    | alertingDashboards   | with-security        | FAIL  |
2023-07-20 18:36:58 ERROR    | alertingDashboards   | without-security     | FAIL  |
2023-07-20 18:04:19 ERROR    | customImportMapDashboards | with-security        | FAIL  |
2023-07-20 18:05:49 ERROR    | notificationsDashboards | without-security     | FAIL  |
2023-07-20 17:58:35 ERROR    | queryWorkbenchDashboards | with-security        | FAIL  |
2023-07-20 17:58:35 ERROR    | queryWorkbenchDashboards | without-security     | FAIL  |
2023-07-20 18:16:36 ERROR    | reportsDashboards    | without-security     | FAIL  |
2023-07-20 18:45:59 ERROR    | securityAnalyticsDashboards | with-security        | FAIL  |
2023-07-20 18:45:59 ERROR    | securityAnalyticsDashboards | without-security     | FAIL  |

@peterzhuamazon
Copy link
Member

Windows OSD Test failures on RC3:

alertingDashboards

@lezzago
Copy link
Member

lezzago commented Jul 20, 2023

Signing off alertingDashboards and securityAnalyticsDashboards to green.

@prudhvigodithi
Copy link
Member

prudhvigodithi commented Jul 20, 2023 •
edited
Loading

Integ test results #3616 (comment) manual sign off for 3nd OSD RC Generated on 07/20/2023

Repo Integ-Tests RC2
OpenSearch-Dashboards 🟢
alertingDashboards 🟢
queryWorkbenchDashboards 🟢
securityAnalyticsDashboards 🟢
reportsDashboards 🟢
observabilityDashboards 🟢
notificationsDashboards 🟢
customImportMapDashboards 🟢

@ohltyler
Copy link
Member

OSD signed off - video shows success, same issue as seen in previous RC builds

@prudhvigodithi prudhvigodithi mentioned this issue Jul 20, 2023
Closed
@xluo-aws
Copy link
Member

dashboardsnotification signed off - same problem as previous RC builds due to historical data not clean up.

@heemin32
Copy link
Contributor

customImportMapDashboards signed off - The recorded video showed the test actually succeeded.

@kavithacm
Copy link
Contributor

kavithacm commented Jul 20, 2023 •
edited
Loading

Signing off on observability, reports dashboards and query workbench - same issue as previous RC build

@prudhvigodithi prudhvigodithi mentioned this issue Jul 21, 2023
Merged
@prudhvigodithi
Copy link
Member

prudhvigodithi commented Jul 21, 2023 •
edited
Loading

OpenSearch 2.9.0 Release Checklist

Checklist for the release scheduled on July 24th 2023 at 11.30 am PT.

Pre-Release activities

Release activities

Post-Release activities

@peterzhuamazon peterzhuamazon mentioned this issue Jul 24, 2023
Merged
@prudhvigodithi
Copy link
Member

Native plugin validation tested on apt.

ubuntu@ip-172-31-89-54:/usr/share/opensearch/bin$ sudo ./opensearch-plugin install repository-s3 --batch
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.io.FilePermission config#plus read
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission aws.configFile read,write
* java.util.PropertyPermission aws.sharedCredentialsFile read,write
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
* java.util.PropertyPermission opensearch.path.conf read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.
-> Installed repository-s3 with folder name repository-s3

@prudhvigodithi prudhvigodithi mentioned this issue Jul 24, 2023
Merged
3 tasks
@peterzhuamazon peterzhuamazon mentioned this issue Jul 24, 2023
Merged
This was referenced Jul 24, 2023
Merged
Merged
Closed
This was referenced Jul 24, 2023
Merged
Merged
@gaiksaya gaiksaya unpinned this issue Jul 25, 2023
@bbarani bbarani moved this from In Progress to Done in OpenSearch Engineering Effectiveness Jul 31, 2023
@prudhvigodithi
Copy link
Member

Closing this issue as the release 2.9.0 is out, please ass your thoughts/feedback on the retro issue #3808.
Thank you

@lukas-vlcek lukas-vlcek mentioned this issue Aug 1, 2023
Closed
5 tasks
@gaiksaya gaiksaya mentioned this issue Oct 19, 2023
Open
2 tasks
@prudhvigodithi prudhvigodithi mentioned this issue Jul 19, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@prudhvigodithi prudhvigodithi

@peterzhuamazon peterzhuamazon

Labels
release v2.9.0
Projects
OpenSearch Engineering Effectiveness
Status: Done
Milestone
No milestone
Development

No branches or pull requests