[RELEASE] Release version 2.8.0 #3434

github-actions · 2023-04-23T00:19:37Z

Release OpenSearch and OpenSearch Dashboards 2.8.0

I noticed that a manifest was automatically created in manifests/2.8.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. More details are included in the Maintainers Release owner section.

Release Steps

There are several steps to the release process, these steps are completed as the whole release and components that are behind present risk to the release. The release owner completes the tasks in this ticket, whereas component owners resolve tasks on their ticket in their repositories.

Steps have completion dates for coordinating efforts between the components of a release; components can start as soon as they are ready far in advance of a future release.

Component List

To aid in understanding the state of the release there is a table with status indicating each component state. This is updated based on the status of the component issues.

Preparation

Campaigns

See comments

Release Branch - Ends 2023/05/25

Component versions are auto-incremented to 2.8.0 version.
Plugins team to ensure working CI in component repositories and merge the version increment PRs.
OpenSearch / OpenSearch-Dashboards core cut branch 2.8 early.
All component repos create 2.8 branch for the release.

Feature Freeze - Ends 2023/05/30

OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.
Create Jenkins workflows that run daily snapshot builds for OpenSearch and OpenSearch Dashboards.
Make pull requests to add each component to manifests/2.8.0/opensearch-2.8.0.yml and manifests/2.8.0/opensearch-dashboards-2.8.0.yml with the corresponding checks.

Code Complete - Ends 2023/05/30

Code Complete: Make sure that the code for this specific version of the release is ready and the branch corresponding to this release has been added to this release version manifest.
Verify pull requests to add each component to manifests/2.8.0/opensearch-2.8.0.yml and manifests/2.8.0/opensearch-dashboards-2.8.0.yml have been merged.
Gather, review and combine the release notes from components repositories.

Release testing - Starts 2023/05/31 - Ends 2023/06/02

Declare a release candidate build, and provide the instructions with the release candidates for teams on testing.
Stop builds for this version of OpenSearch and/or OpenSearch Dashboards in order to avoid accidental commits going in unknowingly. Restart only if necessary else manually run the build workflow and declare new release candidate.
After generate the release candidates, raise PR to lock input manifest refs of both OS and OSD builds with the commit ids from distribution manifest of the release candidates.
Sanity Testing (2023/06/01): Sanity testing and fixing of critical issues found by teams. Teams test their components within the distribution, ensuring integration, backwards compatibility, and perf tests pass.
Publish all test results in the comments of this issue.

Performance testing validation - Starts 2023/06/01 - Ends 2023/06/03

Performance tests do not show a regression.
Longevity tests do not show any issues.

Release - 2023/06/06

Verify all issues labeled v2.8.0 in all projects have been resolved.
Complete documentation for this release.
Author blog post for this release.
2023/06/05 - Publish this release on opensearch.org.
2023/06/06 - Publish a blog post - release is launched!

Post Release

Create release tags for each component (Jenkins job name: release-tag-creation).
Replace refs in manifests/2.8.0 with tags and remove checks.
If this is a major or minor version release, stop building previous patch version.
Generate distribution release notes reviewed by PM team for opensearch-build repository.
Increment version for Helm Charts (sample PR) for the 2.8.0 release.
Increment version for Ansible Charts (sample PR) for the 2.8.0 release.
Prepare for next patch release by incrementing patch versions for each component.
Update this template with any new or missed steps.
Create an issue for a retrospective, solicit feedback, and publish a summary.
- [Retrospective] Release 2.8.0 #3604

Components

Replace with links to all component tracking issues.

Component	Untriaged issues	Issues tagged with 2.8.0
opensearch-project/OpenSearch#7664
opensearch-project/OpenSearch-Dashboards#4074
opensearch-project/alerting#927
opensearch-project/anomaly-detection#910
opensearch-project/asynchronous-search#286
opensearch-project/reporting#703
opensearch-project/dashboards-visualizations#186
opensearch-project/index-management#787
opensearch-project/job-scheduler#388
opensearch-project/k-NN#905
opensearch-project/performance-analyzer#449
opensearch-project/performance-analyzer-rca#372
opensearch-project/security-dashboards-plugin#1433
opensearch-project/security#2785
opensearch-project/sql#1646
opensearch-project/observability#1542
opensearch-project/alerting-dashboards-plugin#556
opensearch-project/notifications#681
opensearch-project/index-management-dashboards-plugin#749
opensearch-project/anomaly-detection-dashboards-plugin#488
opensearch-project/cross-cluster-replication#857
opensearch-project/common-utils#434
opensearch-project/geospatial#316
opensearch-project/ml-commons#903
opensearch-project/ml-commons-dashboards#188
opensearch-project/dashboards-maps#413
opensearch-project/dashboards-observability#477
opensearch-project/dashboards-reporting#117
opensearch-project/security-analytics#439
opensearch-project/neural-search#176
opensearch-project/security-analytics-dashboards-plugin#593
opensearch-project/dashboards-notifications#47
opensearch-project/dashboards-query-workbench#73
opensearch-project/opensearch-dashboards-functional-test#666
opensearch-project/dashboards-search-relevance#204

Legend

Symbol	Meaning
🟢	On track with overall release
🟡	Missed last milestone
🔴	Missed multiple milestones

The text was updated successfully, but these errors were encountered:

peterzhuamazon · 2023-05-17T21:54:24Z

Issues / Campaigns

[BUG][2.8.0]Observability 2.8.0.0 failed to install due to jarhell with guava observability#1535
[BUG] OpenSearch-Dashboards integTest does not uninstall OpenSearch after completion #3524
Upcoming Transition to Node.js v18: Plugin Compatibility Test Required Overall Issue OpenSearch-Dashboards#4058
[BUG] Names don't adhere to plugin naming convention opensearch-plugins#174 (comment)
[BUG] ML-Commons Plugin build failure due to OpenSearch Core breaking changes ml-commons#891
- Bump jackson from 2.14.2 to 2.15.0 OpenSearch#7286
- Provide mechanism to configure XContent parsing constraints (after update to Jackson 2.15.0) OpenSearch#7549
[release]: performance-analyzer-commons #3547 (comment)
[RFC] Search pipelines search-processor#80
Upgrade Cypress to v12 opensearch-dashboards-functional-test#408
- Upgrade to cypress 12 (into feature/cypress12) opensearch-dashboards-functional-test#668
OS docker scan:
- PA: jdbc: Update dependency org.xerial:sqlite-jdbc to v3.41.2.2 performance-analyzer-rca#375
  - [Backport 2.x] Update dependency org.xerial:sqlite-jdbc to v3.41.2.2 performance-analyzer-rca#377
ML Dash GA (awaiting review on 2023/05/31 morning by 10PST) (We still experimental):
[BUG] Reindex is break can not copy all documents from source OpenSearch#7878
- [Backport 2.8] Revert "Time series based workload desc order optimization through re… OpenSearch#7893
[Site] update results path based on recent updates for concurrency opensearch-dashboards-functional-test#708
[Site] add OSD results opensearch-dashboards-functional-test#711
OSD ftrepo test issues on node18:

We will see once release build occurs but seeing some issues were node 18 + localhost and cypress latest wasn’t playing nicely.
therefore some plugins (if not all) might need https://github.com/opensearch-project/opensearch-build/blob/main/manifests/2.8.0/opensearch-dashboards-2.8.0-test.yml#L13 to include server.host: 0.0.0.0 and an environment variable for baseUrl: 'http://0.0.0.0:5601/ but I recommended holding off any action until we get a test run.
More info:
https://github.com/cypress-io/github-action/issues/811

PRs:

more

2nd RC possibility:

3rd RC possibility:

rishabh6788 · 2023-06-01T18:22:48Z

Product/ Version	Architecture	Description	Instance Type	Workload	Index latency (p50)	Index latencyp90	Index latencyp99	Index latencyp100	Index throughputp0	Index throughputp50	Index throughputp100	Ops Count	Op Error Count	Error Rate	Query latencyp50	Query latencyp90	Query latencyp99	Query latencyp100	Query throughputp0	Query throughputp50	Query throughputp100	Ops Count	Op Error Count	Error Rate	CPUp50	CPUp90	CPUp99	CPUp100	Memoryp50	Memoryp90	Memoryp99	Memoryp100	Old	Young
2.8.0	x64	with_security	m5.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	2,258.1	3,007.8	5,871.9	8,746.7	32,246	33,971.4	38,121.1	46,890	0	0	276.1	281.6	292	313.6	1.726	1.74	1.753	1,510	0	0	97	100	100	100	53	66	78.65	93	0	1,238,141
2.8.0	x64	without_security	m5.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	2,160.6	2,881.2	5,637.9	9,982.8	33,564.6	35,734.3	40,595.5	46,742	0	0	285.5	292.7	302.4	309.7	1.727	1.741	1.756	1,510	0	0	97	99	100	100	50.75	65	91.38	97	0	1,053,492
Comparison					4.32%	4.21%	3.99%	-14.13%	4.09%	5.19%	6.49%				-3.40%	-3.94%	-3.56%	1.24%	0.06%	0.06%	0.17%

Product/ Version	Architecture	Description	Instance Type	Workload	Index latency (p50)	Index latencyp90	Index latencyp99	Index latencyp100	Index throughputp0	Index throughputp50	Index throughputp100	Ops Count	Op Error Count	Error Rate	Query latencyp50	Query latencyp90	Query latencyp99	Query latencyp100	Query throughputp0	Query throughputp50	Query throughputp100	Ops Count	Op Error Count	Error Rate	CPUp50	CPUp90	CPUp99	CPUp100	Memoryp50	Memoryp90	Memoryp99	Memoryp100	Old	Young
2.8.0	arm64	with_security	m6g.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	1,710.3	2,275.4	4,314.7	6,987.6	42,197.8	44,490.6	48,768	46,102	0	0	409.9	422.1	430.2	435.3	1.725	1.739	1.753	1,510	0	0	96	98	100	100	53	67	88.04	93	0	996,946
2.8.0	arm64	without_security	m6g.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	1,564.4	2,090.7	4,112.6	7,385.6	46,324.5	48,112.4	52,931.5	45,820	0	0	327.8	337.1	342.5	350	1.731	1.743	1.756	1,510	0	0	96	98	100	100	48	64	92.04	95	0	848,496

Product/ Version	Architecture	Description	Instance Type	Workload	Index latency (p50)	Index latencyp90	Index latencyp99	Index latencyp100	Index throughputp0	Index throughputp50	Index throughputp100	Ops Count	Op Error Count	Error Rate	Query latencyp50	Query latencyp90	Query latencyp99	Query latencyp100	Query throughputp0	Query throughputp50	Query throughputp100	Ops Count	Op Error Count	Error Rate	CPUp50	CPUp90	CPUp99	CPUp100	Memoryp50	Memoryp90	Memoryp99	Memoryp100	Old	Young
2.7.0	x64	with_security	m5.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	2,318.4	3,065.2	5,775.2	9,499	31,751	33,313.5	37,468.2	46,931	0	0	296.4	310.9	326.3	337	1.724	1.739	1.753	1510	0	0	97	99	100	100	53	66	87.14	94	0	1,220,516
2.8.0	x64	with_security	m5.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	2,258.1	3,007.8	5,871.9	8,746.7	32,246	33,971.4	38,121.1	46,890	0	0	276.1	281.6	292	313.6	1.726	1.74	1.753	1,510	0	0	97	100	100	100	53	66	78.65	93	0	1,238,141
Comparison					2.60%	1.87%	-1.67%	7.92%	1.56%	1.97%	1.74%				6.85%	9.42%	10.51%	6.94%	0.12%	0.06%	0.00%

Product/ Version	Architecture	Description	Instance Type	Workload	Index latency (p50)	Index latencyp90	Index latencyp99	Index latencyp100	Index throughputp0	Index throughputp50	Index throughputp100	Ops Count	Op Error Count	Error Rate	Query latencyp50	Query latencyp90	Query latencyp99	Query latencyp100	Query throughputp0	Query throughputp50	Query throughputp100	Ops Count	Op Error Count	Error Rate	CPUp50	CPUp90	CPUp99	CPUp100	Memoryp50	Memoryp90	Memoryp99	Memoryp100	Old	Young
2.7.0	x64	without_security	m5.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	2,170.8	2,916.6	5,512.7	9,747.3	33,671.9	35,557	39,831.6	46,783	0	0	277.3	282.9	290	300.2	1.716	1.734	1.752	1510	0	0	97	100	100	100	51	63	88	94	0	1,037,614
2.8.0	x64	without_security	m5.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	2,160.6	2,881.2	5,637.9	9,982.8	33,564.6	35,734.3	40,595.5	46,742	0	0	285.5	292.7	302.4	309.7	1.727	1.741	1.756	1,510	0	0	97	99	100	100	50.75	65	91.38	97	0	1,053,492
Comparison					0.47%	1.21%	-2.27%	-2.42%	-0.32%	0.50%	1.92%				-2.96%	-3.46%	-4.28%	-3.16%	0.64%	0.40%	0.23%

Product/ Version	Architecture	Description	Instance Type	Workload	Index latency (p50)	Index latencyp90	Index latencyp99	Index latencyp100	Index throughputp0	Index throughputp50	Index throughputp100	Ops Count	Op Error Count	Error Rate	Query latencyp50	Query latencyp90	Query latencyp99	Query latencyp100	Query throughputp0	Query throughputp50	Query throughputp100	Ops Count	Op Error Count	Error Rate	CPUp50	CPUp90	CPUp99	CPUp100	Memoryp50	Memoryp90	Memoryp99	Memoryp100	Old	Young
2.7.0	arm64	with_security	m6g.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	1,741.8	2,336.1	4,227.1	6,758.6	41,226.7	42,941.1	46,643.1	46,281	0	0	317.8	331	334.3	407.8	1.718	1.735	1.749	1510	0	0	95.667	98.8	100	100	52	66	76.72	88	0	968,100
2.8.0	arm64	with_security	m6g.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	1,710.3	2,275.4	4,314.7	6,987.6	42,197.8	44,490.6	48,768	46,102	0	0	409.9	422.1	430.2	435.3	1.725	1.739	1.753	1,510	0	0	96	98	100	100	53	67	88.04	93	0	996,946
Comparison					1.81%	2.60%	-2.07%	-3.39%	2.36%	3.61%	4.56%				-28.98%	-27.52%	-28.69%	-6.74%	0.41%	0.23%	0.23%

Product/ Version	Architecture	Description	Instance Type	Workload	Index latency (p50)	Index latencyp90	Index latencyp99	Index latencyp100	Index throughputp0	Index throughputp50	Index throughputp100	Ops Count	Op Error Count	Error Rate	Query latencyp50	Query latencyp90	Query latencyp99	Query latencyp100	Query throughputp0	Query throughputp50	Query throughputp100	Ops Count	Op Error Count	Error Rate	CPUp50	CPUp90	CPUp99	CPUp100	Memoryp50	Memoryp90	Memoryp99	Memoryp100	Old	Young
2.7.0	arm64	without_security	m6g.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	1,649.4	2,232.5	4,155.6	7,537	43,950.6	45,584.2	49,754.1	46,048	0	0	331.7	372.7	377.9	383.7	1.727	1.741	1.756	1510	0	0	96	98	100	100	49	64	85.6	95	0	816,604
2.8.0	arm64	without_security	m6g.xlarge	nyc_taxis / 2 warmupIterations / 3 testIterations	1,564.4	2,090.7	4,112.6	7,385.6	46,324.5	48,112.4	52,931.5	45,820	0	0	327.8	337.1	342.5	350	1.731	1.743	1.756	1,510	0	0	96	98	100	100	48	64	92.04	95	0	848,496
Comparison					5.15%	6.35%	1.03%	2.01%	5.40%	5.55%	6.39%				1.18%	9.55%	9.37%	8.78%	0.23%	0.11%	0.00%

Hailong-am · 2023-06-02T03:36:27Z

see reindex may have some issue with the docker image , opensearch-project/OpenSearch#7878

peterzhuamazon · 2023-06-05T23:50:58Z

All integTests are either passing or have plugin owner sign off manually.a

peterzhuamazon · 2023-06-06T18:56:10Z

Maven:
https://build.ci.opensearch.org/job/publish-to-maven/18/console
https://repo1.maven.org/maven2/org/opensearch/opensearch/2.8.0/

rishabh6788 · 2023-06-06T18:56:59Z

Native plugin installation working fine.

dev-dsk-sngri-1c-8de54c16 % bin/opensearch-plugin install discovery-ec2
-> Installing discovery-ec2
-> Downloading discovery-ec2 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.SocketPermission * connect,resolve
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed discovery-ec2 with folder name discovery-ec2

dev-dsk-sngri-1c-8de54c16 % bin/opensearch-plugin install repository-s3
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

peterzhuamazon · 2023-06-06T20:11:01Z

We have officially released 2.8.0 version on 2023/06/06:

https://opensearch.org/versions/opensearch-2-8-0.html

Thanks.

peterzhuamazon · 2023-06-14T19:27:04Z

Since 2.8.0 is released to the public and the retro is completed.
We will close this issue now.

Thanks.

github-actions bot added release untriaged Issues that have not yet been triaged v2.8.0 labels Apr 23, 2023

rishabh6788 removed the untriaged Issues that have not yet been triaged label Apr 25, 2023

bbarani assigned peterzhuamazon and rishabh6788 May 15, 2023

bbarani pinned this issue May 22, 2023

peterzhuamazon added this to OpenSearch Engineering Effectiveness May 22, 2023

github-project-automation bot moved this to Backlog in OpenSearch Engineering Effectiveness May 22, 2023

peterzhuamazon moved this from Backlog to In Progress in OpenSearch Engineering Effectiveness May 22, 2023

This was referenced Jun 1, 2023

Add additional cluster config support in OSD integTest #3590

Merged

Initial empty dictionary for None additional cluster configs in OSD IntegTest #3593

Merged

Add 2nd RC changes for 2.8.0 Version #3594

Merged

This was referenced Jun 6, 2023

Switch 2.8.0 ref in manifest to tags #3603

Merged

[Retrospective] Release 2.8.0 #3604

Closed

lukas-vlcek mentioned this issue Jun 7, 2023

Release 2.8.0.0 Aiven-Open/prometheus-exporter-plugin-for-opensearch#183

Closed

5 tasks

acarbonetto mentioned this issue Jun 8, 2023

[Retrospective-SQL Plugin] Release 2.8.0 opensearch-project/sql#1724

Closed

peterzhuamazon mentioned this issue Jun 12, 2023

[NodeJS Upgrade] Update agent node ami for windows in #301 opensearch-project/opensearch-ci#306

Merged

peterzhuamazon closed this as completed Jun 14, 2023

github-project-automation bot moved this from In Progress to Done in OpenSearch Engineering Effectiveness Jun 14, 2023

prudhvigodithi mentioned this issue Jun 16, 2023

OpenSearch Release Process #3635

Merged

gaiksaya unpinned this issue Jun 19, 2023

acarbonetto mentioned this issue Jun 23, 2023

[RFC] Improving public engagement for OpenSearch release process opensearch-project/.github#167

Open

prudhvigodithi mentioned this issue Jul 19, 2023

[Bug]: Installing dashboard plugin repository-s3 -> AccessDenied #3799

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[RELEASE] Release version 2.8.0 #3434

[RELEASE] Release version 2.8.0 #3434

github-actions bot commented Apr 23, 2023 •

edited by peterzhuamazon

Loading

This Release Issue

Release Steps

Component List

peterzhuamazon commented May 17, 2023 •

edited

Loading

rishabh6788 commented Jun 1, 2023 •

edited

Loading

Hailong-am commented Jun 2, 2023

peterzhuamazon commented Jun 5, 2023

peterzhuamazon commented Jun 6, 2023 •

edited

Loading

rishabh6788 commented Jun 6, 2023 •

edited

Loading

peterzhuamazon commented Jun 6, 2023

peterzhuamazon commented Jun 14, 2023

[RELEASE] Release version 2.8.0 #3434

[RELEASE] Release version 2.8.0 #3434

Comments

github-actions bot commented Apr 23, 2023 • edited by peterzhuamazon Loading

Release OpenSearch and OpenSearch Dashboards 2.8.0

This Release Issue

Release Steps

Component List

Preparation

Campaigns

Release Branch - Ends 2023/05/25

Feature Freeze - Ends 2023/05/30

Code Complete - Ends 2023/05/30

Release testing - Starts 2023/05/31 - Ends 2023/06/02

Performance testing validation - Starts 2023/06/01 - Ends 2023/06/03

Release - 2023/06/06

Post Release

Components

peterzhuamazon commented May 17, 2023 • edited Loading

Issues / Campaigns

PRs:

more

2nd RC possibility:

3rd RC possibility:

rishabh6788 commented Jun 1, 2023 • edited Loading

Hailong-am commented Jun 2, 2023

peterzhuamazon commented Jun 5, 2023

peterzhuamazon commented Jun 6, 2023 • edited Loading

rishabh6788 commented Jun 6, 2023 • edited Loading

peterzhuamazon commented Jun 6, 2023

peterzhuamazon commented Jun 14, 2023

github-actions bot commented Apr 23, 2023 •

edited by peterzhuamazon

Loading

peterzhuamazon commented May 17, 2023 •

edited

Loading

rishabh6788 commented Jun 1, 2023 •

edited

Loading

peterzhuamazon commented Jun 6, 2023 •

edited

Loading

rishabh6788 commented Jun 6, 2023 •

edited

Loading