Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OpenSearch 1.2.0 Release run integration test cases manually #955

Closed
2 tasks done
Tracked by #567
peternied opened this issue Nov 12, 2021 · 8 comments
Closed
2 tasks done
Tracked by #567

OpenSearch 1.2.0 Release run integration test cases manually #955

peternied opened this issue Nov 12, 2021 · 8 comments
Assignees

Comments

@peternied
Copy link
Member

peternied commented Nov 12, 2021

Trigger integration test with

  • On an x64 system ./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/{BUILDNUM}/linux/x64 --keep
  • On an arm64 system ./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/{BUILDNUM}/linux/arm64 --keep

Record the OpenSearch-Build commit number, and then save the results on this issue. If there are any bugs create them on the components associated with the issues.

@peternied peternied self-assigned this Nov 12, 2021
@peternied
Copy link
Member Author

x64 results on build 994

Commit id: d3acfee
./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/994/linux/x64

2021-11-12 19:34:57 INFO     | alerting             | with-security        | PASS  |    0 |
2021-11-12 19:34:57 INFO     | alerting             | without-security     | PASS  |    0 |
2021-11-12 19:34:57 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2021-11-12 19:34:57 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2021-11-12 19:34:57 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2021-11-12 19:34:57 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2021-11-12 19:34:57 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2021-11-12 19:34:57 ERROR    | index-management     | with-security        | FAIL  |    1 |
2021-11-12 19:34:57 INFO     | index-management     | without-security     | PASS  |    0 |
2021-11-12 19:34:57 INFO     | k-NN                 | with-security        | PASS  |    0 |
2021-11-12 19:34:57 INFO     | k-NN                 | without-security     | PASS  |    0 |
2021-11-12 19:34:57 INFO     | sql                  | with-security        | PASS  |    0 |
2021-11-12 19:34:57 INFO     | sql                  | without-security     | PASS  |    0 |

Created issue opensearch-project/index-management#194 for failure

@peternied
Copy link
Member Author

peternied commented Nov 12, 2021

arm64 results on build 994

Commit id: 805fbec (trivial difference between x64 tests)
./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/994/linux/arm64

2021-11-12 22:46:12 ERROR    | alerting             | with-security        | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | alerting             | without-security     | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | anomaly-detection    | with-security        | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | anomaly-detection    | without-security     | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | asynchronous-search  | with-security        | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | asynchronous-search  | without-security     | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | dashboards-reports   | without-security     | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | index-management     | with-security        | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | index-management     | without-security     | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | k-NN                 | with-security        | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | k-NN                 | without-security     | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | sql                  | with-security        | FAIL  |    1 |
2021-11-12 22:46:12 ERROR    | sql                  | without-security     | FAIL  |    1 |

The failure was due to gradle reaper, I am rerunning with additional logs for more data.

Error: LinkageError occurred while loading main class org.opensearch.gradle.reaper.Reaper
        java.lang.UnsupportedClassVersionError: org/opensearch/gradle/reaper/Reaper has been compiled by a more recent version of the Java Runtime (class file version 58.0), this version of the Java Runtime only recognizes class file versions up to 55.0

@peternied peternied changed the title Run integration test cases manually OpenSearch 1.2.0 Release run integration test cases manually Nov 12, 2021
@peternied
Copy link
Member Author

Figured out the issue with the arm host, it was using java 11, rerunning

@peternied
Copy link
Member Author

arm64 results on build 994

Commit id: 805fbec (trivial difference between x64 tests)
./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/994/linux/arm64

2021-11-13 01:11:08 INFO     | alerting             | with-security        | PASS  |    0 |
2021-11-13 01:11:08 INFO     | alerting             | without-security     | PASS  |    0 |
2021-11-13 01:11:08 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2021-11-13 01:11:08 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2021-11-13 01:11:08 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2021-11-13 01:11:08 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2021-11-13 01:11:08 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2021-11-13 01:11:08 INFO     | index-management     | with-security        | PASS  |    0 |
2021-11-13 01:11:08 ERROR    | index-management     | without-security     | FAIL  |    1 |
2021-11-13 01:11:08 ERROR    | k-NN                 | with-security        | FAIL  |    1 |
2021-11-13 01:11:08 ERROR    | k-NN                 | without-security     | FAIL  |    1 |
2021-11-13 01:11:08 INFO     | sql                  | with-security        | PASS  |    0 |
2021-11-13 01:11:08 INFO     | sql                  | without-security     | PASS  |    0 |

Looking into the failures, I'll have them posted seperately

@peternied
Copy link
Member Author

x64 results on build 1032

Commit id: d3acfee
./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/1032/linux/x64

2021-11-15 18:34:53 INFO     | alerting             | with-security        | PASS  |    0 |
2021-11-15 18:34:53 INFO     | alerting             | without-security     | PASS  |    0 |
2021-11-15 18:34:53 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2021-11-15 18:34:53 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2021-11-15 18:34:53 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2021-11-15 18:34:53 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2021-11-15 18:34:53 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2021-11-15 18:34:53 INFO     | index-management     | with-security        | PASS  |    0 |
2021-11-15 18:34:53 INFO     | index-management     | without-security     | PASS  |    0 |
2021-11-15 18:34:53 INFO     | k-NN                 | with-security        | PASS  |    0 |
2021-11-15 18:34:53 INFO     | k-NN                 | without-security     | PASS  |    0 |
2021-11-15 18:34:53 INFO     | sql                  | with-security        | PASS  |    0 |
2021-11-15 18:34:53 INFO     | sql                  | without-security     | PASS  |    0 |

All tests passed without issue

@peternied
Copy link
Member Author

arm64 results on build 994 (Issues!)

Commit id: 805fbec (trivial difference between x64 tests)
./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/994/linux/arm64

2021-11-13 01:11:08 ERROR    | index-management     | without-security     | FAIL  |    1 |
2021-11-13 01:11:08 ERROR    | k-NN                 | with-security        | FAIL  |    1 |
2021-11-13 01:11:08 ERROR    | k-NN                 | without-security     | FAIL  |    1 |

@peternied
Copy link
Member Author

peternied commented Nov 16, 2021

arm64 results on build 1032 (Issues!)

Commit id: 805fbec (trivial difference between x64 tests)
./test.sh integ-test https://ci.opensearch.org/ci/dbc/bundle-build/1.2.0/1032/linux/arm64

2021-11-16 01:08:44 INFO     | alerting             | with-security        | PASS  |    0 |
2021-11-16 01:08:44 INFO     | alerting             | without-security     | PASS  |    0 |
2021-11-16 01:08:44 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2021-11-16 01:08:44 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2021-11-16 01:08:44 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2021-11-16 01:08:44 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2021-11-16 01:08:44 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2021-11-16 01:08:44 ERROR    | index-management     | with-security        | FAIL  |    1 |
2021-11-16 01:08:44 INFO     | index-management     | without-security     | PASS  |    0 |
2021-11-16 01:08:44 ERROR    | k-NN                 | with-security        | FAIL  |    1 |
2021-11-16 01:08:44 ERROR    | k-NN                 | without-security     | FAIL  |    1 |
2021-11-16 01:08:44 INFO     | sql                  | with-security        | PASS  |    0 |
2021-11-16 01:08:44 INFO     | sql                  | without-security     | PASS  |    0 |

Results are in folder 0a91364d94934de98f1810220391de49

@peternied
Copy link
Member Author

All tests have been run and bugs filed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant