Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable multi cluster integtest for CCR #4048

Merged
merged 1 commit into from
Sep 20, 2023

Conversation

monusingh-1
Copy link
Contributor

@monusingh-1 monusingh-1 commented Sep 20, 2023

Disables multi cluster integration tests for CCR

Currently the logger in test workflow does not support collecting cluster logs for multiple clusters.
This results in entire test failing at the end with

FileExistsError: [Errno 17] File exists: '/var/jenkins/workspace/integ-test@4/test-results/5327/integ-test/cross-cluster-replication/with-security/local-cluster-logs/opensearch-service-logs'

Pending #3448

Description

Describe what this change achieves.

Issues Resolved

List any issues this PR will resolve, e.g. Closes [...].

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Disables multi cluster integration tests

Signed-off-by: Monu Singh <msnghgw@amazon.com>
@codecov
Copy link

codecov bot commented Sep 20, 2023

Codecov Report

Merging #4048 (46fc17a) into main (69d8f75) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #4048   +/-   ##
=======================================
  Coverage   92.10%   92.10%           
=======================================
  Files         187      187           
  Lines        5674     5674           
=======================================
  Hits         5226     5226           
  Misses        448      448           

@monusingh-1
Copy link
Contributor Author

2023-09-20 16:00:18 INFO     Executing "git init" in /tmp/tmpx_ivx1ti/cross-cluster-replication
2023-09-20 16:00:18 INFO     Executing "git remote add origin https://github.com/opensearch-project/cross-cluster-replication.git" in /tmp/tmpx_ivx1ti/cross-cluster-replication
2023-09-20 16:00:18 INFO     Executing "git fetch --depth 1 origin dee2f600d214360d32415023a563eeccad103e77" in /tmp/tmpx_ivx1ti/cross-cluster-replication
2023-09-20 16:00:18 INFO     Executing "git checkout FETCH_HEAD" in /tmp/tmpx_ivx1ti/cross-cluster-replication
2023-09-20 16:00:18 INFO     Executing "git rev-parse HEAD" in /tmp/tmpx_ivx1ti/cross-cluster-replication
2023-09-20 16:00:18 INFO     Checked out https://github.com/opensearch-project/cross-cluster-replication.git@dee2f600d214360d32415023a563eeccad103e77 into /tmp/tmpx_ivx1ti/cross-cluster-replication at dee2f600d214360d32415023a563eeccad103e77
2023-09-20 16:00:18 INFO     opensearch distribution: tar
2023-09-20 16:00:18 INFO     Downloading bundle artifact
2023-09-20 16:00:18 INFO     Downloading https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/2.10.0/8515/linux/x64/tar/dist/opensearch/opensearch-2.10.0-linux-x64.tar.gz into /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0-linux-x64.tar.gz ...
2023-09-20 16:00:24 INFO     Downloaded bundle to /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0-linux-x64.tar.gz
2023-09-20 16:00:24 INFO     Installing /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0-linux-x64.tar.gz in /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0
2023-09-20 16:00:32 INFO     Started OpenSearch with parent PID 82998
2023-09-20 16:00:32 INFO     Waiting for service to become available
2023-09-20 16:00:32 INFO     Pinging service attempt 0
2023-09-20 16:00:32 INFO     Pinging https://localhost:9200/_cluster/health
2023-09-20 16:00:32 INFO     Service not available, yet
2023-09-20 16:00:42 INFO     Pinging service attempt 1
2023-09-20 16:00:42 INFO     Pinging https://localhost:9200/_cluster/health
2023-09-20 16:00:42 INFO     Service not available, yet
2023-09-20 16:00:52 INFO     Pinging service attempt 2
2023-09-20 16:00:52 INFO     Pinging https://localhost:9200/_cluster/health
/home/ec2-user/.local/share/virtualenvs/opensearch-build-6InJtTzb/lib/python3.9/site-packages/urllib3/connectionpool.py:1056: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
  warnings.warn(
2023-09-20 16:00:52 INFO     200: {"cluster_name":"opensearchcluster1","status":"green","timed_out":false,"number_of_nodes":1,"number_of_data_nodes":1,"discovered_master":true,"discovered_cluster_manager":true,"active_primary_shards":3,"active_shards":3,"relocating_shards":0,"initializing_shards":0,"unassigned_shards":0,"delayed_unassigned_shards":0,"number_of_pending_tasks":0,"number_of_in_flight_fetch":0,"task_max_waiting_in_queue_millis":0,"active_shards_percent_as_number":100.0}
2023-09-20 16:00:52 INFO     Service is available
2023-09-20 16:00:52 INFO     ===============================================
2023-09-20 16:00:52 INFO     Running integration tests for cross-cluster-replication with-security
2023-09-20 16:00:52 INFO     ===============================================
2023-09-20 16:00:52 INFO     Executing "bash /tmp/tmpx_ivx1ti/cross-cluster-replication/scripts/integtest.sh -b localhost -p 9200 -s true -v 2.10.0" in /tmp/tmpx_ivx1ti/cross-cluster-replication

2023-09-20 16:02:27 INFO     Sending SIGKILL to PID 82998
2023-09-20 16:02:27 INFO     Process killed with exit code None
2023-09-20 16:02:27 INFO     Recording local cluster logs for cross-cluster-replication with test configuration as with-security at /home/ec2-user/opensearch-build/test-results/064c41438d2e450b84cce0e6d3d57555/integ-test/cross-cluster-replication/with-security/local-cluster-logs
2023-09-20 16:02:27 INFO     Cleanup /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0 content after the test
2023-09-20 16:02:27 INFO     opensearch distribution: tar
2023-09-20 16:02:27 INFO     Downloading bundle artifact
2023-09-20 16:02:27 INFO     Downloading https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/2.10.0/8515/linux/x64/tar/dist/opensearch/opensearch-2.10.0-linux-x64.tar.gz into /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0-linux-x64.tar.gz ...
2023-09-20 16:02:38 INFO     Downloaded bundle to /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0-linux-x64.tar.gz
2023-09-20 16:02:38 INFO     Installing /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0-linux-x64.tar.gz in /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0
2023-09-20 16:02:46 INFO     Started OpenSearch with parent PID 84165
2023-09-20 16:02:46 INFO     Waiting for service to become available
2023-09-20 16:02:46 INFO     Pinging service attempt 0
2023-09-20 16:02:46 INFO     Pinging http://localhost:9200/_cluster/health
2023-09-20 16:02:46 INFO     Service not available, yet
2023-09-20 16:02:56 INFO     Pinging service attempt 1
2023-09-20 16:02:56 INFO     Pinging http://localhost:9200/_cluster/health
2023-09-20 16:02:56 INFO     Service not available, yet
2023-09-20 16:03:06 INFO     Pinging service attempt 2
2023-09-20 16:03:06 INFO     Pinging http://localhost:9200/_cluster/health
2023-09-20 16:03:06 INFO     200: {"cluster_name":"opensearchcluster1","status":"green","timed_out":false,"number_of_nodes":1,"number_of_data_nodes":1,"discovered_master":true,"discovered_cluster_manager":true,"active_primary_shards":2,"active_shards":2,"relocating_shards":0,"initializing_shards":0,"unassigned_shards":0,"delayed_unassigned_shards":0,"number_of_pending_tasks":0,"number_of_in_flight_fetch":0,"task_max_waiting_in_queue_millis":0,"active_shards_percent_as_number":100.0}
2023-09-20 16:03:06 INFO     Service is available
2023-09-20 16:03:06 INFO     ===============================================
2023-09-20 16:03:06 INFO     Running integration tests for cross-cluster-replication without-security
2023-09-20 16:03:06 INFO     ===============================================
2023-09-20 16:03:06 INFO     Executing "bash /tmp/tmpx_ivx1ti/cross-cluster-replication/scripts/integtest.sh -b localhost -p 9200 -s false -v 2.10.0" in /tmp/tmpx_ivx1ti/cross-cluster-replication
2023-09-20 16:03:21 INFO     Sending SIGKILL to PID 84165
2023-09-20 16:03:21 INFO     Process killed with exit code None
2023-09-20 16:03:21 INFO     Recording local cluster logs for cross-cluster-replication with test configuration as without-security at /home/ec2-user/opensearch-build/test-results/064c41438d2e450b84cce0e6d3d57555/integ-test/cross-cluster-replication/without-security/local-cluster-logs
2023-09-20 16:03:21 INFO     Cleanup /tmp/tmpx_ivx1ti/1/local-test-cluster/opensearch-2.10.0 content after the test
2023-09-20 16:03:21 INFO     Recording component test results for cross-cluster-replication at /home/ec2-user/opensearch-build/test-results/064c41438d2e450b84cce0e6d3d57555/integ-test/cross-cluster-replication/with-security
2023-09-20 16:03:21 INFO     Walking tree from /home/ec2-user/opensearch-build/test-results/064c41438d2e450b84cce0e6d3d57555/integ-test/cross-cluster-replication/with-security
2023-09-20 16:03:21 INFO     Recording component test results for cross-cluster-replication at /home/ec2-user/opensearch-build/test-results/064c41438d2e450b84cce0e6d3d57555/integ-test/cross-cluster-replication/without-security
2023-09-20 16:03:21 INFO     Walking tree from /home/ec2-user/opensearch-build/test-results/064c41438d2e450b84cce0e6d3d57555/integ-test/cross-cluster-replication/without-security
2023-09-20 16:03:21 INFO     Skipping ml-commons
2023-09-20 16:03:21 INFO     Skipping neural-search
2023-09-20 16:03:21 INFO     Skipping notifications-core
2023-09-20 16:03:21 INFO     Skipping notifications
2023-09-20 16:03:21 INFO     Skipping opensearch-observability
2023-09-20 16:03:21 INFO     Skipping opensearch-reports
2023-09-20 16:03:21 INFO     Skipping sql
2023-09-20 16:03:21 INFO     Skipping asynchronous-search
2023-09-20 16:03:21 INFO     Skipping anomaly-detection
2023-09-20 16:03:21 INFO     Skipping alerting
2023-09-20 16:03:21 INFO     Skipping security-analytics
2023-09-20 16:03:21 INFO     Skipping index-management
2023-09-20 16:03:21 INFO     Skipping performance-analyzer
2023-09-20 16:03:21 INFO     Skipping custom-codecs
2023-09-20 16:03:21 INFO     Removing /tmp/tmpx_ivx1ti
2023-09-20 16:03:21 INFO     | cross-cluster-replication | with-security        | PASS  |
2023-09-20 16:03:21 INFO     | cross-cluster-replication | without-security     | PASS  |

@gaiksaya gaiksaya merged commit b1c12b0 into opensearch-project:main Sep 20, 2023
46 checks passed
@monusingh-1 monusingh-1 deleted the patch-2 branch October 17, 2023 05:55
monusingh-1 added a commit to monusingh-1/os_build that referenced this pull request Oct 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants