Functional x-pack monitoring tests failing for cloud #29973

liza-mae · 2019-02-04T17:53:09Z

Hi I have the following test failures running on cloud. Version: 6.7.0, needs investigating if tests are applicable on cloud, real failures or needs tests changes.

fail: "Monitoring app Cluster listing with all basic license clusters cluster row content non-primary basic cluster shows NA for everything"
fail: "Monitoring app Cluster listing with all basic license clusters cluster row content primary basic cluster shows cluster metrics"
fail: "Monitoring app Cluster listing with all basic license clusters cluster row actions clicking the primary basic cluster goes to overview"
fail: "Monitoring app Elasticsearch nodes listing with offline node should have a nodes table with correct rows with default sorting"
fail: "Monitoring app Elasticsearch nodes listing with offline node should sort by cpu"
fail: "Monitoring app Elasticsearch nodes listing with offline node should sort by load average"
fail: "Monitoring app Elasticsearch nodes listing with offline node should sort by memory"

elasticmachine · 2019-02-04T17:53:11Z

Pinging @elastic/stack-monitoring

liza-mae · 2019-02-04T17:53:52Z

fail: "Monitoring app Cluster listing with all basic license clusters cluster row content non-primary basic cluster shows NA for everything"
│ Error: expected 'Basic' to equal 'Basic\nExpires 29 Aug 30'
│ at Assertion.assert (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:96:13)
│ at Assertion.be.Assertion.equal (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:216:10)
│ at Assertion.(anonymous function) [as be] (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:69:24)
│ at Context.it (test/functional/apps/monitoring/cluster/list.js:99:84)
│ at process._tickCallback (internal/process/next_tick.js:68:7)

liza-mae · 2019-02-04T17:54:03Z

fail: "Monitoring app Cluster listing with all basic license clusters cluster row content primary basic cluster shows cluster metrics"
│ Error: expected '-' to equal 'N/A'
│ at Assertion.assert (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:96:13)
│ at Assertion.be.Assertion.equal (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:216:10)
│ at Assertion.(anonymous function) [as be] (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:69:24)
│ at Context.it (test/functional/apps/monitoring/cluster/list.js:104:81)
│ at process._tickCallback (internal/process/next_tick.js:68:7)

liza-mae · 2019-02-04T17:54:20Z

fail: "Monitoring app Cluster listing with all basic license clusters cluster row actions clicking the primary basic cluster goes to overview"
│ Error: retry.try timeout: Error: retry.try timeout: [POST http://localhost:9515/session/550400999ff24ea3dec62e1f5647ead1/element / {"using":"css selector","value":"[data-test-subj~="clusterOverviewContainer"] [data-test-subj~="clusterName"]"}] no such element: Unable to locate element: {"method":"css selector","selector":"[data-test-subj~="clusterOverviewContainer"] [data-test-subj~="clusterName"]"}
│ (Session info: headless chrome=68.0.3440.75)
│ (Driver info: chromedriver=2.42.591071 (0b695ff80972cc1a65a5cd643186d2ae582cd4ac),platform=Linux 4.4.0-141-generic x86_64)
│ at Server._post (/home/liza/TESTING/kibana-6-7-0/test/functional/services/remote/verbose_remote_logging.js:34:21)
│ at runRequest (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:92:40)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:113:39
│ at new Promise (/home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:411:4)
│ at Session._post (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:67:10)
│ at Session.find (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:1328:15)
│ at Command. (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Command.js:42:36)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:393:16
│ at run (/home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:237:8)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/nextTick.ts:44:4
│ at process._tickCallback (internal/process/next_tick.js:61:11)
│ at Command.find (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Command.js:23:10)
│ at Command.prototype.(anonymous function) [as findByCssSelector] (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/lib/strategies.js:29:16)
│ at _ensureElementWithTimeout (/home/liza/TESTING/kibana-6-7-0/test/functional/services/find.js:83:36)
│ at retry.try (/home/liza/TESTING/kibana-6-7-0/test/functional/services/find.js:63:33)
│ at runAttempt (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:39:21)
│ at retryForSuccess (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:67:37)
│ at lastError (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:29:9)
│ at retryForSuccess (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:63:13)
│ at lastError (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:29:9)
│ at retryForSuccess (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:63:13)

liza-mae · 2019-02-04T17:54:31Z

fail: "Monitoring app Elasticsearch nodes listing with offline node should have a nodes table with correct rows with default sorting"
│ Error: expected undefined to equal '0% \n3% max\n0% min'
│ at Assertion.assert (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:96:13)
│ at Assertion.be.Assertion.equal (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:216:10)
│ at Assertion.(anonymous function) [as be] (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:69:24)
│ at nodesAll.forEach (test/functional/apps/monitoring/elasticsearch/nodes.js:76:41)
│ at Array.forEach ()
│ at Context.it (test/functional/apps/monitoring/elasticsearch/nodes.js:73:18)
│ at process._tickCallback (internal/process/next_tick.js:68:7)

liza-mae · 2019-02-04T17:54:43Z

fail: "Monitoring app Elasticsearch nodes listing with offline node should sort by cpu"
│ Error: retry.try timeout: [POST http://localhost:9515/session/550400999ff24ea3dec62e1f5647ead1/element / {"using":"css selector","value":"[data-test-subj~="elasticsearchNodesTableContainer"] [data-test-subj~="tableHeaderCell_node_cpu_utilization_2"]"}] no such element: Unable to locate element: {"method":"css selector","selector":"[data-test-subj~="elasticsearchNodesTableContainer"] [data-test-subj~="tableHeaderCell_node_cpu_utilization_2"]"}
│ (Session info: headless chrome=68.0.3440.75)
│ (Driver info: chromedriver=2.42.591071 (0b695ff80972cc1a65a5cd643186d2ae582cd4ac),platform=Linux 4.4.0-141-generic x86_64)
│ at Server._post (/home/liza/TESTING/kibana-6-7-0/test/functional/services/remote/verbose_remote_logging.js:34:21)
│ at runRequest (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:92:40)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:113:39
│ at new Promise (/home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:411:4)
│ at Session._post (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:67:10)
│ at Session.find (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:1328:15)
│ at Command. (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Command.js:42:36)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:393:16
│ at run (/home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:237:8)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/nextTick.ts:44:4
│ at process._tickCallback (internal/process/next_tick.js:61:11)
│ at Command.find (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Command.js:23:10)
│ at Command.prototype.(anonymous function) [as findByCssSelector] (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/lib/strategies.js:29:16)
│ at _ensureElementWithTimeout (/home/liza/TESTING/kibana-6-7-0/test/functional/services/find.js:83:36)
│ at retry.try (/home/liza/TESTING/kibana-6-7-0/test/functional/services/find.js:63:33)
│ at runAttempt (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:39:21)
│ at retryForSuccess (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:67:37)
│ at lastError (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:29:9)
│ at retryForSuccess (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:63:13)
│

liza-mae · 2019-02-04T17:54:53Z

fail: "Monitoring app Elasticsearch nodes listing with offline node should sort by load average"
│ Error: retry.try timeout: [POST http://localhost:9515/session/550400999ff24ea3dec62e1f5647ead1/element / {"using":"css selector","value":"[data-test-subj~="elasticsearchNodesTableContainer"] [data-test-subj~="tableHeaderCell_node_load_average_3"]"}] no such element: Unable to locate element: {"method":"css selector","selector":"[data-test-subj~="elasticsearchNodesTableContainer"] [data-test-subj~="tableHeaderCell_node_load_average_3"]"}
│ (Session info: headless chrome=68.0.3440.75)
│ (Driver info: chromedriver=2.42.591071 (0b695ff80972cc1a65a5cd643186d2ae582cd4ac),platform=Linux 4.4.0-141-generic x86_64)
│ at Server._post (/home/liza/TESTING/kibana-6-7-0/test/functional/services/remote/verbose_remote_logging.js:34:21)
│ at runRequest (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:92:40)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:113:39
│ at new Promise (/home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:411:4)
│ at Session._post (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:67:10)
│ at Session.find (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Session.js:1328:15)
│ at Command. (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Command.js:42:36)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:393:16
│ at run (/home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/Promise.ts:237:8)
│ at /home/liza/TESTING/kibana-6-7-0/node_modules/dojo/_debug/nextTick.ts:44:4
│ at process._tickCallback (internal/process/next_tick.js:61:11)
│ at Command.find (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/Command.js:23:10)
│ at Command.prototype.(anonymous function) [as findByCssSelector] (/home/liza/TESTING/kibana-6-7-0/node_modules/leadfoot/lib/strategies.js:29:16)
│ at _ensureElementWithTimeout (/home/liza/TESTING/kibana-6-7-0/test/functional/services/find.js:83:36)
│ at retry.try (/home/liza/TESTING/kibana-6-7-0/test/functional/services/find.js:63:33)
│ at runAttempt (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:39:21)
│ at retryForSuccess (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:67:37)
│ at lastError (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:29:9)
│ at retryForSuccess (/home/liza/TESTING/kibana-6-7-0/test/common/services/retry/retry_for_success.js:63:13)

liza-mae · 2019-02-04T17:55:07Z

fail: "Monitoring app Elasticsearch nodes listing with offline node should sort by memory"
│ Error: expected '25% \n49% max\n25% min' to equal '39% \n52% max\n25% min'
│ at Assertion.assert (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:96:13)
│ at Assertion.be.Assertion.equal (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:216:10)
│ at Assertion.(anonymous function) [as be] (/home/liza/TESTING/kibana-6-7-0/node_modules/expect.js/index.js:69:24)
│ at nodesAll.forEach (test/functional/apps/monitoring/elasticsearch/nodes.js:151:44)
│ at Array.forEach ()
│ at Context.it (test/functional/apps/monitoring/elasticsearch/nodes.js:150:18)
│ at process._tickCallback (internal/process/next_tick.js:68:7)

chrisronline · 2019-02-14T14:13:36Z

Skipping tests for now. Follow https://github.com/elastic/stack-monitoring/issues/31 for updates on when they will be re-added

liza-mae added test Team:Monitoring Stack Monitoring team test_xpack_functional failed-test A test failure on a tracked branch, potentially flaky-test test-cloud labels Feb 4, 2019

This was referenced Feb 5, 2019

[Monitoring] Removing mappings.json from archive data is breaking tests #30152

Closed

[Monitoring] Skip elasticsearch/nodes.js functional test for cloud #30713

Closed

chrisronline closed this as completed Feb 14, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Functional x-pack monitoring tests failing for cloud #29973

Functional x-pack monitoring tests failing for cloud #29973

liza-mae commented Feb 4, 2019

elasticmachine commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

chrisronline commented Feb 14, 2019

Functional x-pack monitoring tests failing for cloud #29973

Functional x-pack monitoring tests failing for cloud #29973

Comments

liza-mae commented Feb 4, 2019

elasticmachine commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

liza-mae commented Feb 4, 2019

chrisronline commented Feb 14, 2019