Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: X-Pack API Integration Tests.x-pack/test/api_integration/apis/fleet/unenroll_agent·ts - apis Fleet Endpoints fleet_unenroll_agent allow to unenroll using a list of ids #64696

Closed
kibanamachine opened this issue Apr 28, 2020 · 29 comments
Closed

Failing test: X-Pack API Integration Tests.x-pack/test/api_integration/apis/fleet/unenroll_agent·ts - apis Fleet Endpoints fleet_unenroll_agent allow to unenroll using a list of ids #64696

kibanamachine opened this issue Apr 28, 2020 · 29 comments
Assignees
@nchaulet
Labels
bug Fixes for quality problems that affect the customer experience failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Fleet Team label for Observability Data Collection Fleet team v7.9.0

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Apr 28, 2020 •
edited
Loading

A test failed on a tracked branch

Error: expected 200 "OK", got 500 "Internal Server Error"
    at Test._assertStatus (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:268:12)
    at Test._assertFunction (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:283:11)
    at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:173:18)
    at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
    at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
    at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/index.js:718:3)
    at parser (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/index.js:906:18)
    at IncomingMessage.res.on (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/parsers/json.js:19:7)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19)

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Apr 28, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-test-triage (failed-test)

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@mistic mistic mentioned this issue May 4, 2020
Closed
@mistic
Copy link
Member

mistic commented May 4, 2020

@elastic/ingest-management could you look into this please?

@elasticmachine
Copy link
Contributor

Pinging @elastic/endpoint-management (Team:Endpoint Management)

@ph
Copy link
Contributor

ph commented May 4, 2020

@nchaulet Can you take a look?

@nchaulet
Copy link
Member

nchaulet commented May 4, 2020

Looking

@nchaulet
Copy link
Member

nchaulet commented May 4, 2020

Fleet was not able to setup because of an error related to the package manager looks like it's fixed now

[00:08:43]                 │ proc [kibana]  error  [09:22:20.146] [warning][process] UnhandledPromiseRejectionWarning: YAMLException: bad indentation of a sequence entry at line 14, column 9:
[00:08:43]                 │ proc [kibana]     - name: @timestamp
[00:08:43]                 │ proc [kibana]             ^
[00:08:43]                 │ proc [kibana]     at generateError (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:167:10)
[00:08:43]                 │ proc [kibana]     at throwError (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:173:9)
[00:08:43]                 │ proc [kibana]     at readBlockSequence (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:962:7)
[00:08:43]                 │ proc [kibana]     at composeNode (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:1358:12)
[00:08:43]                 │ proc [kibana]     at readDocument (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:1519:3)
[00:08:43]                 │ proc [kibana]     at loadDocuments (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:1575:5)
[00:08:43]                 │ proc [kibana]     at load (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:1596:19)
[00:08:43]                 │ proc [kibana]     at safeLoad (/dev/shm/workspace/install/kibana-7/node_modules/js-yaml/lib/js-yaml/loader.js:1618:10)
[00:08:43]                 │ proc [kibana]     at reduce (/dev/shm/workspace/install/kibana-7/x-pack/plugins/ingest_manager/server/services/epm/fields/field.js:227:25)
[00:08:43]                 │ proc [kibana]     at Array.reduce (<anonymous>)
[00:08:43]                 │ proc [kibana]     at loadFieldsFromYaml (/dev/shm/workspace/install/kibana-7/x-pack/plugins/ingest_manager/server/services/epm/fields/field.js:224:31)
[00:08:43]                 │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:68:7)
[00:08:43]                 │ proc [kibana]     at emitWarning (internal/process/promises.js:97:15)
[00:08:43]                 │ proc [kibana]     at emitPromiseRejectionWarnings (internal/process/promises.js:143:7)
[00:08:43]                 │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:69:34)

@mistic
Copy link
Member

mistic commented May 4, 2020

@nchaulet then do you think that test is not flaky and we can close the PR to skip it?

@nchaulet
Copy link
Member

nchaulet commented May 4, 2020

Yes you can close the PR to skip it,
I think this could really help to avoid this issue in the future #61920

@mistic
Copy link
Member

mistic commented May 4, 2020

closing for now

@mistic mistic closed this as completed May 4, 2020
@kibanamachine kibanamachine reopened this May 20, 2020
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@spalger
Copy link
Contributor

spalger commented May 20, 2020

Snippet from the logs:

└-> "before all" hook
  │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] [.kibana_2/6NmaVv01Tf2Gj2voEu7Rng] update_mapping [_doc]
  │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] applying create index request using v1 templates []
  │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] [logs-index_pattern_placeholder] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
  │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] applying create index request using v1 templates []
  │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] [metrics-index_pattern_placeholder] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
  │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] applying create index request using v1 templates []
  │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] [events-index_pattern_placeholder] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
  │ proc [kibana]   log   [09:49:18.443] [error][ingestManager][plugins] Error connecting to package registry: Not Found
  │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-18-tests-xl-1589964441590935549] [.kibana_2/6NmaVv01Tf2Gj2voEu7Rng] update_mapping [_doc]
└-> allow to unenroll using a list of ids
  └-> "before each" hook: global before each
  └-> "before each" hook
    │ proc [kibana]  error  [09:49:18.493]  Error: Internal Server Error
    │ proc [kibana]     at HapiResponseAdapter.toError (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/response_adapter.js:132:19)
    │ proc [kibana]     at HapiResponseAdapter.toHapiResponse (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/response_adapter.js:86:19)
    │ proc [kibana]     at HapiResponseAdapter.handle (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/response_adapter.js:81:17)
    │ proc [kibana]     at Router.handle (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/router.js:160:34)
    │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:68:7)
  └- ✖ fail: "apis Fleet Endpoints fleet_unenroll_agent allow to unenroll using a list of ids"

│ proc [kibana] log [09:49:18.443] [error][ingestManager][plugins] Error connecting to package registry: Not Found

That looks suspicious, but it also seems to happen before the test starts...

@nchaulet
Copy link
Member

│ proc [kibana] log [09:49:18.443] [error][ingestManager][plugins] Error connecting to package registry: Not Found

This is happening in the beforeEach, so the test probably because of that. This would be fixed if we have a local package registry

@spalger
Copy link
Contributor

spalger commented May 20, 2020

Do you think we should be attempting to recover from that automatically? What does the "Not Found" mean? Do you think that responding with a 500 is the right approach?

@kevinlog kevinlog added Team:Fleet Team label for Observability Data Collection Fleet team and removed Team:Endpoint Management labels Jun 5, 2020
@ph ph added the bug Fixes for quality problems that affect the customer experience label Jun 8, 2020
@ph
Copy link
Contributor

ph commented Jun 8, 2020

@nchaulet can you take a look?

@nchaulet
Copy link
Member

nchaulet commented Jun 8, 2020

@spalger Yes I think a 500 is the right response here, as it's an error that is a major error that will block fleet and ingest manager later, the Not Found Error means that we receive a 404 when try to comunicate from Kibana to the Package registry, I think sonja did some work to have better messaging.

I will close it for now

@nchaulet nchaulet closed this as completed Jun 8, 2020
@kibanamachine kibanamachine reopened this Jun 9, 2020
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@ph
Copy link
Contributor

ph commented Jun 29, 2020

This is still a problem @nchaulet we should fix it.

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@jen-huang
Copy link
Contributor

jen-huang commented Jul 16, 2020 •
edited
Loading

^ This latest failure is due to the same version conflict error seen in #72102 & #72053

@jen-huang jen-huang mentioned this issue Jul 16, 2020
Closed
spalger added a commit that referenced this issue Jul 17, 2020
@spalger
skip flaky suite (#64696)
55da30d
spalger added a commit that referenced this issue Jul 17, 2020
@spalger
skip flaky suite (#64696)
897cc34 
(cherry picked from commit 55da30d)
spalger added a commit that referenced this issue Jul 17, 2020
@spalger
skip flaky suite (#64696)
cb5559a 
(cherry picked from commit 55da30d)
@spalger
Copy link
Contributor

spalger commented Jul 17, 2020

13 failures in PRs and 1 failure in 7.x, skipping

image

master: 55da30d
7.x/7.10: cb5559a
7.9: 897cc34

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

gmmorris added a commit to gmmorris/kibana that referenced this issue Jul 17, 2020
@gmmorris
Merge branch 'master' into task-manager/batch-update-delete
edb3f1e 
* master: (214 commits)
  replacing hard coded links for ela.st (elastic#72240)
  skip flaky suite (elastic#60865)
  chore(NA): teardown dynamic dll plugin (elastic#72096)
  Register navLink actions for declared applications (elastic#72109)
  Fix value for process.hash.sha256 draggable (elastic#72142)
  Call setupIngest before fleet_install tests (elastic#72214)
  [Security Solution][Detections] Better toast errors (elastic#72205)
  skip flaky suite (elastic#64696)
  [Security Solution][Detections] Disable exceptions for Threshold and ML rules (elastic#72137)
  [Security Solution][Detections,Lists] Miscellaneous post-FF fixes (elastic#71990)
  [baseline/capture] use high-memory nodes with ramDisks (elastic#71894)
  skip flaky suite (elastic#77207)
  [Maps] Fix issue preventing TMS from rendering correctly (elastic#71946)
  using test_user with minimum privs (elastic#71988)
  Fixed Webhook connector doesn't retain added HTTP header settings (elastic#71924)
  [Ingest Manager] Do not show enrolling and unenrolling agents as online in agent counters (elastic#71921)
  [Maps] fix 'New Map' from getting added to recently accessed (elastic#72125)
  [Visualizations] Pass 'aggs' parameter to custom request handlers (elastic#71423)
  [Monitoring] Out of the box alert tweaks (elastic#71942)
  [ML] Fix datafeed start time is incorrect when the job has trailing empty buckets (elastic#71976)
  ...
gmmorris added a commit to gmmorris/kibana that referenced this issue Jul 17, 2020
@gmmorris
Merge branch 'master' into alerting/consumer-based-rbac
cbee849 
* master: (55 commits)
  updates 'External alerts' tab text (elastic#72237)
  [Security Solution][Case] Fix connector's dropdown with conflicting requests (elastic#72037)
  replacing hard coded links for ela.st (elastic#72240)
  skip flaky suite (elastic#60865)
  chore(NA): teardown dynamic dll plugin (elastic#72096)
  Register navLink actions for declared applications (elastic#72109)
  Fix value for process.hash.sha256 draggable (elastic#72142)
  Call setupIngest before fleet_install tests (elastic#72214)
  [Security Solution][Detections] Better toast errors (elastic#72205)
  skip flaky suite (elastic#64696)
  [Security Solution][Detections] Disable exceptions for Threshold and ML rules (elastic#72137)
  [Security Solution][Detections,Lists] Miscellaneous post-FF fixes (elastic#71990)
  [baseline/capture] use high-memory nodes with ramDisks (elastic#71894)
  skip flaky suite (elastic#77207)
  [Maps] Fix issue preventing TMS from rendering correctly (elastic#71946)
  using test_user with minimum privs (elastic#71988)
  Fixed Webhook connector doesn't retain added HTTP header settings (elastic#71924)
  [Ingest Manager] Do not show enrolling and unenrolling agents as online in agent counters (elastic#71921)
  [Maps] fix 'New Map' from getting added to recently accessed (elastic#72125)
  [Visualizations] Pass 'aggs' parameter to custom request handlers (elastic#71423)
  ...
gmmorris added a commit to gmmorris/kibana that referenced this issue Jul 17, 2020
@gmmorris
Merge branch 'alerting/consumer-based-rbac' into alerting/management-…
fead80a 
…feature-privileges

* alerting/consumer-based-rbac: (56 commits)
  take into account which features available in the active space
  updates 'External alerts' tab text (elastic#72237)
  [Security Solution][Case] Fix connector's dropdown with conflicting requests (elastic#72037)
  replacing hard coded links for ela.st (elastic#72240)
  skip flaky suite (elastic#60865)
  chore(NA): teardown dynamic dll plugin (elastic#72096)
  Register navLink actions for declared applications (elastic#72109)
  Fix value for process.hash.sha256 draggable (elastic#72142)
  Call setupIngest before fleet_install tests (elastic#72214)
  [Security Solution][Detections] Better toast errors (elastic#72205)
  skip flaky suite (elastic#64696)
  [Security Solution][Detections] Disable exceptions for Threshold and ML rules (elastic#72137)
  [Security Solution][Detections,Lists] Miscellaneous post-FF fixes (elastic#71990)
  [baseline/capture] use high-memory nodes with ramDisks (elastic#71894)
  skip flaky suite (elastic#77207)
  [Maps] Fix issue preventing TMS from rendering correctly (elastic#71946)
  using test_user with minimum privs (elastic#71988)
  Fixed Webhook connector doesn't retain added HTTP header settings (elastic#71924)
  [Ingest Manager] Do not show enrolling and unenrolling agents as online in agent counters (elastic#71921)
  [Maps] fix 'New Map' from getting added to recently accessed (elastic#72125)
  ...
chrisronline pushed a commit to chrisronline/kibana that referenced this issue Jul 17, 2020
@spalger @chrisronline
skip flaky suite (elastic#64696)
e868236
@jen-huang
Copy link
Contributor

Fixed with #72149

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nchaulet nchaulet

Labels
bug Fixes for quality problems that affect the customer experience failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Fleet Team label for Observability Data Collection Fleet team v7.9.0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
9 participants
@ph @spalger @nchaulet @jen-huang @mistic @dmlemeshko @elasticmachine @kibanamachine @kevinlog