Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: X-Pack Endpoint Integrations Functional Tests on ESS.x-pack/test/security_solution_endpoint/apps/integrations/endpoint_exceptions·ts - endpoint Endpoint Exceptions should add event.module=endpoint to entry if only wildcard operator is present #173441

Closed
kibanamachine opened this issue Dec 14, 2023 · 9 comments · Fixed by #197457
Assignees
Labels
failed-test A test failure on a tracked branch, potentially flaky-test OLM Sprint Team:Defend Workflows “EDR Workflows” sub-team of Security Solution

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Dec 14, 2023

A test failed on a tracked branch

StaleElementReferenceError: stale element reference: stale element not found
  (Session info: chrome=120.0.6099.109)
    at Object.throwDecodedError (node_modules/selenium-webdriver/lib/error.js:524:15)
    at parseHttpResponse (node_modules/selenium-webdriver/lib/http.js:601:13)
    at Executor.execute (node_modules/selenium-webdriver/lib/http.js:529:28)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Task.exec (prevent_parallel_calls.ts:28:20) {
  remoteStacktrace: '#0 0x55f05c513d33 <unknown>\n' +
    '#1 0x55f05c1d0f87 <unknown>\n' +
    '#2 0x55f05c1d7533 <unknown>\n' +
    '#3 0x55f05c1d9a28 <unknown>\n' +
    '#4 0x55f05c1d9b7c <unknown>\n' +
    '#5 0x55f05c220937 <unknown>\n' +
    '#6 0x55f05c220d11 <unknown>\n' +
    '#7 0x55f05c214363 <unknown>\n' +
    '#8 0x55f05c24a36d <unknown>\n' +
    '#9 0x55f05c213db9 <unknown>\n' +
    '#10 0x55f05c24a75e <unknown>\n' +
    '#11 0x55f05c269297 <unknown>\n' +
    '#12 0x55f05c24a0e3 <unknown>\n' +
    '#13 0x55f05c212044 <unknown>\n' +
    '#14 0x55f05c21344e <unknown>\n' +
    '#15 0x55f05c4d8861 <unknown>\n' +
    '#16 0x55f05c4dc785 <unknown>\n' +
    '#17 0x55f05c4c6285 <unknown>\n' +
    '#18 0x55f05c4dd41f <unknown>\n' +
    '#19 0x55f05c4aa20f <unknown>\n' +
    '#20 0x55f05c501028 <unknown>\n' +
    '#21 0x55f05c5011f7 <unknown>\n' +
    '#22 0x55f05c512ed4 <unknown>\n' +
    '#23 0x7fd821ea0609 start_thread\n'
}

First failure: CI Build - 8.12

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Dec 14, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Dec 14, 2023
@kibanamachine kibanamachine added the Team:Defend Workflows “EDR Workflows” sub-team of Security Solution label Dec 14, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-defend-workflows (Team:Defend Workflows)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Dec 14, 2023
gergoabraham added a commit that referenced this issue Jan 16, 2024
## Summary

closes:
- #173685
- #173684
- #173184
- #173441

flaky runner:
- 10x ESS + 10x serverless:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4865
💯 ✅
- 100x ESS +100x serverless:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4869
💯 ✅

> [!caution]
> don't forget to revert the `temp` commit ✅

---------

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
@kibanamachine kibanamachine reopened this Jan 26, 2024
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.12

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.12

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@mistic
Copy link
Member

mistic commented Oct 18, 2024

Skipped.

main: a0ac374

@elastic elastic deleted a comment from kibanamachine Oct 22, 2024
@kibanamachine
Copy link
Contributor Author

Skipped

main: 94ae1a4

kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Oct 24, 2024
…#197457)

## Summary

closes elastic#173184
closes elastic#173441
closes elastic#196003

This PR tries to improve on the `StaleElementReferenceError` happening
in Endpoint Exception tests.

This error is thrown if an element has already been removed from the DOM
when trying to perform an action on it. For some reference, see
elastic#140427

Improvements:
- the part that was failing is wrapped inside the `retryOnStale` helper:
602f229
**note:** actually the test fails have started in December, 2023, but
the line where the fail was in the last test runs were added in May,
2024 (elastic#183471). unfortunately, the
log artifacts from 2023 are already removed from Buildkite, so no
certainty on what happened back then
- another suspicious part was wrapped as well:
ec8c5cf and
e5245ad
- and as an extra, wait for page load:
7cd867f

flaky 50/50 ✅ but this doesn't mean much, as this issue happens quite
rarely ¯\\(◉‿◉)/¯

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
(cherry picked from commit f151e2c)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Oct 24, 2024
…#197457)

## Summary

closes elastic#173184
closes elastic#173441
closes elastic#196003

This PR tries to improve on the `StaleElementReferenceError` happening
in Endpoint Exception tests.

This error is thrown if an element has already been removed from the DOM
when trying to perform an action on it. For some reference, see
elastic#140427

Improvements:
- the part that was failing is wrapped inside the `retryOnStale` helper:
602f229
**note:** actually the test fails have started in December, 2023, but
the line where the fail was in the last test runs were added in May,
2024 (elastic#183471). unfortunately, the
log artifacts from 2023 are already removed from Buildkite, so no
certainty on what happened back then
- another suspicious part was wrapped as well:
ec8c5cf and
e5245ad
- and as an extra, wait for page load:
7cd867f

flaky 50/50 ✅ but this doesn't mean much, as this issue happens quite
rarely ¯\\(◉‿◉)/¯

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
(cherry picked from commit f151e2c)
kibanamachine added a commit that referenced this issue Oct 24, 2024
…197457) (#197662)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[EDR Workflows] Unskip and fix flaky endpoint exceptions FTR
(#197457)](#197457)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Gergő
Ábrahám","email":"gergo.abraham@elastic.co"},"sourceCommit":{"committedDate":"2024-10-24T14:27:08Z","message":"[EDR
Workflows] Unskip and fix flaky endpoint exceptions FTR (#197457)\n\n##
Summary\r\n\r\ncloses #173184 \r\ncloses #173441\r\ncloses
#196003\r\n\r\nThis PR tries to improve on the
`StaleElementReferenceError` happening\r\nin Endpoint Exception
tests.\r\n\r\nThis error is thrown if an element has already been
removed from the DOM\r\nwhen trying to perform an action on it. For some
reference,
see\r\nhttps://github.com//pull/140427\r\n\r\nImprovements:\r\n-
the part that was failing is wrapped inside the `retryOnStale`
helper:\r\n602f2294fddb9bee8b69ebf2fd8382e9f025d59d\r\n**note:**
actually the test fails have started in December, 2023, but\r\nthe line
where the fail was in the last test runs were added in May,\r\n2024
(#183471). unfortunately,
the\r\nlog artifacts from 2023 are already removed from Buildkite, so
no\r\ncertainty on what happened back then\r\n- another suspicious part
was wrapped as well:\r\nec8c5cfd94812c8e5b357e00aac8bfae93ceecf4
and\r\ne5245ad010a02527105a56973465a25feb52ec85\r\n- and as an extra,
wait for page
load:\r\n7cd867fcb9489b24e79066dce750a2381af93d7d\r\n\r\nflaky 50/50 ✅
but this doesn't mean much, as this issue happens quite\r\nrarely
¯\\\\(◉‿◉)/¯\r\n\r\n\r\n### Checklist\r\n\r\nDelete any items that are
not applicable to this PR.\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests changed\r\n\r\n---------\r\n\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>","sha":"f151e2ccaa55cc5e13740f49e88c323c0e1d8f6d","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team:Defend
Workflows","backport:prev-major"],"title":"[EDR Workflows] Unskip and
fix flaky endpoint exceptions
FTR","number":197457,"url":"https://github.com/elastic/kibana/pull/197457","mergeCommit":{"message":"[EDR
Workflows] Unskip and fix flaky endpoint exceptions FTR (#197457)\n\n##
Summary\r\n\r\ncloses #173184 \r\ncloses #173441\r\ncloses
#196003\r\n\r\nThis PR tries to improve on the
`StaleElementReferenceError` happening\r\nin Endpoint Exception
tests.\r\n\r\nThis error is thrown if an element has already been
removed from the DOM\r\nwhen trying to perform an action on it. For some
reference,
see\r\nhttps://github.com//pull/140427\r\n\r\nImprovements:\r\n-
the part that was failing is wrapped inside the `retryOnStale`
helper:\r\n602f2294fddb9bee8b69ebf2fd8382e9f025d59d\r\n**note:**
actually the test fails have started in December, 2023, but\r\nthe line
where the fail was in the last test runs were added in May,\r\n2024
(#183471). unfortunately,
the\r\nlog artifacts from 2023 are already removed from Buildkite, so
no\r\ncertainty on what happened back then\r\n- another suspicious part
was wrapped as well:\r\nec8c5cfd94812c8e5b357e00aac8bfae93ceecf4
and\r\ne5245ad010a02527105a56973465a25feb52ec85\r\n- and as an extra,
wait for page
load:\r\n7cd867fcb9489b24e79066dce750a2381af93d7d\r\n\r\nflaky 50/50 ✅
but this doesn't mean much, as this issue happens quite\r\nrarely
¯\\\\(◉‿◉)/¯\r\n\r\n\r\n### Checklist\r\n\r\nDelete any items that are
not applicable to this PR.\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests changed\r\n\r\n---------\r\n\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>","sha":"f151e2ccaa55cc5e13740f49e88c323c0e1d8f6d"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/197457","number":197457,"mergeCommit":{"message":"[EDR
Workflows] Unskip and fix flaky endpoint exceptions FTR (#197457)\n\n##
Summary\r\n\r\ncloses #173184 \r\ncloses #173441\r\ncloses
#196003\r\n\r\nThis PR tries to improve on the
`StaleElementReferenceError` happening\r\nin Endpoint Exception
tests.\r\n\r\nThis error is thrown if an element has already been
removed from the DOM\r\nwhen trying to perform an action on it. For some
reference,
see\r\nhttps://github.com//pull/140427\r\n\r\nImprovements:\r\n-
the part that was failing is wrapped inside the `retryOnStale`
helper:\r\n602f2294fddb9bee8b69ebf2fd8382e9f025d59d\r\n**note:**
actually the test fails have started in December, 2023, but\r\nthe line
where the fail was in the last test runs were added in May,\r\n2024
(#183471). unfortunately,
the\r\nlog artifacts from 2023 are already removed from Buildkite, so
no\r\ncertainty on what happened back then\r\n- another suspicious part
was wrapped as well:\r\nec8c5cfd94812c8e5b357e00aac8bfae93ceecf4
and\r\ne5245ad010a02527105a56973465a25feb52ec85\r\n- and as an extra,
wait for page
load:\r\n7cd867fcb9489b24e79066dce750a2381af93d7d\r\n\r\nflaky 50/50 ✅
but this doesn't mean much, as this issue happens quite\r\nrarely
¯\\\\(◉‿◉)/¯\r\n\r\n\r\n### Checklist\r\n\r\nDelete any items that are
not applicable to this PR.\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests changed\r\n\r\n---------\r\n\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>","sha":"f151e2ccaa55cc5e13740f49e88c323c0e1d8f6d"}}]}]
BACKPORT-->

Co-authored-by: Gergő Ábrahám <gergo.abraham@elastic.co>
kibanamachine added a commit that referenced this issue Oct 24, 2024
…197457) (#197661)

# Backport

This will backport the following commits from `main` to `8.16`:
- [[EDR Workflows] Unskip and fix flaky endpoint exceptions FTR
(#197457)](#197457)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Gergő
Ábrahám","email":"gergo.abraham@elastic.co"},"sourceCommit":{"committedDate":"2024-10-24T14:27:08Z","message":"[EDR
Workflows] Unskip and fix flaky endpoint exceptions FTR (#197457)\n\n##
Summary\r\n\r\ncloses #173184 \r\ncloses #173441\r\ncloses
#196003\r\n\r\nThis PR tries to improve on the
`StaleElementReferenceError` happening\r\nin Endpoint Exception
tests.\r\n\r\nThis error is thrown if an element has already been
removed from the DOM\r\nwhen trying to perform an action on it. For some
reference,
see\r\nhttps://github.com//pull/140427\r\n\r\nImprovements:\r\n-
the part that was failing is wrapped inside the `retryOnStale`
helper:\r\n602f2294fddb9bee8b69ebf2fd8382e9f025d59d\r\n**note:**
actually the test fails have started in December, 2023, but\r\nthe line
where the fail was in the last test runs were added in May,\r\n2024
(#183471). unfortunately,
the\r\nlog artifacts from 2023 are already removed from Buildkite, so
no\r\ncertainty on what happened back then\r\n- another suspicious part
was wrapped as well:\r\nec8c5cfd94812c8e5b357e00aac8bfae93ceecf4
and\r\ne5245ad010a02527105a56973465a25feb52ec85\r\n- and as an extra,
wait for page
load:\r\n7cd867fcb9489b24e79066dce750a2381af93d7d\r\n\r\nflaky 50/50 ✅
but this doesn't mean much, as this issue happens quite\r\nrarely
¯\\\\(◉‿◉)/¯\r\n\r\n\r\n### Checklist\r\n\r\nDelete any items that are
not applicable to this PR.\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests changed\r\n\r\n---------\r\n\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>","sha":"f151e2ccaa55cc5e13740f49e88c323c0e1d8f6d","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","v9.0.0","Team:Defend
Workflows","backport:prev-major"],"title":"[EDR Workflows] Unskip and
fix flaky endpoint exceptions
FTR","number":197457,"url":"https://github.com/elastic/kibana/pull/197457","mergeCommit":{"message":"[EDR
Workflows] Unskip and fix flaky endpoint exceptions FTR (#197457)\n\n##
Summary\r\n\r\ncloses #173184 \r\ncloses #173441\r\ncloses
#196003\r\n\r\nThis PR tries to improve on the
`StaleElementReferenceError` happening\r\nin Endpoint Exception
tests.\r\n\r\nThis error is thrown if an element has already been
removed from the DOM\r\nwhen trying to perform an action on it. For some
reference,
see\r\nhttps://github.com//pull/140427\r\n\r\nImprovements:\r\n-
the part that was failing is wrapped inside the `retryOnStale`
helper:\r\n602f2294fddb9bee8b69ebf2fd8382e9f025d59d\r\n**note:**
actually the test fails have started in December, 2023, but\r\nthe line
where the fail was in the last test runs were added in May,\r\n2024
(#183471). unfortunately,
the\r\nlog artifacts from 2023 are already removed from Buildkite, so
no\r\ncertainty on what happened back then\r\n- another suspicious part
was wrapped as well:\r\nec8c5cfd94812c8e5b357e00aac8bfae93ceecf4
and\r\ne5245ad010a02527105a56973465a25feb52ec85\r\n- and as an extra,
wait for page
load:\r\n7cd867fcb9489b24e79066dce750a2381af93d7d\r\n\r\nflaky 50/50 ✅
but this doesn't mean much, as this issue happens quite\r\nrarely
¯\\\\(◉‿◉)/¯\r\n\r\n\r\n### Checklist\r\n\r\nDelete any items that are
not applicable to this PR.\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests changed\r\n\r\n---------\r\n\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>","sha":"f151e2ccaa55cc5e13740f49e88c323c0e1d8f6d"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/197457","number":197457,"mergeCommit":{"message":"[EDR
Workflows] Unskip and fix flaky endpoint exceptions FTR (#197457)\n\n##
Summary\r\n\r\ncloses #173184 \r\ncloses #173441\r\ncloses
#196003\r\n\r\nThis PR tries to improve on the
`StaleElementReferenceError` happening\r\nin Endpoint Exception
tests.\r\n\r\nThis error is thrown if an element has already been
removed from the DOM\r\nwhen trying to perform an action on it. For some
reference,
see\r\nhttps://github.com//pull/140427\r\n\r\nImprovements:\r\n-
the part that was failing is wrapped inside the `retryOnStale`
helper:\r\n602f2294fddb9bee8b69ebf2fd8382e9f025d59d\r\n**note:**
actually the test fails have started in December, 2023, but\r\nthe line
where the fail was in the last test runs were added in May,\r\n2024
(#183471). unfortunately,
the\r\nlog artifacts from 2023 are already removed from Buildkite, so
no\r\ncertainty on what happened back then\r\n- another suspicious part
was wrapped as well:\r\nec8c5cfd94812c8e5b357e00aac8bfae93ceecf4
and\r\ne5245ad010a02527105a56973465a25feb52ec85\r\n- and as an extra,
wait for page
load:\r\n7cd867fcb9489b24e79066dce750a2381af93d7d\r\n\r\nflaky 50/50 ✅
but this doesn't mean much, as this issue happens quite\r\nrarely
¯\\\\(◉‿◉)/¯\r\n\r\n\r\n### Checklist\r\n\r\nDelete any items that are
not applicable to this PR.\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests changed\r\n\r\n---------\r\n\r\nCo-authored-by:
Elastic Machine
<elasticmachine@users.noreply.github.com>","sha":"f151e2ccaa55cc5e13740f49e88c323c0e1d8f6d"}}]}]
BACKPORT-->

Co-authored-by: Gergő Ábrahám <gergo.abraham@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-test A test failure on a tracked branch, potentially flaky-test OLM Sprint Team:Defend Workflows “EDR Workflows” sub-team of Security Solution
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants