Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Failing Test] Fixes Spaces Data Before All Failure #147519

Merged

Conversation

jeramysoucy
Copy link
Contributor

@jeramysoucy jeramysoucy commented Dec 14, 2022

Fixes #52714
Fixes #52715

After all failure likely due to before failure - when before fails, the data set is not installed and cannot be removed.

Before all failure seems likely to be a race condition of one or more elements being 'not interactable'. I was unable to reproduce the issue locally and via a Flaky Test Runner, but walking through the code noticed an incorrect attribute reference and a few places where we could improve determinism.

  • Replaced 'showSampleDataAccordion'->'class' check with 'showSampleDataButton'->'aria-expanded'
  • Added deterministic verification of sample data accordion open
  • Mirrored previous timing/enable check fix to 'removeSampleDataSet' in 'addSampleDataSet'
  • Improved determinism in 'removeSampleDataSet', adding an initial check for whether the data set was installed
  • Added additional debug logs to improve any future troubleshooting

@jeramysoucy jeramysoucy added release_note:skip Skip the PR/issue when compiling release notes v8.7.0 Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more! test-failure-flaky labels Dec 14, 2022
@jeramysoucy jeramysoucy marked this pull request as ready for review December 14, 2022 20:07
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-security (Team:Security)

@jeramysoucy jeramysoucy added the backport:skip This commit does not require backporting label Dec 14, 2022
@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

Unknown metric groups

ESLint disabled in files

id before after diff
osquery 1 2 +1

ESLint disabled line counts

id before after diff
enterpriseSearch 19 21 +2
fleet 61 67 +6
osquery 109 115 +6
securitySolution 445 451 +6
total +20

Total ESLint disabled count

id before after diff
enterpriseSearch 20 22 +2
fleet 70 76 +6
osquery 110 117 +7
securitySolution 521 527 +6
total +21

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Copy link
Contributor

@thomheymann thomheymann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@jeramysoucy jeramysoucy merged commit c2be109 into elastic:main Dec 15, 2022
@jeramysoucy jeramysoucy deleted the fixes-flaky-spaces-data-before-all branch December 15, 2022 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting release_note:skip Skip the PR/issue when compiling release notes Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more! test-failure-flaky v8.7.0
Projects
None yet
5 participants