-
Notifications
You must be signed in to change notification settings - Fork 54
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
(Likely) fix flaky sidebar tests #888
Conversation
e96cad9
to
6f4fee1
Compare
6f4fee1
to
390736f
Compare
@skjnldsv, may I draw your attention to this PR before the others, It will likely make the CI of the other tests more deterministic |
We're supposed to hide disable the hiding during testing 🙈 Line 29 in 9d33800
|
Odd, that is not working in my local cypress, but maybe I did something wrong. I throttled cypresses download speed and noticed this problem. |
The isTesting variable is definitely working, since I see the debug line in the cypress building tests. Lines 13 to 15 in 9d33800
|
I guess there is something else, let me check |
Yep, the UI doesn't hide when testing is senbaled, so it works. Because there is no way to currently wait for the Sidebar to be done opening, we have a weird setTimeout, but sometimes it fails 🤔 |
@beardhatcode nextcloud-libraries/nextcloud-vue#1914 Then we could have this into the Sidebar app and wait for proper events to either finish the Promise Or add a dedicated callback method :) |
8555a38
to
65dcf9c
Compare
Here is a video that shows that the sidebar is really not working in some cases: |
3b595fc
to
6641c65
Compare
Signed-off-by: Robbert Gurdeep Singh <git@beardhatcode.be>
6641c65
to
8026580
Compare
Ok, so it appears that something is going wrong with clicking on the "Open Sidebar" button. I assume this is caused by the transition (but it would be weird if that were the case), so I added some waits, and now it seems to work reproducibly: https://dashboard.cypress.io/projects/xysa6x/runs/2581/overview The odd thing is: if this works, why doesn't the download spec fail, it does basically the same with no problem: viewer/cypress/integration/download.spec.js Lines 64 to 69 in a3f5c6a
|
@skjnldsv, could you take another look at this? |
First pr has been merged and backported |
But that will not fix the issue @skjnldsv. The sidebar really doesn't open, and that is why the test fails. See the video in: https://dashboard.cypress.io/projects/xysa6x/runs/2577/test-results/b71e2024-b304-4b4c-8b42-ec7cb70f91c8 |
I think this might fix the flaky test for the sidebar.
The issue was likey caused because the click to open the menu occured while the header was not visible. The act of clicking
however revealed the header without opening the menu. As a concequence, the next step does not have a menu item to
click on.
successful runs via CI (triggered by force pushes to this branch):