Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: skip or fix flaky tests #23167

Merged
merged 67 commits into from
Aug 15, 2022
Merged

chore: skip or fix flaky tests #23167

merged 67 commits into from
Aug 15, 2022

Conversation

rachelruderman
Copy link
Contributor

@rachelruderman rachelruderman commented Aug 5, 2022

User facing changelog

n/a

Additional details

This PR skips or fixes flaky tests in CI, thereby restoring our confidence in CI while we work out the kinks. The issues fixed or skipped are commented in the code.

Steps to test

Be impressed by a good amount of green builds in the CircleCI dashboard for this branch. Unfortunately they are not consistently green because we have memory/performance issues where our CPU gets maxed out and causes timeouts sometimes. See issues #23326, #23321 and #23308 for examples of memory exhaustion in CI

How has the user experience changed?

n/a

PR Tasks

  • Have tests been added/updated?
  • [na] Has the original issue (or this PR, if no issue exists) been tagged with a release in ZenHub? (user-facing changes only)
  • [na] Has a PR for user-facing changes been opened in cypress-documentation?
  • [na] Have API changes been updated in the type definitions?

@cypress-bot
Copy link
Contributor

cypress-bot bot commented Aug 5, 2022

Thanks for taking the time to open a PR!

@cypress
Copy link

cypress bot commented Aug 5, 2022



Test summary

37828 0 615 0Flakiness 7


Run details

Project cypress
Status Passed
Commit 1672431
Started Aug 12, 2022 10:05 PM
Ended Aug 12, 2022 10:24 PM
Duration 19:29 💡
OS Linux Debian - 11.3
Browser Multiple

View run in Cypress Dashboard ➡️


Flakiness

cypress/e2e/commands/net_stubbing.cy.ts Flakiness
1 network stubbing > intercepting request > can delay with deprecated delayMs param
2 network stubbing > intercepting request > can delay with deprecated delayMs param
3 network stubbing > intercepting request > can delay with deprecated delayMs param
4 network stubbing > intercepting request > can delay with deprecated delayMs param
5 network stubbing > intercepting request > can delay with deprecated delayMs param
This comment includes only the first 5 flaky tests. See all 7 flaky tests in the Cypress Dashboard.

This comment has been generated by cypress-bot as a result of this project's GitHub integration settings. You can manage this integration in this project's settings in the Cypress Dashboard

cy.contains('Your tests are loading...').should('not.exist')
cy.contains('Your tests are loading...', { timeout: 10000 }).should('not.exist')
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hopeful fix for #23306

@@ -1626,16 +1626,14 @@ describe('network stubbing', function () {
}).then(function () {
$.post('/post-only', 'quuz').done((responseText) => {
expect(responseText).to.contain(body)

done()
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixes 23145. We didn't need done() here -- passing and failing test cases work as expected here without calling done()

@@ -75,18 +75,17 @@ describe('src/cy/commands/actions/type - #type special chars', () => {
})

context('parseSpecialCharSequences: false', () => {
it('types special character sequences literally', (done) => {
Copy link
Contributor Author

@rachelruderman rachelruderman Aug 15, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All skips and fixes in this file are under the umbrella issue 23160

This was referenced Aug 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Restore confidence in CI
3 participants