Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: fix system-tests-firefox downloads flake #20547

Conversation

ryanthemanuel
Copy link
Collaborator

@ryanthemanuel ryanthemanuel commented Mar 9, 2022

User facing changelog

n/a

Additional details

There was a change made on the multi domain branch to fix a flake. The purpose of this change was to ensure that we are waiting for the download of the csv file before we check its contents.

Unfortunately, this left an additional flake. That flake was caused because we were downloading the same file multiple times in different tests and thus the second one actually gets placed at records(1).csv. In addition, the first file download doesn't have the fix that the second file download has so the file is not guaranteed to be downloaded. Therefore when the second test executes it's actually reading the location of the first test's download which may or may not be there.

To fix the second flake, we will limit the test that are run to just download_spec since that is the only test necessary to test switching download locations. Also, since readFile actually will retry until all chained assertions pass, the first fix is no longer necessary and that both flakes will be resolved if we just limit the tests being run to download_spec in this scenario.

How has the user experience changed?

n/a

PR Tasks

  • Have tests been added/updated?
  • [na] Has the original issue (or this PR, if no issue exists) been tagged with a release in ZenHub? (user-facing changes only)
  • [na] Has a PR for user-facing changes been opened in cypress-documentation?
  • [na] Have API changes been updated in the type definitions?
  • [na] Have new configuration options been added to the cypress.schema.json?

@cypress-bot
Copy link
Contributor

cypress-bot bot commented Mar 9, 2022

Thanks for taking the time to open a PR!

@cypress
Copy link

cypress bot commented Mar 9, 2022



Test summary

9265 0 156 2Flakiness 2


Run details

Project cypress
Status Passed
Commit 83d42b9
Started Mar 10, 2022 7:33 PM
Ended Mar 10, 2022 7:45 PM
Duration 12:35 💡
OS Linux Debian - 10.10
Browser Multiple

View run in Cypress Dashboard ➡️


Flakiness

cypress/integration/commands/net_stubbing_spec.ts Flakiness
1 network stubbing > intercepting response > can 'delay' a proxy response using Promise.delay
2 network stubbing > waiting and aliasing > can timeout waiting on a single request using "alias.request"

This comment has been generated by cypress-bot as a result of this project's GitHub integration settings. You can manage this integration in this project's settings in the Cypress Dashboard

@ryanthemanuel ryanthemanuel merged commit ca1857f into feature-multidomain Mar 10, 2022
@ryanthemanuel ryanthemanuel deleted the ryanm/test/fix-system-tests-firefox-downloads branch March 10, 2022 21:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants