Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test Cypress test runner against beta / canary versions of Chrome #3096

Closed
bahmutov opened this issue Jan 8, 2019 · 5 comments · Fixed by #16341
Closed

Test Cypress test runner against beta / canary versions of Chrome #3096

bahmutov opened this issue Jan 8, 2019 · 5 comments · Fixed by #16341
Assignees
Labels
process: build Related to our internal build process process: tests Related to our internal tests

Comments

@bahmutov
Copy link
Contributor

bahmutov commented Jan 8, 2019

Problem

New versions of Chrome browser regularly break Cypress because of its changed behavior, and we have to catch up and find browser CLI flags that would fix the new problem.

Proposal

It would be nice to periodically run a small project like cypress-test-tiny or cypress-example-kitchensink against upcoming Chrome version to find out about potential breaking change before that version of Chrome is released as stable.

@bahmutov bahmutov self-assigned this Jan 8, 2019
@bahmutov bahmutov added the process: build Related to our internal build process label Jan 8, 2019
@jennifer-shehane jennifer-shehane added the process: tests Related to our internal tests label Jan 9, 2019
@jennifer-shehane
Copy link
Member

Chromium Versions: https://omahaproxy.appspot.com/

@jennifer-shehane
Copy link
Member

An example of a PR that I need to test exclusively on Chromium 72.0.3605.0+ #3049

@flotwig
Copy link
Contributor

flotwig commented Apr 27, 2021

Based on team discussions, the solution to this looks something like this:

  • create a new driver-integration-tests-chrome-beta job
  • update driver-integration-tests-chrome and driver-integration-tests-chrome-beta to install Chrome from a version stored in some text file in this repository
  • a GitHub action that regularly checks what the latest stable/beta chrome versions are
    • if a new version is available, opens a pull request to update that version text file (known-good-chrome-version.json?) like dependabot does
    • automerges PR on pass, requests reviewer on fail

@cypress-bot
Copy link
Contributor

cypress-bot bot commented May 14, 2021

The code for this is done in cypress-io/cypress#16341, but has yet to be released.
We'll update this issue and reference the changelog when it's released.

@cypress-bot cypress-bot bot added stage: pending release and removed stage: needs review The PR code is done & tested, needs review labels May 14, 2021
@jennifer-shehane
Copy link
Member

This was released in develop.

@cypress-io cypress-io locked as resolved and limited conversation to collaborators May 25, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
process: build Related to our internal build process process: tests Related to our internal tests
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants