Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: do not allow experimentalSessionAndOrigin to be available in CT … #21588

Merged
merged 8 commits into from
May 23, 2022

Conversation

AtofStryker
Copy link
Contributor

…per #21573

User facing changelog

Additional details

The goal of this PR is to make experimentalSessionAndOrigin scoped to e2e testing only until we evaluate how session would be used, as well as test isolation, in the CT environment.

Updates to the config have been added to forbid use of the experimentalSessionAndOrigin flag, as well as added tests to make sure experimentalSessionAndOrigin is migrated to the e2e config options and not kept at the root level. There is also an added system test to verify error messaging if a user tries to add the experimentalSessionAndOrigin flag under the component config.

How has the user experience changed?

PR Tasks

  • Have tests been added/updated?
  • Has the original issue (or this PR, if no issue exists) been tagged with a release in ZenHub? (user-facing changes only)
  • Has a PR for user-facing changes been opened in cypress-documentation?
  • Have API changes been updated in the type definitions?
  • Have new configuration options been added to the cypress.schema.json?

@cypress-bot
Copy link
Contributor

cypress-bot bot commented May 20, 2022

Thanks for taking the time to open a PR!

@@ -209,7 +209,7 @@ const resolvedOptions: Array<ResolvedConfigOption> = [
defaultValue: false,
validation: validate.isBoolean,
isExperimental: true,
canUpdateDuringTestTime: true,
canUpdateDuringTestTime: false,
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This probably should be in its own commit, but I noticed we had this enabled to be updated during test time, when it should not be able to be updated during test time.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@AtofStryker is this a breaking change from 9.x?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emilyrohrbough I think it's just wrong here. Should be fine in 9.x. My guess is it wasn't caught when merging in with the 10.x-release branch.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch then!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@emilyrohrbough thank you! I did want to point out though that this did cause some issues with the config flag being set through the global config function for some of the session runner cy-in-cy tests. I moved the session.ui tests to point to a new directory with the session tests moved into it with the experimental flag turned on in the config in e214495, 1677ca0, and fd08b57

@AtofStryker AtofStryker marked this pull request as ready for review May 20, 2022 18:30
@AtofStryker AtofStryker requested review from a team and tgriesser as code owners May 20, 2022 18:30
@AtofStryker
Copy link
Contributor Author

Looks like I need to update the config of some tests 😅

@cypress
Copy link

cypress bot commented May 20, 2022



Test summary

37456 0 454 0Flakiness 6


Run details

Project cypress
Status Passed
Commit 15a75c5
Started May 23, 2022 5:13 PM
Ended May 23, 2022 5:32 PM
Duration 19:07 💡
OS Linux Debian - 10.11
Browser Multiple

View run in Cypress Dashboard ➡️


Flakiness

commands/actions/click.cy.js Flakiness
1 ... > scroll-behavior > can scroll to and click elements in html with scroll-behavior: smooth
commands/net_stubbing.cy.ts Flakiness
1 network stubbing > intercepting response > can throttle a proxy response using res.setThrottle
commands/xhr.cy.js Flakiness
1 ... > logs Method, Status, URL, and XHR
cypress/proxy-logging.cy.ts Flakiness
1 Proxy Logging > request logging > xhr log has response body/status code when xhr response is logged second
2 ... > intercept log has consoleProps with intercept info
This comment includes only the first 5 flaky tests. See all 6 flaky tests in the Cypress Dashboard.

This comment has been generated by cypress-bot as a result of this project's GitHub integration settings. You can manage this integration in this project's settings in the Cypress Dashboard

@AtofStryker AtofStryker merged commit a7ecbec into 10.0-release May 23, 2022
@AtofStryker AtofStryker deleted the bugfix/component-testing-options branch May 23, 2022 17:55
tgriesser added a commit that referenced this pull request May 25, 2022
…pack

* develop:
  test(launchpad): skip failure due to recaptcha on windows, enable more windows jobs (#21620)
  docs: add "Steps to test" to PR template (#21606)
  feat: (origin) handle waiting for aliased intercepts (#21579)
  fix: handle git watch error (#21600)
  fix: Successfully create new specs files that do not have a known extension (#21593)
  chore: release 9.7.0
  fix: do not allow experimentalSessionAndOrigin to be available in CT … (#21588)
  chore: sort the frameworks select dropdown in a more logical way (#21553)
  Trigger Build
  fix: disable ct testing when run via binary (#21540)
  chore: Update Chrome (beta) to 102.0.5005.61 (#21556)
  chore: release @cypress/react-v5.12.5
  fix: add support for Next.js v12.1.6 (#21516)
  chore: release @cypress/schematic-v1.7.0
  feat(cypress/schematic): add headed option and other fixes (#21415)
  chore: release @cypress/vite-dev-server-v2.2.3
  fix: handle specs with white space in vite-dev-server (#21386)
  Empty commit
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

the experimentalSessionAndOrigin feature should not be available in component testing
5 participants