Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[test] Disable BrowserStack for PRs #28041

Merged
merged 2 commits into from
Aug 30, 2021

Conversation

eps1lon
Copy link
Member

@eps1lon eps1lon commented Aug 30, 2021

  1. Limited ressources on BrowserStack lead starvation of the test_browser CircleCI job
  2. Number of commits in PRs is way bigger than the number of merged commits
  3. BrowserStack rarely fails with actual issues

We can save a lot of ressources by only running BS on merged commits. BS now acts as a stop gap for broken releases not broken merges.

Closes #27991

Documentation of new workflow

Usual PR run (now with no BrowserStack): https://app.circleci.com/pipelines/github/mui-org/material-ui/51444/workflows/b40d81d2-6f75-431e-b6b6-3b1f480300a2/jobs/290265
PR with "parameters": { "browserstack-force": true } i.e. with BrowserStack: https://app.circleci.com/pipelines/github/mui-org/material-ui/51447/workflows/7323cfaa-357d-410f-9d4f-2c16cb696b74/jobs/290290

@eps1lon eps1lon added the test label Aug 30, 2021
@mui-pr-bot
Copy link

mui-pr-bot commented Aug 30, 2021

No bundle size changes (experimental)

Generated by 🚫 dangerJS against ff7ef61

@eps1lon eps1lon force-pushed the test/disable-browserstack-pr branch from 5700207 to ff7ef61 Compare August 30, 2021 05:29
@eps1lon eps1lon marked this pull request as ready for review August 30, 2021 05:54
@eps1lon eps1lon merged commit c29d229 into mui:next Aug 30, 2021
@eps1lon eps1lon deleted the test/disable-browserstack-pr branch August 30, 2021 05:56
@oliviertassinari oliviertassinari changed the title [test] Disable browserstack for PRs [test] Disable BrowserStack for PRs Sep 4, 2021
@oliviertassinari
Copy link
Member

oliviertassinari commented Sep 5, 2021

A follow-up on this PR has been done at #28171.

@flaviendelangle I have cherry-picked it on MUI X: mui/mui-x@e6cae75. It's similar to mui/mui-x#2500 but more efficient, as the test_browser step is not BrowserStack only dependent, it also runs in Chrome headless, inside CircleCI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[test] Failing BrowserStack tests
3 participants