Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run cypress in repeat #2537

Conversation

karola312
Copy link
Member

I want to merge this change because I want to be able to run tests in repeat mode via GitHub for checking flaky tests. It's time-consuming to do this locally. Additionally tests results after executing locally can be different than when executed on GitHub Actions

PR intended to be tested with API branch:

Screenshots

Pull Request Checklist

  1. This code contains UI changes
  2. All visible strings are translated with proper context including data-formatting
  3. Attributes [data-test-id] are added for new elements
  4. Changes are mentioned in the changelog
  5. The changes are tested in different browsers and in light/dark mode

Test environment config

API_URI=https://automation-dashboard.staging.saleor.cloud/graphql/
MARKETPLACE_URL=https://apps.saleor.io
SALEOR_APPS_ENDPOINT=https://apps.saleor.io/api/saleor-apps

Do you want to run more stable tests?

To run all tests, just select the stable checkbox. To speed up tests, increase the number of containers. Tests will be re-run only when the "run e2e" label is added.

  1. stable
  2. giftCard
  3. category
  4. collection
  5. attribute
  6. productType
  7. shipping
  8. customer
  9. permissions
  10. menuNavigation
  11. pages
  12. sales
  13. vouchers
  14. homePage
  15. login
  16. orders
  17. products
  18. app
  19. plugins
  20. translations
  21. navigation
  22. variants

CONTAINERS=1

@karola312 karola312 requested a review from a team as a code owner November 4, 2022 16:30
@karola312 karola312 linked an issue Nov 4, 2022 that may be closed by this pull request
@github-actions github-actions bot temporarily deployed to 2534-create-workflow-to-run-tests-in-loop-for-detecting-flaky-t November 4, 2022 16:30 Inactive
@github-actions github-actions bot temporarily deployed to storybook 2534-create-workflow-to-run-tests-in-loop-for-detecting-flaky-t November 4, 2022 16:30 Inactive
@karola312 karola312 requested review from a team, michalina-graczyk and szczecha and removed request for a team November 4, 2022 16:37
@karola312 karola312 added the tests PR with new cypress tests label Nov 4, 2022
NyanKiyoshi
NyanKiyoshi previously approved these changes Nov 8, 2022
Copy link
Member

@NyanKiyoshi NyanKiyoshi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

Comment on lines +34 to +37
- name: Setup Node
uses: actions/setup-node@v3
with:
node-version: 16
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FYI they want to switch to v18 at #2533 - you may need to change the CI if it's merged before your PR

Co-authored-by: Anna Szczęch <30683248+szczecha@users.noreply.github.com>
@github-actions github-actions bot temporarily deployed to 2534-create-workflow-to-run-tests-in-loop-for-detecting-flaky-t November 8, 2022 11:50 Inactive
@github-actions github-actions bot temporarily deployed to storybook 2534-create-workflow-to-run-tests-in-loop-for-detecting-flaky-t November 8, 2022 11:50 Inactive
@karola312 karola312 merged commit 9d4c198 into main Nov 9, 2022
@karola312 karola312 deleted the 2534-create-workflow-to-run-tests-in-loop-for-detecting-flaky-tests branch November 9, 2022 12:56
krzysztofzuraw pushed a commit that referenced this pull request Nov 15, 2022
* Run cypress in repeat

* Update .github/workflows/cypress-repeat.yml

Co-authored-by: Anna Szczęch <30683248+szczecha@users.noreply.github.com>

Co-authored-by: Anna Szczęch <30683248+szczecha@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tests PR with new cypress tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Create workflow to run tests in loop for detecting flaky tests
3 participants