Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Acceptance test suite types and matching tag #34519

Open
phil-davis opened this issue Feb 17, 2019 · 1 comment
Open

Acceptance test suite types and matching tag #34519

phil-davis opened this issue Feb 17, 2019 · 1 comment

Comments

@phil-davis
Copy link
Contributor

Acceptance tests are categorized into cli api and webUI. For that we both:

  • start the suite name with cli api or webUI
  • tag every feature file in the suite with cli api or webUI
  • run each suite by name and specify the appropriate tag, e.g. run acceptance test suite cliMain and filter by tag cli

Problem:

  • if a feature file in the suite is missing the appropriate tag, or has the wrong tag, then the test scenarios in that feature do not get run, and no error occurs.

In this case filtering by tag is redundancy that introduces the possibility of "silent" errors. See PR #34517

Think about how to do this better.

@ownclouders
Copy link
Contributor

GitMate.io thinks possibly related issues are #22492 (test), #31579 (test), #22485 (test), #33443 (Acceptance tests static tags), and #33517 ([WIP] Acceptance test for static tags).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants