Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add scenario result to webUI test output #31408

Merged
merged 1 commit into from
May 10, 2018
Merged

Add scenario result to webUI test output #31408

merged 1 commit into from
May 10, 2018

Conversation

phil-davis
Copy link
Contributor

Description

Report scenario pass/fail status in the output of webUI tests, even when the tests is not running on SauceLabs.

Motivation and Context

When running webUI acceptance tests on Travis+SauceLabs we write the result of each scenario to the output log. This is handy for quickly finding the scenarios that failed. You can search for (fail)

But when running locally or on drone, this handy output line is not written.

How Has This Been Tested?

Local webUI test run.

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Acceptance test enhancement

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

@phil-davis
Copy link
Contributor Author

While merging webUI test script functionality into the API acceptance test run.sh script, I was annoyed by this "missing" output again. So it would be nice to "fix" it in this separate PR. Then I will also move this behavior over into the run.sh script.

@phil-davis
Copy link
Contributor Author

Backport stable10 #31409

@codecov
Copy link

codecov bot commented May 10, 2018

Codecov Report

Merging #31408 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##             master   #31408    +/-   ##
==========================================
  Coverage     62.64%   62.64%            
+ Complexity    18416    18255   -161     
==========================================
  Files          1145     1145            
  Lines         68480    68480            
  Branches       1234     1234            
==========================================
  Hits          42897    42897            
  Misses        25222    25222            
  Partials        361      361
Flag Coverage Δ Complexity Δ
#javascript 52.05% <ø> (ø) 0 <ø> (ø) ⬇️
#phpunit 63.84% <ø> (ø) 18255 <ø> (-161) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e0b1ddc...79dbde1. Read the comment docs.

@lock
Copy link

lock bot commented Jul 30, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked as resolved and limited conversation to collaborators Jul 30, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants