Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix failure case number in test result summary incorrect issue #10485

Merged

Conversation

xwjiang-ms
Copy link
Contributor

Description of PR

Summary:
Fixes # (issue)

Type of change

  • Bug fix
  • Testbed and Framework(new/improvement)
  • Test case(new/improvement)

Back port request

  • 201911
  • 202012
  • 202205
  • 202305

Approach

What is the motivation for this PR?

In test summary, failures += failure + error, but in fact, if a testcase failed with both failure and error, the count of failure and error would both +1, so it's unnecessary to calculate in that way

How did you do it?

Let failures += failure

How did you verify/test it?

Run a test with both failure and error, and check the test result xml file

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation

Copy link
Collaborator

@yejianquan yejianquan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@wangxin wangxin merged commit c40d3d0 into sonic-net:master Oct 26, 2023
18 checks passed
mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Oct 26, 2023
…-net#10485)

What is the motivation for this PR?
In test summary, failures += failure + error, but in fact, if a testcase failed with both failure and error, the count of failure and error would both +1, so it's unnecessary to calculate in that way

How did you do it?
Let failures += failure

How did you verify/test it?
Run a test with both failure and error, and check the test result xml file
@mssonicbld
Copy link
Collaborator

Cherry-pick PR to 202012: #10495

mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Oct 26, 2023
…-net#10485)

What is the motivation for this PR?
In test summary, failures += failure + error, but in fact, if a testcase failed with both failure and error, the count of failure and error would both +1, so it's unnecessary to calculate in that way

How did you do it?
Let failures += failure

How did you verify/test it?
Run a test with both failure and error, and check the test result xml file
@mssonicbld
Copy link
Collaborator

Cherry-pick PR to 202205: #10496

mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Oct 26, 2023
…-net#10485)

What is the motivation for this PR?
In test summary, failures += failure + error, but in fact, if a testcase failed with both failure and error, the count of failure and error would both +1, so it's unnecessary to calculate in that way

How did you do it?
Let failures += failure

How did you verify/test it?
Run a test with both failure and error, and check the test result xml file
@mssonicbld
Copy link
Collaborator

Cherry-pick PR to 202305: #10497

@xwjiang-ms xwjiang-ms deleted the fix_failure_case_number_incorrect branch October 26, 2023 02:42
mssonicbld pushed a commit that referenced this pull request Oct 26, 2023
What is the motivation for this PR?
In test summary, failures += failure + error, but in fact, if a testcase failed with both failure and error, the count of failure and error would both +1, so it's unnecessary to calculate in that way

How did you do it?
Let failures += failure

How did you verify/test it?
Run a test with both failure and error, and check the test result xml file
mssonicbld pushed a commit that referenced this pull request Oct 26, 2023
What is the motivation for this PR?
In test summary, failures += failure + error, but in fact, if a testcase failed with both failure and error, the count of failure and error would both +1, so it's unnecessary to calculate in that way

How did you do it?
Let failures += failure

How did you verify/test it?
Run a test with both failure and error, and check the test result xml file
mssonicbld pushed a commit that referenced this pull request Oct 27, 2023
What is the motivation for this PR?
In test summary, failures += failure + error, but in fact, if a testcase failed with both failure and error, the count of failure and error would both +1, so it's unnecessary to calculate in that way

How did you do it?
Let failures += failure

How did you verify/test it?
Run a test with both failure and error, and check the test result xml file
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants