Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect Code coverage report on VSTS #1626

Closed
smadala opened this issue May 31, 2018 · 0 comments
Closed

Incorrect Code coverage report on VSTS #1626

smadala opened this issue May 31, 2018 · 0 comments
Assignees
Labels

Comments

@smadala
Copy link
Contributor

smadala commented May 31, 2018

Description

  • Partial code coverage report getting generated when publish the trx with Publish Test results task.

Steps to reproduce

  • Run code coverage in parallel.
  • Publish trx file using Publish Test results task.

Expected behavior

  • All the code coverage attachments should get uploaded.

https://devdiv.visualstudio.com/DevDiv/VS.in%20Agile%20Testing%20IDE/_build/index?buildId=1734156&_a=summary

2018-05-31T07:12:22.2029903Z ##[debug]Reading test results from file 'E:\A\_work\62\s\TestResults\Parallel_netcoreapp1.0_TrxLogResults.trx'
2018-05-31T07:12:22.2449906Z ##[debug]Setting run start and finish times.
2018-05-31T07:12:22.2450653Z ##[debug]Attachment location: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In
2018-05-31T07:12:22.2452381Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58.coverage
2018-05-31T07:12:22.2452923Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58[1].coverage
2018-05-31T07:12:22.2453442Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58[2].coverage
2018-05-31T07:12:22.2454137Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58[3].coverage
2018-05-31T07:12:22.2454735Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58[4].coverage
2018-05-31T07:12:22.2455190Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58[5].coverage
2018-05-31T07:12:22.2455603Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_11_13.coverage
2018-05-31T07:12:22.2456060Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_11_12.coverage
2018-05-31T07:12:22.2456521Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_11_14.coverage
2018-05-31T07:12:22.2457225Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_11_14[1].coverage
2018-05-31T07:12:22.2457683Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58[6].coverage
2018-05-31T07:12:22.2458096Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_11_16.coverage
2018-05-31T07:12:22.2458547Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_10_58[7].coverage
2018-05-31T07:12:22.2459119Z ##[debug]Adding run level attachment: E:\A\_work\62\s\TestResults\dlab14_DDMBLDW132_2018-05-31_00_11_11\In\DDMBLDW132\dlab14_DDMBLDW132_2018-05-31.00_11_16[1].coverage
2018-05-31T07:12:22.2702206Z ##[debug]Total test results: 1643

image

Actual behavior

  • Shows partial code coverage report(observer same file adding as run level attachments multiple times). If there is multiple code coverage files with same name then only one gets uploads.

https://devdiv.visualstudio.com/DevDiv/VS.in%20Agile%20Testing%20IDE/_build/index?buildId=1730978&_a=summary

2018-05-30T12:06:30.4124234Z ##[debug]Reading test results from file 'E:\A\_work\7\s\TestResults\Parallel_netcoreapp1.0_TrxLogResults.trx'
2018-05-30T12:06:30.4579170Z ##[debug]Setting run start and finish times.
2018-05-30T12:06:30.4580200Z ##[debug]Attachment location: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In
2018-05-30T12:06:30.4581681Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4582266Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4583131Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4583608Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4584063Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4584520Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_18.coverage
2018-05-30T12:06:30.4584972Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4585446Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4585871Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_21.coverage
2018-05-30T12:06:30.4586772Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_20.coverage
2018-05-30T12:06:30.4587334Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_23.coverage
2018-05-30T12:06:30.4588067Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_24.coverage
2018-05-30T12:06:30.4588582Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_06.coverage
2018-05-30T12:06:30.4589059Z ##[debug]Adding run level attachment: E:\A\_work\7\s\TestResults\dlab14_DDMBLDW131_2018-05-30_05_05_18\In\DDMBLDW131\dlab14_DDMBLDW131_2018-05-30.05_05_25.coverage
2018-05-30T12:06:30.4820740Z ##[debug]Total test results: 1643

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant