Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dotnet-watch tests failing #40006

Open
dsplaisted opened this issue Apr 4, 2024 · 12 comments
Open

dotnet-watch tests failing #40006

dsplaisted opened this issue Apr 4, 2024 · 12 comments
Assignees
Labels
Milestone

Comments

@dsplaisted
Copy link
Member

dsplaisted commented Apr 4, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=629827
Build error leg or test failing: dotnet-watch.Tests.dll.1.WorkItemExecution
Pull request: #39888

Error Message

##[error].packages/microsoft.dotnet.helix.sdk/8.0.0-beta.24177.1/tools/Microsoft.DotNet.Helix.Sdk.MultiQueue.targets(89,5): error : (NETCORE_ENGINEERING_TELEMETRY=Test) Work item dotnet-watch.Tests.dll.1 in job 82728a56-9430-4356-ab82-1c21670792a7 has failed

{
  "ErrorMessage": "",
  "ErrorPattern": "Work item dotnet-watch\\.Tests\\.dll\\.1 in job [a-z0-9\\-]+ has failed",
  "BuildRetry": true,
  "ExcludeConsoleLog": true
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=629827
Error message validated: [Work item dotnet-watch\.Tests\.dll\.1 in job [a-z0-9\-]+ has failed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/4/2024 9:51:10 AM UTC

Report

Build Definition Step Name Console log Pull Request
966586 dotnet/sdk 🟣 Run FullFramework Tests Log #47212
965524 dotnet/sdk Run TestBuild Tests Log #47021
965388 dotnet/sdk Run TestBuild Tests Log #47184
965182 dotnet/sdk 🟣 Run TestBuild Tests Log #47175
965175 dotnet/sdk Run TestBuild Tests Log #47174
965066 dotnet/sdk 🟣 Run TestBuild Tests Log #47169
964829 dotnet/sdk 🟣 Run TestBuild Tests Log #47159
964710 dotnet/sdk 🟣 Run FullFramework Tests Log #47146
964688 dotnet/sdk 🟣 Run TestBuild Tests Log #47157
964593 dotnet/sdk Run TestBuild Tests Log #47119
964145 dotnet/sdk Run TestBuild Tests Log #47112
964071 dotnet/sdk 🟣 Run TestBuild Tests Log #47144
964037 dotnet/sdk Run TestBuild Tests Log #47143
963883 dotnet/sdk Run TestBuild Tests Log #47112
963332 dotnet/sdk 🟣 Run TestBuild Tests Log #47126
963730 dotnet/sdk 🟣 Run TestBuild Tests Log #47135
963545 dotnet/sdk 🟣 Run TestBuild Tests Log #46967
963574 dotnet/sdk 🟣 Run TestBuild Tests Log #47135
963272 dotnet/sdk 🟣 Run TestBuild Tests Log #46967
963137 dotnet/sdk 🟣 Run TestBuild Tests Log #47101
963293 dotnet/sdk 🟣 Run TestBuild Tests Log #47120
963158 dotnet/sdk 🟣 Run TestBuild Tests Log #47048
963152 dotnet/sdk 🟣 Run TestBuild Tests Log #47069
963298 dotnet/sdk Run TestBuild Tests Log #47123
963324 dotnet/sdk 🟣 Run TestBuild Tests Log #47116
963292 dotnet/sdk 🟣 Run TestBuild Tests Log #47121
963283 dotnet/sdk 🟣 Run TestBuild Tests Log #47085
963125 dotnet/sdk 🟣 Run TestBuild Tests Log #47116
963143 dotnet/sdk 🟣 Run TestBuild Tests Log #47096
963164 dotnet/sdk 🟣 Run TestBuild Tests Log #47001
963134 dotnet/sdk 🟣 Run TestBuild Tests Log #47109
963049 dotnet/sdk Run TestBuild Tests Log #47068
963080 dotnet/sdk 🟣 Run TestBuild Tests Log #47114
963030 dotnet/sdk 🟣 Run TestBuild Tests Log #47106
962908 dotnet/sdk 🟣 Run TestBuild Tests Log #47110
962410 dotnet/sdk 🟣 Run FullFramework Tests Log #47101
961913 dotnet/sdk 🟣 Run TestBuild Tests Log #47001
962175 dotnet/sdk 🟣 Run TestBuild Tests Log #47032
962311 dotnet/sdk 🟣 Run TestBuild Tests Log #47096
962734 dotnet/sdk 🟣 Run TestBuild Tests Log #47107
962168 dotnet/sdk 🟣 Run TestBuild Tests Log #47081
962109 dotnet/sdk 🟣 Run TestBuild Tests Log #47069
961905 dotnet/sdk 🟣 Run FullFramework Tests Log #46967
961915 dotnet/sdk 🟣 Run TestBuild Tests Log #47002
961908 dotnet/sdk 🟣 Run TestBuild Tests Log #47086
961850 dotnet/sdk 🟣 Run FullFramework Tests Log #47032
961810 dotnet/sdk Run TestBuild Tests Log #47082
961609 dotnet/sdk 🟣 Run TestBuild Tests Log #47076
961456 dotnet/sdk 🟣 Run FullFramework Tests Log #46967
961388 dotnet/sdk 🟣 Run TestBuild Tests Log #47032
961129 dotnet/sdk 🟣 Run TestBuild Tests Log #46967
961268 dotnet/sdk 🟣 Run TestBuild Tests Log #47067
961216 dotnet/sdk 🟣 Run TestBuild Tests Log #47064
961193 dotnet/sdk 🟣 Run FullFramework Tests Log #47015
960086 dotnet/sdk 🟣 Run TestBuild Tests Log #47035
960955 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
960748 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
960718 dotnet/sdk 🟣 Run TestBuild Tests Log #47056
960708 dotnet/sdk 🟣 Run TestBuild Tests Log #47055
960644 dotnet/sdk Run TestBuild Tests Log #47033
960675 dotnet/sdk 🟣 Run TestBuild Tests Log #47025
960133 dotnet/sdk 🟣 Run TestBuild Tests Log #47026
960156 dotnet/sdk Run TestBuild Tests Log #46931
959746 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
959668 dotnet/sdk 🟣 Run TestBuild Tests Log #47001
959727 dotnet/sdk 🟣 Run TestBuild Tests Log #47032
959676 dotnet/sdk 🟣 Run TestBuild Tests Log #47003
959119 dotnet/sdk 🟣 Run TestBuild Tests Log #46991
959171 dotnet/sdk 🟣 Run FullFramework Tests Log #47002
959006 dotnet/sdk 🟣 Run TestBuild Tests Log #46994
959023 dotnet/sdk Run FullFramework Tests Log #46920
959063 dotnet/sdk Run TestBuild Tests Log #47021
959076 dotnet/sdk 🟣 Run TestBuild Tests Log #47023
959003 dotnet/sdk 🟣 Run FullFramework Tests Log #47019
958956 dotnet/sdk 🟣 Run TestBuild Tests Log #47013
958941 dotnet/sdk Run TestBuild Tests Log #46920
958812 dotnet/sdk 🟣 Run TestBuild Tests Log #46988
958903 dotnet/sdk 🟣 Run TestBuild Tests Log #47013
958860 dotnet/sdk 🟣 Run TestBuild Tests Log #47011
958752 dotnet/sdk Run FullFramework Tests Log #47010
958676 dotnet/sdk 🟣 Run TestBuild Tests Log #46998
958621 dotnet/sdk 🟣 Run TestBuild Tests Log #46997
958601 dotnet/sdk Run FullFramework Tests Log #47006
958540 dotnet/sdk 🟣 Run TestBuild Tests Log #46998
958534 dotnet/sdk Run FullFramework Tests Log #46931
958488 dotnet/sdk 🟣 Run TestBuild Tests Log #46965
958384 dotnet/sdk 🟣 Run TestBuild Tests Log #46973
958118 dotnet/sdk Run FullFramework Tests Log #46989
957939 dotnet/sdk 🟣 Run FullFramework Tests Log #46983
957745 dotnet/sdk 🟣 Run TestBuild Tests Log #46915
957614 dotnet/sdk 🟣 Run TestBuild Tests Log #46981
957581 dotnet/sdk 🟣 Run TestBuild Tests Log #46954
957549 dotnet/sdk 🟣 Run TestBuild Tests Log #46972
957414 dotnet/sdk 🟣 Run TestBuild Tests Log #46968
957373 dotnet/sdk 🟣 Run TestBuild Tests Log #46965
957429 dotnet/sdk 🟣 Run TestBuild Tests Log #46971
957416 dotnet/sdk 🟣 Run TestBuild Tests Log #46970
2646299 dotnet-sdk Run FullFramework Tests Log #47785
957206 dotnet/sdk 🟣 Run TestBuild Tests Log #46963
957160 dotnet/sdk 🟣 Run FullFramework Tests Log #46927
Displaying 100 of 352 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 63 333
@marcpopMSFT
Copy link
Member

@tmat
Copy link
Member

tmat commented Jun 26, 2024

No luck yet. This might help: https://github.com/dotnet/sdk/blob/d45e40d665e647804de03d2b4eec2aae9c488cb5/test/dotnet-watch.Tests/xunit.runner.json

It will print out test info every 20 seconds a test is running.

@marcpopMSFT
Copy link
Member

@tmat another failure this morning shows a bunch of build processes for watch apps still running... https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-sdk-refs-pull-41958-merge-84357342ee154a5088/dotnet-watch.Tests.dll.2/1/console.3dddc463.log?helixlogtype=result

@tmat
Copy link
Member

tmat commented Jul 3, 2024

Looks like that's in 8.0 branch. Porting test diagnostics from 9: #41963

@Forgind
Copy link
Member

Forgind commented Aug 26, 2024

This has been making one of my PRs fail today, so I looked into it a bit. Based on when this issue was created and which tests are failing, I suspect this PR:
#39618

I asked jasonmalinowski whether the MSBuildWorkspace is supposed to support F# because I'd found a code snippet that suggested that it shouldn't, and he said it doesn't and never did. Did that PR make us use MSBuildWorkspace in a different way than we had before?

@Forgind
Copy link
Member

Forgind commented Aug 26, 2024

The changes to HotReloadDotNetWatcher look most suspicious to me. It looks like a substantial change to how we call MSBuild.

@Forgind
Copy link
Member

Forgind commented Jan 18, 2025

Ping @tmat
This is still a serious pain point, currently preventing MSBuild from merging their code flow to 9.0.2xx. I already clicked rerun twice. I pointed to a PR that I think is likely to blame.

@tmat
Copy link
Member

tmat commented Jan 19, 2025

Fixes targeting 9.0.3xx: #45999, #46141

@nagilson
Copy link
Member

@tmat Thank you for making some PRs to try to remedy this -- we are still seeing this in 9.0.2xx, 9.0.1xx, and main, 10 preview 2. Do your changes need to be ported?

@tmat
Copy link
Member

tmat commented Feb 20, 2025

They don't flow automatically to main?

Re 9.0.2xx, 9.0.1xx - these are product changes. Do they meet the servicing bar?

@nagilson
Copy link
Member

nagilson commented Feb 20, 2025

They should flow to main, but either something went wrong and it didn't for those PRs, or the fix did not work, since it is still showing up in .net 10 preview 2: #46983

I dont think they would meet the bar that, so good point. 9.0.3xx though, they probably do.

@tmat
Copy link
Member

tmat commented Feb 21, 2025

Might be something else causing failure in 10 P2. Do you have a link to the failed run? The PR is merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants