Failed test: baseservices/exceptions/unhandled/unhandledTester/unhandledTester

[jkotas]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=625874
Build error leg or test failing: baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd
Pull request: #100375

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Failed test: baseservices/exceptions/unhandled/unhandledTester/unhandledTester",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=625874
Error message validated: [Failed test: baseservices/exceptions/unhandled/unhandledTester/unhandledTester]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/1/2024 7:18:14 PM UTC

Report

Build	Definition	Test	Pull Request
750859	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#105278
750809	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd
750537	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#105206
748928	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#105185
748909	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#105184
746435	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#104731
733445	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#104458
725502	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd
723841	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#104104
721862	dotnet/runtime	baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd	#104003

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	5	10

[jkotas]

cc @janvorli

[janvorli]

There is something wrong with the test infra. It seems that it executes the testing apps that fail with unhandled exception as separate tests even though they have <CLRTestKind>BuildOnly</CLRTestKind> in their .csproj files. As you can see below, the unhandled.sh was executed and then the two sub-projects that are not supposed to be run separately were run too.

06:04:08.457 Passed test: baseservices/exceptions/unhandled/unhandled/unhandled.cmd
06:04:08.461 Running test: baseservices/exceptions/unhandled/unhandledmissingdependency/unhandledmissingdependency.cmd
Test executable '/private/tmp/helix/working/A7D20967/w/B6100991/e/baseservices/exceptions/baseservices-exceptions/../unhandled/unhandledmissingdependency/unhandledmissingdependency.sh' not found, skipping.
06:04:08.465 Passed test: baseservices/exceptions/unhandled/unhandledmissingdependency/unhandledmissingdependency.cmd
06:04:08.472 Running test: baseservices/exceptions/unhandled/unhandledTester/unhandledTester.cmd

@jkoritzinsky do you have any idea what could be wrong with it?

[janvorli]

Hmm, maybe that's just a quirk and the helpers were actually not executed separately.

[janvorli]

Anyways, given the logs I have added to the test recently, I can see that the main test never completes waiting for the child test helper process.

[janvorli]

All the failures are on macOS x64, a recent PR has disabled this test on this platform.