Some Helix workitems fail with "ModuleNotFoundError: No module named 'pkg_resources'"

[jakobbotsch]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1285578

Build leg reported

Regression_6.WorkItemExecution

Pull Request

dotnet/runtime#124083

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "ModuleNotFoundError: No module named 'pkg_resources'",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

[am11]

Issue tracking is not capturing the PRs (query looks correct) but this is quite widespread in helix rn.

[jakobbotsch]

I believe a fix was being deployed last night, so hopefully we don't see this hitting on newer PRs.

[hoyosjs]

This issue hit every workitem that didn't pass - despite failures. We should try not to use build analysis auto-green for these kinds of things (infra on the ground kind of thing).

[am11]

This issue hit every workitem that didn't pass - despite failures.

I think it was both false-positive and false-negative: test passed, workitem failed and both test and workitem failed. The BA rule maybe a bit involved to distinguish test vs. workitem failure.