Send to Helix jobs failing because of AuthenticationException: RevocationStatusUnknown

[dkurepa]

Recently, there's been a spike of AuthenticationException: RevocationStatusUnknown exceptions our customers are seeing in their Helix jobs

We should investigate this issue.
We have seen something similar in the past: dotnet/arcade#8703

[dkurepa]

Looks like this is happening on the following images:

ImageName

ubuntu-22.04
macos-12
macos-11
windows-2019
build.ubuntu.2204.amd64
windows.vs2022.amd64
1es-ubuntu-2004
build.ubuntu.1804.amd64
build.ubuntu.2004.amd64
windows.vs2019.amd64
windows.vs2022preview.amd64

so basically all

[garath]

Assigning to FR.

[garath]

On its face this seems like a transient, server-side problem (not helix). Let's monitor for a day and see if it continues.

[garath]

The Timeline tables can have duplicate entries. This should be a more precise query:

Execute in [Web] [Desktop] [cluster('engsrvprod.kusto.windows.net').database('engineeringdata')]

TimelineIssues
| where Type == 'error' and Message has 'RevocationStatusUnknown'
| join kind=inner TimelineBuilds on BuildId
| where StartTime > ago(20d)
| summarize take_any(*) by BuildId, RecordId, TimelineId
| summarize count() by bin(StartTime, 1d)

StartTime	count_
2023-09-07T00:00:00Z	147
2023-09-06T00:00:00Z	107

[garath]

No occurrences since September 11. Whatever was causing this server-side appears to have been fixed.