XHarness message of order error leading to timeout

[jkoritzinsky]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=925619

Build leg reported

WasmTestOnChrome-MT-System.Runtime.CompilerServices.Unsafe.Tests.WorkItemExecution

Pull Request

dotnet/runtime#111716

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "fail: [out of order message from the driver]: Unable to receive message from renderer",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

XHarness receives this message out of order, gets disconnected, and then keeps trying to reconnect until the job times out.

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=925619
Error message validated: [fail: [out of order message from the driver]: Unable to receive message from renderer]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 1/22/2025 10:48:35 PM UTC

Report

Build	Definition	Test	Pull Request
986910	dotnet/runtime	WasmTestOnChrome-ST-System.Globalization.Calendars.Tests.WorkItemExecution	dotnet/runtime#113721
982178	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#99596
982571	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113512
982664	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113416
982912	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113602
982883	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113429
982873	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113413
982859	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113606
982756	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113313
982751	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113374
982683	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
982654	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113604
982633	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113602
982623	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113603
982606	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
982590	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113600
982505	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113598
982463	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113111
982400	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113592
982186	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
982175	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
982155	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113587
982048	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
982040	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113435
982035	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
982006	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#112937
981964	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113513
981925	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113550
981895	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113577
981824	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
981795	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
981746	dotnet/runtime	WasmTestOnChrome-ST-System.Reflection.Emit.Tests.WorkItemExecution	dotnet/runtime#113572
981699	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113374
981611	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#110818
981606	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113524
981566	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113374
981549	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
981535	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
981461	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#112937
980856	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113503
980944	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113550
981325	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113513
981208	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#112378
981182	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113374
981129	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113557
981043	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
981058	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113554
981017	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113512
981002	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113507
980991	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113513
980978	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution
980888	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113166
980843	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113453
980835	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#112604
979131	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113342
977542	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113342
977540	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113342
970330	dotnet/runtime	WasmTestOnChrome-ST-System.Net.Http.Functional.Tests.WorkItemExecution	dotnet/runtime#113146
966734	dotnet/runtime	WasmTestOnChrome-ST-Microsoft.Bcl.Numerics.Tests.WorkItemExecution	dotnet/runtime#110818
962654	dotnet/runtime	WasmTestOnChrome-ST-System.Runtime.Serialization.Xml.Tests.WorkItemExecution	dotnet/runtime#112457

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
1	54	60

[dougbu]

not sure whether is is pervasive / broad enough to be a dotnet/dnceng issue

separately, DNCEng no longer manages the dotnet/xharness repo. I think @ivanpovazan and others who've done recent work may be able to help you

[ivanpovazan]

@ilonatommy @akoeplinger have you encountered this before?

[ilonatommy]

Yes, we used to hit it on the runtime dotnet/runtime#103061 and it was fixed by increasing the timeout for running these tests.

[ivanpovazan]

Thanks, is there a ticket to increase the timeout again?

[ilonatommy]

No, we stopped hitting it after the fix got merged

[ilonatommy]

@maraf, do you know if the issue got some other way of fixing? I can see that the timeout increase is removed already

[maraf]

No idea. Maybe we did some detection of browser crash?