CI failure: Internal CLR error. (0x80131506) at System.SZArrayHelper.GetEnumerator

[carlossanlop]

Seen in this RC1 PR: #74045

Leg: Installer Build and Test coreclr windows_x86 Release
Log: https://dev.azure.com/dnceng/public/_build/results?buildId=1951970&view=logs&j=fcaa063f-6419-5e58-b2af-9d549ec8d7bb&t=83613dd5-c469-5fc6-b3ef-ae348715a225&l=611

D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error : Fatal error. Internal CLR error. (0x80131506) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at System.SZArrayHelper.GetEnumerator[[Internal.JitInterface.CorJitFlag, ILCompiler.ReadyToRun, Version=7.0.0.0, Culture=neutral, PublicKeyToken=null]]() [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at Internal.JitInterface.CorInfoImpl.getJitFlags(Internal.JitInterface.CORJIT_FLAGS ByRef, UInt32) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at Internal.JitInterface.CorInfoImpl._getJitFlags(IntPtr, IntPtr*, Internal.JitInterface.CORJIT_FLAGS*, UInt32) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at Internal.JitInterface.CorInfoImpl.JitCompileMethod(IntPtr ByRef, IntPtr, IntPtr, IntPtr, Internal.JitInterface.CORINFO_METHOD_INFO ByRef, UInt32, IntPtr ByRef, UInt32 ByRef) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at Internal.JitInterface.CorInfoImpl.JitCompileMethod(IntPtr ByRef, IntPtr, IntPtr, IntPtr, Internal.JitInterface.CORINFO_METHOD_INFO ByRef, UInt32, IntPtr ByRef, UInt32 ByRef) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at Internal.JitInterface.CorInfoImpl.CompileMethodInternal(ILCompiler.DependencyAnalysis.IMethodNode, Internal.IL.MethodIL) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at Internal.JitInterface.CorInfoImpl.CompileMethod(ILCompiler.DependencyAnalysis.ReadyToRun.MethodWithGCInfo, ILCompiler.Logger) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at ILCompiler.ReadyToRunCodegenCompilation.<ComputeDependencyNodeDependencies>g__CompileOneMethod|38_3(ILCompiler.DependencyAnalysisFramework.DependencyNodeCore`1<ILCompiler.DependencyAnalysis.NodeFactory>) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at System.Threading.Tasks.Parallel+<>c__DisplayClass19_0`1[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].<ForWorker>b__1(System.Threading.Tasks.RangeWorker ByRef, Int32, Boolean ByRef) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at System.Threading.Tasks.TaskReplicator+Replica.Execute() [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at System.Threading.ExecutionContext.RunFromThreadPoolDispatchLoop(System.Threading.Thread, System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef, System.Threading.Thread) [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at System.Threading.ThreadPoolWorkQueue.Dispatch() [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(463,5): error :    at System.Threading.PortableThreadPool+WorkerThread.WorkerThreadStart() [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
D:\a\_work\1\s\artifacts\bin\Crossgen2Tasks\Debug\net7.0\Microsoft.NET.CrossGen.targets(351,5): error NETSDK1096: Optimizing assemblies for performance failed. You can either exclude the failing assemblies from being optimized, or set the PublishReadyToRun property to false. [D:\a\_work\1\s\src\installer\pkg\sfx\Microsoft.NETCore.App\Microsoft.NETCore.App.Runtime.sfxproj]
    0 Warning(s)
    16 Error(s)

[mangod9]

believe this is similar to things like #69454, where NativeAOT compiled crossgen2 AVs randomly. We are trying to isolate the issue. fyi @AaronRobinsonMSFT who was trying to find a repro on windows.

[mangod9]

if this proves to be difficult to diagnose, perhaps we will have to fallback to non-native crossgen2.

[MichalStrehovsky]

believe this is similar to things like #69454, where NativeAOT compiled crossgen2

The issue starts with "Note: this is the crossgen that is not NativeAOT'd.".

if this proves to be difficult to diagnose, perhaps we will have to fallback to non-native crossgen2.

This is not NativeAOT crossgen either. The SzArrayHelper class on the stack does not exist in NativeAOT CoreLib, it's part of CoreCLR's CoreLib. We also don't build NativeAOT on x86 Windows so this is the shipping configuration of crossgen2 (we don't NativeAOT compile x86 because NativeAOT doesn't support x86).

We have multiple crossgen2 stress bugs. So far only #72645 has been with NativeAOT. The NativeAOT one crashes more often. Hard to say if these are all the same bugs.

[mangod9]

Ah I was under the impression that NativeAOT is not enabled only on MacOS.

[mangod9]

Not actionable at the moment. Local repro attempts have been unsuccessful. We could reopen if we rehit with RC1 sdk.