JIT fullpgo_random_edge crash running System.Text.RegularExpressions.Tests

[markples]

runtime-coreclr libraries-pgo
Libraries Test Run checked coreclr Linux arm Release

I've only seen this once. The test usually fails with #75827.

https://dev.azure.com/dnceng-public/public/_build/results?buildId=52661&view=results
https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-75140-merge-3b4146f8acaa431cb3/System.Text.RegularExpressions.Tests/1/console.be74b291.log?helixlogtype=result

+ printenv
+ grep COMPlus
COMPlus_JitRandomlyCollect64BitCounts=1
COMPlus_ReadyToRun=0
COMPlus_TC_QuickJitForLoops=1
COMPlus_TieredCompilation=1
COMPlus_JitRandomEdgeCounts=1
COMPlus_DbgMiniDumpName=/home/helixbot/dotnetbuild/dumps/coredump.%d.dmp
COMPlus_TieredPGO=1
COMPlus_DbgEnableMiniDump=1
...
  Starting:    System.Text.RegularExpressions.Tests (parallel test collections = on, max threads = 4)
[createdump] Gathering state for process 61 dotnet
[createdump] Crashing thread 000000b2 signal 0000000b
[createdump] Gathering state for process 61 dotnet
[createdump] Crashing thread 000000b9 signal 0000000b
[createdump] Target process is alive
[createdump] Problem suspending threads: ptrace(ATTACH, 61) FAILED Operation not permitted (1)
[createdump] Failure took 1ms
[createdump] Writing minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.61.dmp
[createdump] Written 1648136192 bytes (402377 pages) to core file
[createdump] Target process is alive
[createdump] waitpid() returned successfully (wstatus 0000ff00)
[createdump] Dump successfully written in 452382ms
/root/helix/work/workitem/e
./RunTests.sh: line 168:    61 Segmentation fault      (core dumped) "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Text.RegularExpressions.Tests.runtimeconfig.json --depsfile System.Text.RegularExpressions.Tests.deps.json xunit.console.dll System.Text.RegularExpressions.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE
----- end Fri Oct 14 15:43:07 UTC 2022 ----- exit code 139 ----------------------------------------------------------
exit code 139 means SIGSEGV Illegal memory access. Deref invalid pointer, overrunning buffer, stack overflow etc. Core dumped.
ulimit -c value: unlimited

cc @dotnet/jit-contrib

[ghost]

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

---

runtime-coreclr libraries-pgo
Libraries Test Run checked coreclr Linux arm Release

I've only seen this once. The test usually fails with #75827.

https://dev.azure.com/dnceng-public/public/_build/results?buildId=52661&view=results
https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-75140-merge-3b4146f8acaa431cb3/System.Text.RegularExpressions.Tests/1/console.be74b291.log?helixlogtype=result

+ printenv
+ grep COMPlus
COMPlus_JitRandomlyCollect64BitCounts=1
COMPlus_ReadyToRun=0
COMPlus_TC_QuickJitForLoops=1
COMPlus_TieredCompilation=1
COMPlus_JitRandomEdgeCounts=1
COMPlus_DbgMiniDumpName=/home/helixbot/dotnetbuild/dumps/coredump.%d.dmp
COMPlus_TieredPGO=1
COMPlus_DbgEnableMiniDump=1
...
  Starting:    System.Text.RegularExpressions.Tests (parallel test collections = on, max threads = 4)
[createdump] Gathering state for process 61 dotnet
[createdump] Crashing thread 000000b2 signal 0000000b
[createdump] Gathering state for process 61 dotnet
[createdump] Crashing thread 000000b9 signal 0000000b
[createdump] Target process is alive
[createdump] Problem suspending threads: ptrace(ATTACH, 61) FAILED Operation not permitted (1)
[createdump] Failure took 1ms
[createdump] Writing minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.61.dmp
[createdump] Written 1648136192 bytes (402377 pages) to core file
[createdump] Target process is alive
[createdump] waitpid() returned successfully (wstatus 0000ff00)
[createdump] Dump successfully written in 452382ms
/root/helix/work/workitem/e
./RunTests.sh: line 168:    61 Segmentation fault      (core dumped) "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Text.RegularExpressions.Tests.runtimeconfig.json --depsfile System.Text.RegularExpressions.Tests.deps.json xunit.console.dll System.Text.RegularExpressions.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE
----- end Fri Oct 14 15:43:07 UTC 2022 ----- exit code 139 ----------------------------------------------------------
exit code 139 means SIGSEGV Illegal memory access. Deref invalid pointer, overrunning buffer, stack overflow etc. Core dumped.
ulimit -c value: unlimited

cc @dotnet/jit-contrib

Author:	markples
Assignees:	-
Labels:	area-CodeGen-coreclr, blocking-clean-ci-optional
Milestone:	8.0.0

[jakobbotsch]

We haven't seen this for a while. Will close it and we can reopen it if we see it again.