Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure:JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh #57462

Closed
VincentBu opened this issue Aug 16, 2021 · 16 comments
Closed

Test failure:JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh #57462

VincentBu opened this issue Aug 16, 2021 · 16 comments
Assignees
Labels
arch-arm64 arch-x64 arch-x86 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI GCStress os-linux Linux OS (any supported distro) os-windows
Milestone

Comments

@VincentBu
Copy link
Contributor

Run: runtime-coreclr gcstress0x3-gcstress0xc 20210815.1

Failed test:

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open
- JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open
- JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open
- Regressions/coreclr/GitHub_45929/test45929/test45929.sh

CoreCLR OSX arm64 Checked gcstress0x3 @ OSX.1100.ARM64.Open
- readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh

CoreCLR OSX arm64 Checked gcstress0x3 @ OSX.1100.ARM64.Open
- Regressions/coreclr/GitHub_45929/test45929/test45929.sh

CoreCLR windows x86 Checked gcstress0x3 @ Windows.10.Amd64.Open
- Regressions\\coreclr\\GitHub_45929\\test45929\\test45929.cmd

CoreCLR windows arm64 Checked gcstress0x3 @ Windows.10.Arm64v8.Open
- Regressions\\coreclr\\GitHub_45929\\test45929\\test45929.cmd

Error message:

cmdLine:/datadisks/disk1/work/AAAE0959/w/B0AA0987/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 8/15/2021 3:13:37 PM, end: 8/15/2021 4:13:37 PM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/AAAE0959/w/B0AA0987/uploads/Reports/JIT.HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/AAAE0959/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Avx2_ro.dll ''
Supported ISAs:
AES:       True
AVX:       True
AVX2:      True
AVXVNNI:   False
BMI1:      True
BMI2:      True
FMA:       True
LZCNT:     True
PCLMULQDQ: True
POPCNT:    True
SSE:       True
SSE2:      True
SSE3:      True
SSE4.1:    True
SSE4.2:    True
SSSE3:     True

Beginning test case Add.Byte at 8/15/2021 3:13:39 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/15/2021 3:13:47 PM
Beginning test case Add.Int16 at 8/15/2021 3:13:47 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/15/2021 3:13:52 PM
Beginning test case Add.Int32 at 8/15/2021 3:13:52 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/15/2021 3:1


Stack trace
   at JIT_HardwareIntrinsics._X86_Avx2_Avx2_ro_Avx2_ro_._X86_Avx2_Avx2_ro_Avx2_ro_sh()
@dotnet-issue-labeler dotnet-issue-labeler bot added area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI untriaged New issue has not been triaged by the area owner labels Aug 16, 2021
@ghost
Copy link

ghost commented Aug 16, 2021

Tagging subscribers to this area: @JulieLeeMSFT
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime-coreclr gcstress0x3-gcstress0xc 20210815.1

Failed test:

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open
- JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open
- JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open
- Regressions/coreclr/GitHub_45929/test45929/test45929.sh

CoreCLR OSX arm64 Checked gcstress0x3 @ OSX.1100.ARM64.Open
- readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh

CoreCLR OSX arm64 Checked gcstress0x3 @ OSX.1100.ARM64.Open
- Regressions/coreclr/GitHub_45929/test45929/test45929.sh

CoreCLR windows x86 Checked gcstress0x3 @ Windows.10.Amd64.Open
- Regressions\\coreclr\\GitHub_45929\\test45929\\test45929.cmd

CoreCLR windows arm64 Checked gcstress0x3 @ Windows.10.Arm64v8.Open
- Regressions\\coreclr\\GitHub_45929\\test45929\\test45929.cmd

Error message:

cmdLine:/datadisks/disk1/work/AAAE0959/w/B0AA0987/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 8/15/2021 3:13:37 PM, end: 8/15/2021 4:13:37 PM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/AAAE0959/w/B0AA0987/uploads/Reports/JIT.HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/AAAE0959/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Avx2_ro.dll ''
Supported ISAs:
AES:       True
AVX:       True
AVX2:      True
AVXVNNI:   False
BMI1:      True
BMI2:      True
FMA:       True
LZCNT:     True
PCLMULQDQ: True
POPCNT:    True
SSE:       True
SSE2:      True
SSE3:      True
SSE4.1:    True
SSE4.2:    True
SSSE3:     True

Beginning test case Add.Byte at 8/15/2021 3:13:39 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/15/2021 3:13:47 PM
Beginning test case Add.Int16 at 8/15/2021 3:13:47 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/15/2021 3:13:52 PM
Beginning test case Add.Int32 at 8/15/2021 3:13:52 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/15/2021 3:1


Stack trace
   at JIT_HardwareIntrinsics._X86_Avx2_Avx2_ro_Avx2_ro_._X86_Avx2_Avx2_ro_Avx2_ro_sh()
Author: VincentBu
Assignees: -
Labels:

arch-arm64, arch-x86, os-linux, os-windows, GCStress, arch-x64, area-CodeGen-coreclr, untriaged

Milestone: -

@JulieLeeMSFT JulieLeeMSFT added needs-further-triage Issue has been initially triaged, but needs deeper consideration or reconsideration and removed untriaged New issue has not been triaged by the area owner labels Aug 16, 2021
@JulieLeeMSFT JulieLeeMSFT added this to the 6.0.0 milestone Aug 16, 2021
@JulieLeeMSFT
Copy link
Member

CC @dotnet/jit-contrib

@echesakov echesakov assigned echesakov and unassigned jakobbotsch Aug 16, 2021
@echesakov
Copy link
Contributor

Most of the failures in the issue are due to timeouts - we've seen such in the past with the GCStress jobs.
However, I will re-run them locally to double check that they pass to be on a safe side.

The only "interesting" one here is Regressions\coreclr\GitHub_45929\test45929\test45929.cmd - it timed out on multiple platforms - Linux-x64, macOS-arm64, Windows-x86 and Windows-Arm64.

@echesakov
Copy link
Contributor

The Regressions\coreclr\GitHub_45929 test runs veeeery slowly under GCStress=3 on my Linux-x64 machine

BEGIN EXECUTION
/home/echesako/git/runtime/artifacts/tests/coreclr/Linux.x64.Checked/Tests/Core_Root/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false test45929.dll ''
The test started.
Progress:
8/16/2021 4:07:33 PM : 001.1%
8/16/2021 4:10:59 PM : 002.0%
8/16/2021 4:14:23 PM : 003.0%
8/16/2021 4:17:47 PM : 004.0%
8/16/2021 4:21:09 PM : 005.0%

and it's still in progress...

I don't know if it's expected - @janvorli can you please comment since you've added the test?

@echesakov
Copy link
Contributor

echesakov commented Aug 17, 2021

Regressions\coreclr\GitHub_45929 test took 6 hours on my machine to complete (successfully) - I am going to mark the test as GCIncompatible for now. This doesn't look at the JIT issue to me.

EDIT: Found related issue - #46803

@echesakov
Copy link
Contributor

I ran locally other tests in the issue that were failing with timeouts and don't see any issue there.

I suspect these could be transient failures (the Avx2_ro and Sse2_ro tests suites are huge and they can occasionally exceed the timeouts set on the jobs).

Moving the issue to 7.0 to keep an eye on the test for now.

@echesakov echesakov modified the milestones: 6.0.0, 7.0.0 Aug 17, 2021
@echesakov echesakov removed the needs-further-triage Issue has been initially triaged, but needs deeper consideration or reconsideration label Aug 17, 2021
@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr gcstress0x3-gcstress0xc 20210822.1

Failed test:

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open

- readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh
- JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh
- JIT/HardwareIntrinsics/X86/Sse41/Sse41_ro/Sse41_ro.sh
- JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh
- JIT/HardwareIntrinsics/X86/Avx/Avx_ro/Avx_ro.sh
- profiler/unittest/releaseondetach/releaseondetach.sh

Error message:

cmdLine:/datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 8/22/2021 2:59:48 PM, end: 8/22/2021 3:59:48 PM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/A53608FC/w/AD2B099C/uploads/Reports/readytorun.coreroot_determinism/coreroot_determinism/coreroot_determinism.output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A53608FC/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false coreroot_determinism.dll ''
================================== Compiling with seed 1 ==================================
Locating output folder /datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/seed1
Deleting 0 output folders
Successfully deleted 0 output folders in 130408 msecs
Using dotnet: /datadisks/disk1/work/A53608FC/p/corerun
1 / 1 (0%, 0 failed): launching: /datadisks/disk1/work/A53608FC/p/corerun /datadisks/disk1/work/A53608FC/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/seed1/CPAOT-ret.out/System.Private.CoreLib.dll.rsp
1 / 1 (100%, 0 failed): succeeded in 110803 msecs: corerun /datadisks/disk1/work/A53608FC/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/seed1/CPAOT-ret.out/System.Private.CoreLib.dll.rsp
================================== Compiling with seed 2 ==================================
Locating output folder /datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/seed2
Deleting 0 output folders
Successfully deleted 0 output folders in 16503 msecs
Using dotnet: /datadisks/disk1/work/A53608FC/p/corerun
1 / 1 (0%, 0 failed): launching: /datadisks/disk1/work/A53608FC/p/corerun /datadisks/disk1/work/A53608FC/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/seed2/CPAOT-ret.out/System.Private.CoreLib.dll.rsp

cmdLine:/datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 8/22/2021 2:59:48 PM, end: 8/22/2021 3:59:48 PM)
Test Harness Exitcode is : -100
To run the test:

set CORE_ROOT=/datadisks/disk1/work/A53608FC/p
/datadisks/disk1/work/A53608FC/w/AD2B099C/e/readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh
Expected: True
Actual:   False


Stack trace
   at readytorun_coreroot_determinism._coreroot_determinism_coreroot_determinism_._coreroot_determinism_coreroot_determinism_sh()

or

cmdLine:/datadisks/disk1/work/A53608FC/w/A4B9095C/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 8/22/2021 5:08:12 PM, end: 8/22/2021 6:08:12 PM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/A53608FC/w/A4B9095C/uploads/Reports/JIT.HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A53608FC/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Avx2_ro.dll ''
Supported ISAs:
AES:       True
AVX:       True
AVX2:      True
AVXVNNI:   False
BMI1:      True
BMI2:      True
FMA:       True
LZCNT:     True
PCLMULQDQ: True
POPCNT:    True
SSE:       True
SSE2:      True
SSE3:      True
SSE4.1:    True
SSE4.2:    True
SSSE3:     True

Beginning test case Add.Byte at 8/22/2021 5:08:15 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/22/2021 5:08:36 PM
Beginning test case Add.Int16 at 8/22/2021 5:08:36 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/22/2021 5:08:38 PM
Beginning test case Add.Int32 at 8/22/2021 5:08:38 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 8/22/2021 5:0


Stack trace
   at JIT_HardwareIntrinsics._X86_Avx2_Avx2_ro_Avx2_ro_._X86_Avx2_Avx2_ro_Avx2_ro_sh()

or

Unhandled exception. System.NullReferenceException: Object reference not set to an instance of an object.
Unhandled exception. System.Exception: Profilee returned exit code 134 instead of expected exit code 100.
at Profiler.Tests.ProfilerTestRunner.FailFastWithMessage(String error)
at Profiler.Tests.ProfilerTestRunner.Run(String profileePath, String testName, Guid profilerClsid, String profileeArguments, ProfileeOptions profileeOptions, Dictionary`2 envVars, String reverseServerName, Boolean loadAsNotification, Int32 notificationCopies)
at Profiler.Tests.ReleaseOnShutdown.Main(String[] args)
/datadisks/disk1/work/A53608FC/w/C17A0A18/e/profiler/unittest/releaseondetach/releaseondetach.sh: line 355:  6471 Aborted                 (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}"

Return code:      1
Raw output file:      /datadisks/disk1/work/A53608FC/w/C17A0A18/uploads/Reports/profiler.unittest/releaseondetach/releaseondetach.output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A53608FC/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false releaseondetach.dll ''
Profiler path: /datadisks/disk1/work/A53608FC/w/C17A0A18/e/profiler/unittest/releaseondetach/libProfiler.so
Attaching profiler /datadisks/disk1/work/A53608FC/w/C17A0A18/e/profiler/unittest/releaseondetach/libProfiler.so to self.
Profiler.dll!DllGetClassObject
Profiler.dll!Profiler::Initialize
Initialize for attach started
RequestProfilerDetach successful
Profiler detach succeeded
PROFILER TEST PASSES
Gathering state for process 6479 corerun
Crashing thread 0000195e signal 00000006
Writing minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.6479.dmp
Written 94662656 bytes (23111 pages) to core file
Dump successfully written

Test failed: Profilee returned exit code 134 instead of expected exit code 100.
Gathering state for process 6471 corerun
Crashing thread 00001947 signal 00000006
Writing minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.6471.dmp
Written 99426304 bytes (24274 pages) to core file
Dump successfully written
Expected: 100
Actual: 134
END EXECUTION - FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=/datadisks/disk1/work/A53608FC/p
/datadisks/disk1/work/A53608FC/w/C17A0A18/e/profiler/unittest/releaseondetach/releaseondetach.sh
Expected: True
Actual:   False


Stack trace
   at profiler_unittest._releaseondetach_releaseondetach_._releaseondetach_releaseondetach_sh()

@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr r2r 20210825.1

Failed test:

R2R windows arm Checked @ Windows.10.Arm64v8.Open

- Regressions\\coreclr\\GitHub_45929\\test45929\\test45929.cmd

Error message:

Could Not Find D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\IL-CG2\composite-r2r.dll
Could Not Find D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll.rsp

Assert failure(PID 13164 [0x0000336c], Thread: 5068 [0x13cc]): !CREATE_CHECK_STRING(!"Detected use of a corrupted OBJECTREF. Possible GC hole.")

<no module>! <no symbol> + 0x0 (0x00000000)
File: D:\workspace_work\1\s\src\coreclr\vm\object.cpp Line: 591
Image: D:\h\w\A63C08AF\p\corerun.exe

Return code:      1
Raw output file:      D:\h\w\A63C08AF\w\AEB709F0\uploads\Reports\Regressions.coreclr\GitHub_45929\test45929\test45929.output.txt
Raw output:
BEGIN EXECUTION
test45929.dll
1 file(s) copied.
Response file: D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll.rsp
D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\IL-CG2\test45929.dll
-o:D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll
--targetarch:arm
--verify-type-and-field-layout
-r:D:\h\w\A63C08AF\p\System..dll
-r:D:\h\w\A63C08AF\p\Microsoft..dll
-r:D:\h\w\A63C08AF\p\mscorlib.dll
-r:D:\h\w\A63C08AF\p\netstandard.dll
-O
" "dotnet" "D:\h\w\A63C08AF\p\crossgen2\crossgen2.dll" @"D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll.rsp"   -r:D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\IL-CG2*.dll"
Emitting R2R PE file: D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll
"D:\h\w\A63C08AF\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" test45929.dll
The test started.
Progress:
8/25/2021 11:30:44 PM : 000.0% : 173
8/25/2021 11:30:44 PM : 000.0% : 382
8/25/2021 11:30:44 PM : 000.0% : 390
8/25/2021 11:30:44 PM : 000.0% : 405
8/25/2021 11:30:44 PM : 000.0% : 432
8/25/2021 11:30:44 PM : 000.1% : 472
8/25/2021 11:30:44 PM : 000.1% : 535
8/25/2021 11:30:44 PM : 000.1% : 640
8/25/2021 11:30:45 PM : 000.2% : 869
8/25/2021 11:30:45 PM : 000.3% : 1053
8/25/2021 11:30:45 PM : 000.4% : 1372
8/25/2021 11:30:46 PM : 000.6% : 1816
Expected: 100
Actual: -1073740286
END EXECUTION - FAILED
FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=D:\h\w\A63C08AF\p
D:\h\w\A63C08AF\w\AEB709F0\e\Regressions\coreclr\GitHub_45929\test45929\test45929.cmd
Expected: True
Actual:   False


Stack trace
   at Regressions_coreclr._GitHub_45929_test45929_test45929_._GitHub_45929_test45929_test45929_cmd()

@janvorli
Copy link
Member

janvorli commented Sep 2, 2021

The Regressions\coreclr\GitHub_45929 test runs veeeery slowly under GCStress=3 on my Linux-x64 machine

Yes, it is expected due to the level of stress it does. It does a lot of exception dispatching using ExceptionDispatchInfo. 1 million times in parallel on each available processor. The purpose of this test is to stress the exception dispatching to verify that there is no race in generating watson buckets. Just the stressy nature of this test seems to uncover an unrelated rare GC issue that we are seeing here.

@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr gcstress0x3-gcstress0xc 20210905.1

Failed test:

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open

- JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh
- JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh
- JIT/HardwareIntrinsics/X86/Avx/Avx_ro/Avx_ro.sh

Error message:

cmdLine:/datadisks/disk1/work/AD2B094E/w/A929092C/e/JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 9/5/2021 5:21:08 PM, end: 9/5/2021 6:21:08 PM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/AD2B094E/w/A929092C/uploads/Reports/JIT.HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/AD2B094E/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Sse2_ro.dll ''
Supported ISAs:
AES:       True
AVX:       True
AVX2:      True
AVXVNNI:   False
BMI1:      True
BMI2:      True
FMA:       True
LZCNT:     True
PCLMULQDQ: True
POPCNT:    True
SSE:       True
SSE2:      True
SSE3:      True
SSE4.1:    True
SSE4.2:    True
SSSE3:     True

Beginning test case Add.Double at 9/5/2021 5:21:10 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 9/5/2021 5:21:21 PM
Beginning test case Add.Byte at 9/5/2021 5:21:21 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 9/5/2021 5:21:26 PM
Beginning test case Add.Int16 at 9/5/2021 5:21:26 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 9/5/2021 5:21:34 PM


Stack trace
   at JIT_HardwareIntrinsics._X86_Sse2_Sse2_ro_Sse2_ro_._X86_Sse2_Sse2_ro_Sse2_ro_sh()

@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr r2r-extra 20210912.1

Failed test:

R2R Linux x64 Checked gcstress0xf @ Ubuntu.1804.Amd64.Open

- JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh
- JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh

Error message:

rm: cannot remove 'IL-CG2/composite-r2r.dll': No such file or directory
/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh: line 253: -r:/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/*.dll: No such file or directory
rm: cannot remove '/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll.rsp': No such file or directory
rm: cannot remove '/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll.rsp': No such file or directory

cmdLine:/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 9/13/2021 7:39:24 AM, end: 9/13/2021 9:09:24 AM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/B0A5099E/w/B6400A06/uploads/Reports/JIT.HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/Avx2_ro.dll
Response file: /datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll.rsp
/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/Avx2_ro.dll
-o:/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll
-r:/datadisks/disk1/work/B0A5099E/p/System..dll
-r:/datadisks/disk1/work/B0A5099E/p/Microsoft..dll
-r:/datadisks/disk1/work/B0A5099E/p/mscorlib.dll
--verify-type-and-field-layout
--targetarch:x64
-O
Running CrossGen2:  dotnet /datadisks/disk1/work/B0A5099E/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll.rsp

Emitting R2R PE file: /datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll
/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/TestLibrary.dll
Response file: /datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll.rsp
/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/TestLibrary.dll
-o:/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll
-r:/datadisks/disk1/work/B0A5099E/p/System..dll
-r:/datadisks/disk1/work/B0A5099E/p/Microsoft..dll
-r:/datadisks/disk1/work/B0A5099E/p/mscorlib.dll
--verify-type-and-field-layout
--targetarch:x64
-O
Running CrossGen2:  dotnet /datadisks/disk1/work/B0A5099E/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll.rsp

Emitting R2R PE file: /datadisks/disk1/work/B0A5099E/w/B6400A06/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll
in ReleaseLock
/datadisks/disk1/work/B0A5099E/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Avx2_ro.dll ''
Supported ISAs:
AES:       True
AVX:       True
AVX2:      True
AVXVNNI:   False
BMI1:      True
BMI2:      True
FMA:       True
LZCNT:     True
PCLMULQDQ: True
POPCNT:    True
SSE:       True
SSE2:      True
SSE3:      True
SSE4.1:    True
SSE4.2:    True
SSSE3:     True

Beginning test case Add.Byte at 9/13/2021 7:39:32 AM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_Lo


Stack trace
   at JIT_HardwareIntrinsics._X86_Avx2_Avx2_ro_Avx2_ro_._X86_Avx2_Avx2_ro_Avx2_ro_sh()

@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr r2r 20210920.1

Faile test:

R2R windows arm Checked no_tiered_compilation @ Windows.10.Arm64v8.Open

- Regressions\\coreclr\\GitHub_45929\\test45929\\test45929.cmd

Error message:

Could Not Find D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\IL-CG2\composite-r2r.dll
Could Not Find D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll.rsp

Assert failure(PID 432 [0x000001b0], Thread: 2448 [0x0990]): !CREATE_CHECK_STRING(!"Detected use of a corrupted OBJECTREF. Possible GC hole.")

<no module>! <no symbol> + 0x0 (0x00000000)
File: D:\workspace_work\1\s\src\coreclr\vm\object.cpp Line: 591
Image: D:\h\w\B9A509D4\p\corerun.exe

Return code:      1
Raw output file:      D:\h\w\B9A509D4\w\A5D40916\uploads\Reports\Regressions.coreclr\GitHub_45929\test45929\test45929.output.txt
Raw output:
BEGIN EXECUTION
test45929.dll
1 file(s) copied.
Response file: D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll.rsp
D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\IL-CG2\test45929.dll
-o:D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll
--targetarch:arm
--verify-type-and-field-layout
-r:D:\h\w\B9A509D4\p\System..dll
-r:D:\h\w\B9A509D4\p\Microsoft..dll
-r:D:\h\w\B9A509D4\p\mscorlib.dll
-r:D:\h\w\B9A509D4\p\netstandard.dll
-O
" "dotnet" "D:\h\w\B9A509D4\p\crossgen2\crossgen2.dll" @"D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll.rsp"   -r:D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\IL-CG2*.dll"
Emitting R2R PE file: D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\test45929.dll
"D:\h\w\B9A509D4\p\corerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false"  test45929.dll
The test started.
Progress:
9/21/2021 12:28:27 AM : 000.0% : 257
9/21/2021 12:28:28 AM : 000.0% : 578
9/21/2021 12:28:28 AM : 000.0% : 603
9/21/2021 12:28:28 AM : 000.0% : 638
9/21/2021 12:28:28 AM : 000.0% : 682
9/21/2021 12:28:28 AM : 000.1% : 732
9/21/2021 12:28:28 AM : 000.1% : 822
9/21/2021 12:28:28 AM : 000.1% : 933
9/21/2021 12:28:29 AM : 000.2% : 1120
9/21/2021 12:28:29 AM : 000.3% : 1426
9/21/2021 12:28:29 AM : 000.4% : 1865
9/21/2021 12:28:30 AM : 000.6% : 2428
9/21/2021 12:28:31 AM : 000.9% : 3368
9/21/2021 12:28:31 AM : 001.0% : 3798
9/21/2021 12:28:35 AM : 002.0% : 7326
9/21/2021 12:28:38 AM : 003.0% : 10741
9/21/2021 12:28:41 AM : 004.0% : 13897
9/21/2021 12:28:44 AM : 005.0% : 16969
Expected: 100
Actual: -1073740286
END EXECUTION - FAILED
FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=D:\h\w\B9A509D4\p
D:\h\w\B9A509D4\w\A5D40916\e\Regressions\coreclr\GitHub_45929\test45929\test45929.cmd
Expected: True
Actual:   False


Stack trace
   at Regressions_coreclr._GitHub_45929_test45929_test45929_._GitHub_45929_test45929_test45929_cmd()

@BruceForstall
Copy link
Member

Unfortunately, it looks like this issue now contains a mix of failures, both Avx2 & friends, mostly (exclusively?) timeouts, and Test45929 on Windows/arm32 with a real-looking GC hole assert (note: we don't formally support Windows/arm32 anymore).

@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr gcstress0x3-gcstress0xc 20210925.1

Failed test:

CoreCLR Linux x64 Checked gcstress0x3 @ Ubuntu.1804.Amd64.Open

- JIT/HardwareIntrinsics/X86/Avx/Avx_ro/Avx_ro.sh
- JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh

Error message:

cmdLine:/datadisks/disk1/work/A6160947/w/B81009B2/e/JIT/HardwareIntrinsics/X86/Avx/Avx_ro/Avx_ro.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 9/25/2021 3:55:22 PM, end: 9/25/2021 4:55:22 PM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/A6160947/w/B81009B2/uploads/Reports/JIT.HardwareIntrinsics/X86/Avx/Avx_ro/Avx_ro.output.txt
Raw output:
BEGIN EXECUTION
/datadisks/disk1/work/A6160947/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Avx_ro.dll ''
Supported ISAs:
AES:       True
AVX:       True
AVX2:      True
AVXVNNI:   False
BMI1:      True
BMI2:      True
FMA:       True
LZCNT:     True
PCLMULQDQ: True
POPCNT:    True
SSE:       True
SSE2:      True
SSE3:      True
SSE4.1:    True
SSE4.2:    True
SSSE3:     True

Beginning test case Add.Double at 9/25/2021 3:55:24 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 9/25/2021 3:55:34 PM
Beginning test case Add.Single at 9/25/2021 3:55:34 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 9/25/2021 3:55:37 PM
Beginning test case AddSubtract.Double at 9/25/2021 3:55:37 PM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario_LoadAligned
Beginning scenario: RunClassLclFldScenario
Beginning scenario: RunClassLclFldScenario_Load
Beginning scenario: RunClassFldScenario
Beginning scenario: RunClassFldScenario_Load
Beginning scenario: RunStructLclFldScenario
Beginning scenario: RunStructLclFldScenario_Load
Beginning scenario: RunStructFldScenario
Beginning scenario: RunStructFldScenario_Load

Ending test case at 9/25/202


Stack trace
   at JIT_HardwareIntrinsics._X86_Avx_Avx_ro_Avx_ro_._X86_Avx_Avx_ro_Avx_ro_sh()

@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr r2r-extra 20211010.1

Failed test:

R2R Linux x64 Checked gcstress0xf @ Ubuntu.1804.Amd64.Open

- JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh
- JIT/HardwareIntrinsics/X86/Sse2/Sse2_ro/Sse2_ro.sh

One of error message:

rm: cannot remove 'IL-CG2/composite-r2r.dll': No such file or directory
/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh: line 253: -r:/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/*.dll: No such file or directory
rm: cannot remove '/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll.rsp': No such file or directory
rm: cannot remove '/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll.rsp': No such file or directory

cmdLine:/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.sh Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 10/11/2021 4:32:58 AM, end: 10/11/2021 6:02:58 AM)

Return code:      -100
Raw output file:      /datadisks/disk1/work/9CC208EB/w/A21108DE/uploads/Reports/JIT.HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/Avx2_ro.dll
Response file: /datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll.rsp
/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/Avx2_ro.dll
-o:/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll
-r:/datadisks/disk1/work/9CC208EB/p/System..dll
-r:/datadisks/disk1/work/9CC208EB/p/Microsoft..dll
-r:/datadisks/disk1/work/9CC208EB/p/mscorlib.dll
--verify-type-and-field-layout
--targetarch:x64
-O
Running CrossGen2:  dotnet /datadisks/disk1/work/9CC208EB/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll.rsp

Emitting R2R PE file: /datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/Avx2_ro.dll
/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/TestLibrary.dll
Response file: /datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll.rsp
/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/IL-CG2/TestLibrary.dll
-o:/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll
-r:/datadisks/disk1/work/9CC208EB/p/System..dll
-r:/datadisks/disk1/work/9CC208EB/p/Microsoft..dll
-r:/datadisks/disk1/work/9CC208EB/p/mscorlib.dll
--verify-type-and-field-layout
--targetarch:x64
-O
Running CrossGen2:  dotnet /datadisks/disk1/work/9CC208EB/p/crossgen2/crossgen2.dll @/datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll.rsp

Emitting R2R PE file: /datadisks/disk1/work/9CC208EB/w/A21108DE/e/JIT/HardwareIntrinsics/X86/Avx2/Avx2_ro/TestLibrary.dll
in ReleaseLock
/datadisks/disk1/work/9CC208EB/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Avx2_ro.dll ''
Supported ISAs:
AES:       True
AVX:       True
AVX2:      True
AVXVNNI:   False
BMI1:      True
BMI2:      True
FMA:       True
LZCNT:     True
PCLMULQDQ: True
POPCNT:    True
SSE:       True
SSE2:      True
SSE3:      True
SSE4.1:    True
SSE4.2:    True
SSSE3:     True

Beginning test case Add.Byte at 10/11/2021 4:33:06 AM
Random seed: 20010415; set environment variable CORECLR_SEED to this value to repro

Beginning scenario: RunBasicScenario_UnsafeRead
Beginning scenario: RunBasicScenario_Load
Beginning scenario: RunBasicScenario_LoadAligned
Beginning scenario: RunReflectionScenario_UnsafeRead
Beginning scenario: RunReflectionScenario_Load
Beginning scenario: RunReflectionScenario_LoadAligned
Beginning scenario: RunClsVarScenario
Beginning scenario: RunClsVarScenario_Load
Beginning scenario: RunLclVarScenario_UnsafeRead
Beginning scenario: RunLclVarScenario_Load
Beginning scenario: RunLclVarScenario


Stack trace
   at JIT_HardwareIntrinsics._X86_Avx2_Avx2_ro_Avx2_ro_._X86_Avx2_Avx2_ro_Avx2_ro_sh()

@echesakov
Copy link
Contributor

Duplicate of #60154

@echesakov echesakov marked this as a duplicate of #60154 Oct 14, 2021
@ghost ghost locked as resolved and limited conversation to collaborators Nov 13, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
arch-arm64 arch-x64 arch-x86 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI GCStress os-linux Linux OS (any supported distro) os-windows
Projects
None yet
Development

No branches or pull requests

6 participants