jtreg java/lang/String/Exceptions.java crash Compiled_method=java/lang/String.split #13367

pshipton · 2021-08-24T11:32:32Z

Blocking promotion of jdk17

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_OpenJDK17/9
jdk_lang_0
JVM_OPTIONS: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage -XX:+UseCompressedOops
java/lang/String/Exceptions.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_OpenJDK17/9/openjdk_test_output.tar.gz

15:23:53  stderr:
15:23:53  Unhandled exception
15:23:53  Type=Segmentation error vmState=0x00000000
15:23:53  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
15:23:53  Handler1=00003FFFA14F4910 Handler2=00003FFFA142C300
15:23:53  R0=00003FFFA0D82490 R1=00003FFF780DAC00 R2=00003FFFA16F6E00 R3=0000000000000000
15:23:53  R4=0000000000000000 R5=0000000000000000 R6=000000000000000E R7=00003FFF780DAD20
15:23:53  R8=000000000042A940 R9=000000000000000E R10=00003FFFA1098F20 R11=00000000004264E8
15:23:53  R12=0000000028004442 R13=00003FFF780E6900 R14=000000000042A820 R15=00000000003F5B00
15:23:53  R16=00003FFF79640038 R17=FFFFFFFFFFFFFFFF R18=0005CA3EE8AC14DB R19=00003FFFA0346560
15:23:53  R20=0000000000000001 R21=0000000000000001 R22=0000000000000001 R23=0000000000000002
15:23:53  R24=0000000000000000 R25=00000000FFE636D0 R26=00000000FFE63720 R27=00000000E0328930
15:23:53  R28=0000000000000000 R29=0000000000146400 R30=00000000FFF50D18 R31=000000000000001F
15:23:53  NIP=00003FFF7BF3F54C MSR=800000010280F033 ORIG_GPR3=00000000000081C8 CTR=00003FFF7BF3F4CC
15:23:53  LINK=00003FFFA0D82490 XER=0000000020000000 CCR=0000000028004222 SOFTE=0000000000000001
15:23:53  TRAP=0000000000000300 DAR=0000000000000004 dsisr=0000000040000000 RESULT=0000000000000000
15:23:53  FPR0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR1 40543e7f00000000 (f: 0.000000, d: 8.097650e+01)
15:23:53  FPR2 3fabf62960000000 (f: 1610612736.000000, d: 5.461244e-02)
15:23:53  FPR3 3fee666660000000 (f: 1610612736.000000, d: 9.500000e-01)
15:23:53  FPR4 4012d097e0000000 (f: 3758096384.000000, d: 4.703704e+00)
15:23:53  FPR5 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR6 3fe5555560000000 (f: 1610612736.000000, d: 6.666667e-01)
15:23:53  FPR7 3f28eea840000000 (f: 1073741824.000000, d: 1.902180e-04)
15:23:53  FPR8 006100760061006a (f: 6357098.000000, d: 7.566052e-307)
15:23:53  FPR9 006e0061006c002e (f: 7077934.000000, d: 1.335110e-306)
15:23:53  FPR10 3f977f98e0000000 (f: 3758096384.000000, d: 2.294768e-02)
15:23:53  FPR11 41cdcd6500000000 (f: 0.000000, d: 1.000000e+09)
15:23:53  FPR12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR13 4020800000000000 (f: 0.000000, d: 8.250000e+00)
15:23:53  FPR14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR17 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR18 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR19 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR20 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR21 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR22 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR23 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
15:23:53  
15:23:53  Compiled_method=java/lang/String.split(Ljava/lang/String;)[Ljava/lang/String;
15:23:53  Target=2_90_20210823_14 (Linux 3.10.0-1160.25.1.el7.ppc64le)
15:23:53  CPU=ppc64le (8 logical CPUs) (0x1de290000 RAM)
15:23:53  ----------- Stack Backtrace -----------
15:23:53  (0x00003FFFA14269E4 [libj9prt29.so+0x369e4])
15:23:53  (0x00003FFFA142D708 [libj9prt29.so+0x3d708])
15:23:53  (0x00003FFFA1426AA8 [libj9prt29.so+0x36aa8])
15:23:53  (0x00003FFFA1426C10 [libj9prt29.so+0x36c10])
15:23:53  (0x00003FFFA14266E4 [libj9prt29.so+0x366e4])
15:23:53  (0x00003FFFA142D708 [libj9prt29.so+0x3d708])
15:23:53  (0x00003FFFA14267D8 [libj9prt29.so+0x367d8])
15:23:53  (0x00003FFFA14F4790 [libj9vm29.so+0x44790])
15:23:53  (0x00003FFFA142D708 [libj9prt29.so+0x3d708])
15:23:53  (0x00003FFFA14F4AC4 [libj9vm29.so+0x44ac4])
15:23:53  (0x00003FFFA142C560 [libj9prt29.so+0x3c560])
15:23:53  __kernel_sigtramp_rt64+0x0 (0x00003FFFA25A0478)
15:23:53  (0x00003FFFA1619568 [libj9vm29.so+0x169568])
15:23:53  (0x00003FFFA14CECD0 [libj9vm29.so+0x1ecd0])
15:23:53  (0x00003FFFA14D0168 [libj9vm29.so+0x20168])
15:23:53  (0x00003FFF95307CE4 [libjclse29.so+0x87ce4])
15:23:53  JVM_InvokeMethod+0x40 (0x00003FFFA1A176E0 [libjvm.so+0x276e0])
15:23:53  JVM_InvokeMethod+0x34 (0x00003FFFA2276814 [libjvm.so+0x6814])
15:23:53  Java_jdk_internal_reflect_NativeMethodAccessorImpl_invoke0+0x24 (0x00003FFF7926C5B4 [libjava.so+0xc5b4])
15:23:53  (0x00003FFF7BC28CA4 [<unknown>+0x0])
15:23:53  (0x00003FFFA14C9450 [libj9vm29.so+0x19450])
15:23:53  (0x00003FFFA1564430 [libj9vm29.so+0xb4430])
15:23:53  (0x00003FFFA142D708 [libj9prt29.so+0x3d708])
15:23:53  (0x00003FFFA155F5E4 [libj9vm29.so+0xaf5e4])
15:23:53  (0x00003FFFA13C13E8 [libj9thr29.so+0x113e8])
15:23:53  (0x00003FFFA24D8CD4 [libpthread.so.0+0x8cd4])
15:23:53  clone+0xe4 (0x00003FFFA23D7F14 [libc.so.6+0x127f14])

The text was updated successfully, but these errors were encountered:

pshipton · 2021-08-24T12:43:25Z

Intermittent problem, as it didn't occur in https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_Nightly/2

pshipton · 2021-08-24T16:11:41Z

We've promoted the jdk17 content regardless of the failures, so this isn't blocking anything any more, except for the tests being green.

pshipton · 2021-08-24T16:13:47Z

and any future jdk17 acceptance build but we may already have the final level considering it's after the OpenJDK Final Release Candidate date.

pshipton · 2021-08-25T11:35:57Z

Not sure how intermittent this problem is, there have been a couple of builds where it didn't occur. Removing the blocker label.

JasonFengJ9 · 2021-08-25T11:44:13Z

It is observed in newly enabled JDK17 internal nightly build w/ promoted openj9 branch at Test_openjdk17_j9_sanity.openjdk_ppc64le_linux/44/consoleFull

01:55:34  ===============================================
01:55:34  Running test jdk_lang_1 ...
01:55:34  ===============================================
01:55:34  jdk_lang_1 Start Time: Wed Aug 25 01:55:32 2021 Epoch Time (ms): 1629870932062
01:55:34  "/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
01:55:34  JVMSHRC005I No shared class caches available
01:55:34  JVMSHRC005I No shared class caches available
01:55:34  cache cleanup done
01:55:34  variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage Mode650
01:55:34  JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage -XX:-UseCompressedOops 

02:04:31  --------------------------------------------------
02:04:31  TEST: java/lang/String/Exceptions.java

02:04:31  stderr:
02:04:31  Unhandled exception
02:04:31  Type=Segmentation error vmState=0x00000000
02:04:31  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
02:04:31  Handler1=00007300E7CB4910 Handler2=00007300E7BEC300
02:04:31  R0=0000000000000000 R1=00007300941AABC0 R2=00007300E7EB6E00 R3=00000000E02F6800
02:04:31  R4=0000000000000000 R5=0000000000000001 R6=000000000000000E R7=00007300941AACE0
02:04:31  R8=00000000007F8C50 R9=000000000000000E R10=00007300E7538F20 R11=00000000007F47C8
02:04:31  R12=0000000028004422 R13=00007300941B68F0 R14=00000000007F8930 R15=00000000007F0700
02:04:31  R16=00007300C62F0038 R17=FFFFFFFFFFFFFFFF R18=00000000E02F6800 R19=00007300E67E6580
02:04:31  R20=0000000000000001 R21=0000000000000001 R22=0000000000000001 R23=0000000000000000
02:04:31  R24=00000000E02F6800 R25=00000000E02F6818 R26=00000000003E5100 R27=0000000000000002
02:04:31  R28=00000000E02F6800 R29=0000000000179700 R30=00000000FFE6FD50 R31=00000000FFE6FD68
02:04:31  NIP=00007300CCCAC684 MSR=800000000280F033 ORIG_GPR3=00007300E7DD95C4 CTR=00007300CCCAC5F4
02:04:31  LINK=00007300E72225D0 XER=0000000000000000 CCR=0000000044004422 SOFTE=0000000000000001
02:04:31  TRAP=0000000000000300 DAR=0000000000000004 dsisr=0000000040000000 RESULT=0000000000000000
02:04:31  FPR0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR1 4049c40bc0000000 (f: 3221225472.000000, d: 5.153161e+01)
02:04:31  FPR2 41e0000000000000 (f: 0.000000, d: 2.147484e+09)
02:04:31  FPR3 3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
02:04:31  FPR4 4026000000000000 (f: 0.000000, d: 1.100000e+01)
02:04:31  FPR5 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR6 3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
02:04:31  FPR7 bfd2bef0a7c06ddb (f: 2814406144.000000, d: -2.929041e-01)
02:04:31  FPR8 006100760061006a (f: 6357098.000000, d: 7.566052e-307)
02:04:31  FPR9 006e0061006c002e (f: 7077934.000000, d: 1.335110e-306)
02:04:31  FPR10 bfe02ae75d4cbc62 (f: 1565310080.000000, d: -5.052373e-01)
02:04:31  FPR11 41cdcd6500000000 (f: 0.000000, d: 1.000000e+09)
02:04:31  FPR12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR13 4020800000000000 (f: 0.000000, d: 8.250000e+00)
02:04:31  FPR14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR17 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR18 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR19 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR20 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR21 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR22 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR23 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:04:31  
02:04:31  Compiled_method=java/lang/String.split(Ljava/lang/String;I)[Ljava/lang/String;
02:04:31  Target=2_90_20210825_16 (Linux 5.4.0-74-generic)
02:04:31  CPU=ppc64le (64 logical CPUs) (0xff01e0000 RAM)
02:04:31  ----------- Stack Backtrace -----------
02:04:31  (0x00007300CCCAC684 [<unknown>+0x0])
02:04:31  (0x00007300E7C8ECD0 [libj9vm29.so+0x1ecd0])
02:04:31  (0x00007300E7C90168 [libj9vm29.so+0x20168])
02:04:31  (0x00007300E6097CE4 [libjclse29.so+0x87ce4])
02:04:31  JVM_InvokeMethod+0x40 (0x00007300EC3976E0 [libjvm.so+0x276e0])
02:04:31  JVM_InvokeMethod+0x34 (0x00007300ECBE6814 [libjvm.so+0x6814])
02:04:31  Java_jdk_internal_reflect_NativeMethodAccessorImpl_invoke0+0x24 (0x00007300C5F5C5B4 [libjava.so+0xc5b4])
02:04:31  (0x00007300CC8940A4 [<unknown>+0x0])
02:04:31  (0x00007300E7C89450 [libj9vm29.so+0x19450])
02:04:31  (0x00007300E7D24430 [libj9vm29.so+0xb4430])
02:04:31  (0x00007300E7BED708 [libj9prt29.so+0x3d708])
02:04:31  (0x00007300E7D1F5E4 [libj9vm29.so+0xaf5e4])
02:04:31  (0x00007300EC0413E8 [libj9thr29.so+0x113e8])
02:04:31  (0x00007300ECE99818 [libpthread.so.0+0x9818])
02:04:31  clone+0x74 (0x00007300ECD6EB24 [libc.so.6+0x14eb24])
02:04:31  ---------------------------------------
02:04:31  JVMDUMP039I Processing dump event "gpf", detail "" at 2021/08/25 02:04:02 - please wait.

02:04:31  TEST RESULT: Error. Agent communication error: java.io.EOFException; check console log for any additional details
02:04:31  --------------------------------------------------
02:26:06  Test results: passed: 768; error: 1
02:26:06  Report written to /home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux/jvmtest/openjdk/report/html/report.html
02:26:06  Results written to /home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux/aqa-tests/TKG/output_16298690796821/jdk_lang_1/work
02:26:06  Error: Some tests failed or other problems occurred.
02:26:06  
02:26:06  jdk_lang_1_FAILED

Re-run the Grinder

pshipton · 2021-08-25T11:54:59Z

Ok, perhaps this should remain a blocker. I'm adding back the label so it gets some attention.

rmnattas · 2021-08-25T14:45:12Z

The test fails on jdk17 across platforms (ppcle64 and x86) but passes in jdk11.

The test never passes in jdk17 but running an overnight grinder, half of the runs end with the segmentation fault crash. I'm trying to look if the crash caused by the test being defective in jdk17. Also, all crashes are occupied with Error. Agent communication error: java.io.EOFException;, I'm trying to figure out if that's the cause or the effect of the crash.

rmnattas · 2021-08-25T18:50:39Z

The grinders seem to fail as the latest nightly jdk17 build it pulls is an old (May) build, running a newer build locally passes. Will run again in jenkins with a newer build and continue investigating the issue.

rmnattas · 2021-08-27T15:11:02Z

The crash is not related to the test, and the test passes when running a local grinder. The crash is related to the JVM running the agent, not the test. The run command for the crashing JVM include:

2CIUSERARG               -Djava.library.path=/home/jenkins/workspace/Grinder_iteration_1/openjdkbinary/openjdk-test-image/jdk/jtreg/native
2CIUSERARG               --patch-module=java.base=/home/jenkins/workspace/Grinder_iteration_1/aqa-tests/TKG/output_16299582294715/jdk_lang_0/work/patches/java.base
2CIUSERARG               -Djava.security.policy=file:/home/jenkins/workspace/Grinder_iteration_1/aqa-tests/TKG/../TKG/output_16299582294715/jdk_lang_0/work/jtreg.policy
2CIUSERARG               -Dsun.java.command=com.sun.javatest.regtest.agent.AgentServer -id 19 -logfile /home/jenkins/workspace/Grinder_iteration_1/aqa-tests/TKG/output_16299582294715/jdk_lang_0/work/jtData/agentServer.19.trace -allowSetSecurityManager -port 50973 -timeoutFactor 8.0
2CIUSERARG               -Dsun.java.launcher=SUN_STANDARD

It's still only appears with POWER JDK17 builds, hence the investigation will be on a JVM running the agent code, the test is fine.

vij-singh · 2021-08-31T15:51:00Z

@rmnattas What's the next step or action for this issue?

rmnattas · 2021-08-31T17:34:04Z

The core indicates that the argument passed to java/lang/String.split(Ljava/lang/String;)[Ljava/lang/String; is null, causing a segfault when performing a load. Which could be a non-JIT issue.
My thought on the next step is talking to @llxia to see if I can run the agent locally, maybe on one of the jenkins machines, to investigate and try different options on the agent JVM itself.

llxia · 2021-09-01T13:42:02Z

Please see wiki for running the openjdk tests locally. EXTRA_OPTIONS and JVM_OPTIONS can be used for testing different jvm options.

Also, in case you want to know, openjdk17 test build uses jtreg 6.1 https://openj9-jenkins.osuosl.org/job/test.getDependency/108/

JasonFengJ9 · 2021-09-03T11:49:45Z

An occurrence at https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_Nightly/12/consoleFull

22:28:26  openjdk version "17-internal" 2021-09-14
22:28:26  OpenJDK Runtime Environment (build 17-internal+0-adhoc.****.BuildJDK17ppc64lelinuxNightly)
22:28:26  Eclipse OpenJ9 VM (build v0.28.0-release-54267846712, JRE 17 Linux ppc64le-64-Bit Compressed References 20210902_12 (JIT enabled, AOT enabled)
22:28:26  OpenJ9   - 54267846712
22:28:26  OMR      - 0bf455f830d
22:28:26  JCL      - 712145ee3f5 based on jdk-17+35)

22:33:18  ===============================================
22:33:18  Running test jdk_lang_0 ...
22:33:18  ===============================================
22:33:18  jdk_lang_0 Start Time: Fri Sep  3 02:33:18 2021 Epoch Time (ms): 1630636398429
22:33:18  "/home/jenkins/jenkins-agent/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_Nightly/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/home/jenkins/jenkins-agent/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_Nightly/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
22:33:18  
22:33:18  Attempting to destroy all caches in cacheDir /home/jenkins/javasharedresources/
22:33:18  
22:33:18  JVMSHRC806I Compressed references persistent shared cache "sharedcc_jenkins" has been destroyed. Use option -Xnocompressedrefs if you want to destroy a non-compressed references cache.
22:33:18  JVMSHRC806I Compressed references persistent shared cache "sharedcc_jenkins" has been destroyed. Use option -Xnocompressedrefs if you want to destroy a non-compressed references cache.
22:33:18  JVMSHRC005I No shared class caches available
22:33:18  cache cleanup done
22:33:18  variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage Mode150
22:33:18  JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage -XX:+UseCompressedOops 

22:47:23  --------------------------------------------------
23:16:03  TEST: java/lang/String/Exceptions.java

23:16:03  stderr:
23:16:03  Unhandled exception
23:16:03  Type=Segmentation error vmState=0x00000000
23:16:03  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
23:16:03  Handler1=00003FFF988E4970 Handler2=00003FFF9881C300
23:16:03  R0=0000000000000000 R1=00003FFF61F3ABF0 R2=00003FFF98AE6E00 R3=00000000E033D8F0
23:16:03  R4=0000000000000000 R5=0000000000000001 R6=000000000000000E R7=00003FFF61F3AD10
23:16:03  R8=000000000041DDB0 R9=000000000000000E R10=00003FFF93FF90B0 R11=0000000000419958
23:16:03  R12=0000000028004422 R13=00003FFF61F46900 R14=000000000041DBF0 R15=00000000003E9000
23:16:03  R16=00003FFF63100038 R17=FFFFFFFFFFFFFFFF R18=0005CB0EB10BA18B R19=00003FFF932A6A80
23:16:03  R20=0000000000000001 R21=0000000000000001 R22=0000000000000001 R23=0000000000000000
23:16:03  R24=00000000FFEB8C90 R25=00000000E033D8F0 R26=00000000FFEB8CD0 R27=00000000E033D8F0
23:16:03  R28=0000000000000000 R29=0000000000142700 R30=00000000FFDE6A68 R31=000000000000001F
23:16:03  NIP=00003FFF797FF178 MSR=800000000280F033 ORIG_GPR3=C000000000B2EE08 CTR=00003FFF797FF0F4
23:16:03  LINK=00003FFF93CE7570 XER=0000000000000000 CCR=0000000042004222 SOFTE=0000000000000001
23:16:03  TRAP=0000000000000300 DAR=0000000000000004 dsisr=0000000040000000 RESULT=0000000000000000
23:16:03  FPR0 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR1 405435f760000000 (f: 1610612736.000000, d: 8.084322e+01)
23:16:03  FPR2 41e0000000000000 (f: 0.000000, d: 2.147484e+09)
23:16:03  FPR3 bf3d4a1000000000 (f: 0.000000, d: -4.469194e-04)
23:16:03  FPR4 3f499a0000000000 (f: 0.000000, d: 7.812977e-04)
23:16:03  FPR5 bf94724ea0000000 (f: 2684354560.000000, d: -1.996730e-02)
23:16:03  FPR6 3f811ed6e0000000 (f: 3758096384.000000, d: 8.359603e-03)
23:16:03  FPR7 3f1251c400000000 (f: 0.000000, d: 6.988295e-05)
23:16:03  FPR8 006100760061006a (f: 6357098.000000, d: 7.566052e-307)
23:16:03  FPR9 006e0061006c002e (f: 7077934.000000, d: 1.335110e-306)
23:16:03  FPR10 3fc9c30000000000 (f: 0.000000, d: 2.012634e-01)
23:16:03  FPR11 41cdcd6500000000 (f: 0.000000, d: 1.000000e+09)
23:16:03  FPR12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR13 bfb7440000000000 (f: 0.000000, d: -9.088135e-02)
23:16:03  FPR14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR17 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR18 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR19 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR20 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR21 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR22 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR23 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
23:16:03  
23:16:03  Compiled_method=java/lang/String.split(Ljava/lang/String;I)[Ljava/lang/String;
23:16:03  Target=2_90_20210902_12 (Linux 4.4.0-210-generic)
23:16:03  CPU=ppc64le (4 logical CPUs) (0x1fe380000 RAM)
23:16:03  ----------- Stack Backtrace -----------
23:16:03  (0x00003FFF797FF178 [<unknown>+0x0])
23:16:03  (0x00003FFF98A09920 [libj9vm29.so+0x169920])
23:16:03  (0x00003FFF988BECD0 [libj9vm29.so+0x1ecd0])
23:16:03  (0x00003FFF988C0168 [libj9vm29.so+0x20168])
23:16:03  (0x00003FFF92D97CE4 [libjclse29.so+0x87ce4])
23:16:03  JVM_InvokeMethod+0x40 (0x00003FFF98F076E0 [libjvm.so+0x276e0])
23:16:03  JVM_InvokeMethod+0x34 (0x00003FFF99766814 [libjvm.so+0x6814])
23:16:03  Java_jdk_internal_reflect_NativeMethodAccessorImpl_invoke0+0x24 (0x00003FFF62D7C5B4 [libjava.so+0xc5b4])
23:16:03  (0x00003FFF7963D224 [<unknown>+0x0])
23:16:03  (0x00003FFF988B9450 [libj9vm29.so+0x19450])
23:16:03  (0x00003FFF98954490 [libj9vm29.so+0xb4490])
23:16:03  (0x00003FFF9881D708 [libj9prt29.so+0x3d708])
23:16:03  (0x00003FFF9894F644 [libj9vm29.so+0xaf644])
23:16:03  (0x00003FFF987B13E8 [libj9thr29.so+0x113e8])
23:16:03  (0x00003FFF999A8040 [libpthread.so.0+0x8040])
23:16:03  clone+0x98 (0x00003FFF998C4290 [libc.so.6+0x124290])
23:16:03  ---------------------------------------
23:16:03  JVMDUMP039I Processing dump event "gpf", detail "" at 2021/09/03 03:14:04 - please wait.

23:16:03  --------------------------------------------------
23:19:55  Test results: passed: 798; failed: 4; error: 1
23:22:46  Report written to /home/jenkins/jenkins-agent/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_Nightly/jvmtest/openjdk/report/html/report.html
23:22:46  Results written to /home/jenkins/jenkins-agent/workspace/Test_openjdk17_j9_sanity.openjdk_ppc64le_linux_Nightly/aqa-tests/TKG/output_1630636398956/jdk_lang_0/work
23:22:46  Error: Some tests failed or other problems occurred.
23:22:46  
23:22:46  jdk_lang_0_FAILED

rmnattas · 2021-09-08T15:12:04Z

The issue is actually with the test java/lang/String/Exceptions.java, not the agent. After the change in JDK17+ for the java.lang.String implementation from the OpenJ9 to the OpenJDK impl, the String methods are still under the canSkipNullChecks list which end up causing the JVM to crash instead of throwing a NPE when the String methods are JITed.

pshipton added comp:jit test failure blocker segfault Issues that describe segfaults / JVM crashes labels Aug 24, 2021

pshipton added this to the Release 0.28 (Java 17) milestone Aug 24, 2021

pshipton removed the blocker label Aug 25, 2021

pshipton added the blocker label Aug 25, 2021

midronij mentioned this issue Sep 1, 2021

jtreg java/lang/invoke/VarHandles/VarHandleTestAccess Unexpected exit from test [exit code: 137] #13368

Open

rmnattas mentioned this issue Sep 8, 2021

Remove j.l.String methods from canSkipNullChecks for JDK17+ #13465

Merged

mpirvu closed this as completed in #13465 Sep 11, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

jtreg java/lang/String/Exceptions.java crash Compiled_method=java/lang/String.split #13367

jtreg java/lang/String/Exceptions.java crash Compiled_method=java/lang/String.split #13367

pshipton commented Aug 24, 2021

pshipton commented Aug 24, 2021

pshipton commented Aug 24, 2021

pshipton commented Aug 24, 2021

pshipton commented Aug 25, 2021

JasonFengJ9 commented Aug 25, 2021

pshipton commented Aug 25, 2021

rmnattas commented Aug 25, 2021

rmnattas commented Aug 25, 2021 •

edited

Loading

rmnattas commented Aug 27, 2021 •

edited

Loading

vij-singh commented Aug 31, 2021

rmnattas commented Aug 31, 2021

llxia commented Sep 1, 2021

JasonFengJ9 commented Sep 3, 2021 •

edited

Loading

rmnattas commented Sep 8, 2021

jtreg java/lang/String/Exceptions.java crash Compiled_method=java/lang/String.split #13367

jtreg java/lang/String/Exceptions.java crash Compiled_method=java/lang/String.split #13367

Comments

pshipton commented Aug 24, 2021

pshipton commented Aug 24, 2021

pshipton commented Aug 24, 2021

pshipton commented Aug 24, 2021

pshipton commented Aug 25, 2021

JasonFengJ9 commented Aug 25, 2021

pshipton commented Aug 25, 2021

rmnattas commented Aug 25, 2021

rmnattas commented Aug 25, 2021 • edited Loading

rmnattas commented Aug 27, 2021 • edited Loading

vij-singh commented Aug 31, 2021

rmnattas commented Aug 31, 2021

llxia commented Sep 1, 2021

JasonFengJ9 commented Sep 3, 2021 • edited Loading

rmnattas commented Sep 8, 2021

rmnattas commented Aug 25, 2021 •

edited

Loading

rmnattas commented Aug 27, 2021 •

edited

Loading

JasonFengJ9 commented Sep 3, 2021 •

edited

Loading