OpenJDK java/lang/invoke/CompileThresholdBootstrapTest crash vmState=0x00000000

[pshipton]

https://openj9-jenkins.osuosl.org/job/Test_openjdk23_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/10/ - ub20-aarch64-5
jdk_lang_0
java/lang/invoke/CompileThresholdBootstrapTest.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk23_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/10/openjdk_test_output.tar.gz

21:33:56  ACTION: testng -- Failed. Unexpected exit from test [exit code: 255]
21:33:56  REASON: User specified action: run testng/othervm -Djava.lang.invoke.MethodHandle.COMPILE_THRESHOLD=30 test.java.lang.invoke.CompileThresholdBootstrapTest 
21:33:56  TIME:   3.041 seconds
21:33:56  messages:
21:33:56  command: testng -Djava.lang.invoke.MethodHandle.COMPILE_THRESHOLD=30 test.java.lang.invoke.CompileThresholdBootstrapTest
21:33:56  reason: User specified action: run testng/othervm -Djava.lang.invoke.MethodHandle.COMPILE_THRESHOLD=30 test.java.lang.invoke.CompileThresholdBootstrapTest 
21:33:56  started: Wed Jun 26 01:33:41 UTC 2024
21:33:56  Mode: othervm [/othervm specified]
21:33:56  finished: Wed Jun 26 01:33:44 UTC 2024
21:33:56  elapsed time (seconds): 3.041
21:33:56  configuration:
21:33:56  STDOUT:
21:33:56  STDERR:
21:33:56  Unhandled exception
21:33:56  Type=Segmentation error vmState=0x00000000
21:33:56  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
21:33:56  Handler1=0000FFFFBA983BB4 Handler2=0000FFFFBA8E9BA0 InaccessibleAddress=0000000000000009
21:33:56  R0=0000000000000000 R1=0000000000000005 R2=0000000000000009 R3=0000000000001200
21:33:56  R4=0000000000035150 R5=0000000000000020 R6=0000000000000026 R7=0000FFFF614713FE
21:33:56  R8=0000000000000008 R9=FFFFFFFFFFFFFFA8 R10=0000000000219358 R11=0000000000000008
21:33:56  R12=00000000FFEA46B8 R13=00000000FFEA4658 R14=0000000000001200 R15=0000FFFFB9B1F658
21:33:56  R16=0000FFFF61127240 R17=0000FFFFBB045150 R18=0000FFFF61126D40 R19=00000000001B9C00
21:33:56  R20=0000000000000001 R21=000000000021C7F0 R22=0000FFFFBAB330CC R23=0000000040000000
21:33:56  R24=0000FFFFBAB7F000 R25=000000000040F900 R26=0000FFFFBAB83608 R27=0000FFFFB402E770
21:33:56  R28=0000FFFFBA9DFEC0 R29=0000FFFF61126A50 R30=0000FFFFBAAA3F7C R31=0000FFFF61126A40
21:33:56  PC=0000FFFFBA9F1FC8 SP=0000FFFF61126A40 PSTATE=0000000060001000
21:33:56  V0=0000000000000005 (f: 5.000000, d: 2.470328e-323)
21:33:56  V1=0000000000000006 (f: 6.000000, d: 2.964394e-323)
21:33:56  V2=41cdcd6500000000 (f: 0.000000, d: 1.000000e+09)
21:33:56  V3=402e9a41c8f60202 (f: 3371565568.000000, d: 1.530128e+01)
21:33:56  V4=bfd00ea348b88334 (f: 1220051712.000000, d: -2.508934e-01)
21:33:56  V5=3fd5575b0be00b6a (f: 199232368.000000, d: 3.334568e-01)
21:33:56  V6=3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
21:33:56  V7=000e1781000e1781 (f: 923521.000000, d: 1.959708e-308)
21:33:56  V8=000003c10000745f (f: 29791.000000, d: 2.039238e-311)
21:33:56  V9=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V10=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V11=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V12=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V13=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V14=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V15=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V16=4010040140100401 (f: 1074791424.000000, d: 4.003911e+00)
21:33:56  V17=fe00feff00000000 (f: 0.000000, d: -8.892307e+298)
21:33:56  V18=8020080280200800 (f: 2149582848.000000, d: -4.458850e-308)
21:33:56  V19=ca62c1d6ca62c1d6 (f: 3395469824.000000, d: -2.193092e+50)
21:33:56  V20=a9281f7000f5a88e (f: 16099470.000000, d: -2.006131e-110)
21:33:56  V21=5a37b61a3d2fd955 (f: 1026545984.000000, d: 4.012677e+126)
21:33:56  V22=efcdab8967452301 (f: 1732584192.000000, d: -3.598696e+230)
21:33:56  V23=0000000000000008 (f: 8.000000, d: 3.952525e-323)
21:33:56  V24=3fd6666666666666 (f: 1717986944.000000, d: 3.500000e-01)
21:33:56  V25=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V26=0000000000000001 (f: 1.000000, d: 4.940656e-324)
21:33:56  V27=000000000000000a (f: 10.000000, d: 4.940656e-323)
21:33:56  V28=0000000000000001 (f: 1.000000, d: 4.940656e-324)
21:33:56  V29=0000000000000000 (f: 0.000000, d: 0.000000e+00)
21:33:56  V30=6e616c2e6176616a (f: 1635148160.000000, d: 5.038246e+223)
21:33:56  V31=7465522e6e6f6974 (f: 1852795264.000000, d: 4.884885e+252)
21:33:56  Module=/home/jenkins/workspace/Test_openjdk23_j9_sanity.openjdk_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9vm29.so
21:33:56  Module_base_address=0000FFFFBA950000
21:33:56  Target=2_90_20240625_12 (Linux 5.4.0-182-generic)
21:33:56  CPU=aarch64 (8 logical CPUs) (0x1efe7e000 RAM)
21:33:56  ----------- Stack Backtrace -----------
21:33:56  bytecodeLoopCompressed+0x12108 (0x0000FFFFBA9F1FC8 [libj9vm29.so+0xa1fc8])
21:33:56  c_cInterpreter+0x54 (0x0000FFFFBAAA3F7C [libj9vm29.so+0x153f7c])
21:33:56  ---------------------------------------

[pshipton]

@tajila @babsingh fyi

[babsingh]

Ran a few grinders:

• 200x w/ default settings (2 failures): https://openj9-jenkins.osuosl.org/job/Grinder/3710
• 200x w/ -Xnoaot (1 failure): https://openj9-jenkins.osuosl.org/job/Grinder/3711
• 200x w/ -Xnojit (no failures): https://openj9-jenkins.osuosl.org/job/Grinder/3712
• 200x w/ -Xint (no failures): https://openj9-jenkins.osuosl.org/job/Grinder/3709

The failure is very intermittent. The failure stops when the JIT is disabled. In all failures, the top frame is executing the invokeBasic INL. There is a J2I frame two frames below. I suspect that bad parameters are being passed by the JIT through the J2I frame; DDR detects O-slot corruption in the top frame.

Requesting the JIT to investigate, fyi @hzongaro.

[pshipton]

Created adoptium/aqa-tests#5419 to exclude the test on jdk17.

[hzongaro]

@nbhuiyan, may I ask you to look at this problem?

[vij-singh]

@nbhuiyan Is this specifically related to JDK23 (or reproducible only on JDK23)?

[nbhuiyan]

I have not been able to reproduce this in 400X Grinder using JDK 23:
https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/42379/
https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/42380/ (some failures due to running out of space)

I have also not been able to reproduce this in a 200X Grinder using JDK 21:
https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/42375/

Locally, I have also been unsuccessful in my attempt to reproduce this on x86-64 linux using either JDK21 or 23. Not sure if some recent changes are hiding this problem, so I will try with older builds.

[knn-k]

Any reports of reproducing this issue on platforms other than AArch64 Linux?

[nbhuiyan]

Currently I am not even able to reproduce this on AArch64 Linux.

Using the OpenJ9 and OMR versions that are equivalent to the June 25th nightly build used in the Grinder runs in #19761 (comment), I have been unsuccessful in reproducing the test failure.

200X JDK23 passed: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/42432/

Eclipse OpenJ9 VM (build master-cdbfd114b15, JRE 23 Linux aarch64-64-Bit Compressed References 20240725_11 (JIT enabled, AOT enabled)
OpenJ9   - cdbfd114b15
OMR      - 47a9d248db0
JCL      - 6aa6772c0d1 based on jdk-23+28)

200X JDK21 passed: https://hyc-runtimes-jenkins.swg-devops.com/job/Grinder/42435/

Eclipse OpenJ9 VM (build master-cdbfd114b15, JRE 21 Linux aarch64-64-Bit Compressed References 20240725_306 (JIT enabled, AOT enabled)
OpenJ9   - cdbfd114b15
OMR      - 47a9d248db0
JCL      - 0086a8bbba7 based on jdk-21.0.4+5)

Therefore, I would like to recommend re-enabling this test if it really has been excluded.

@pshipton Has this test been excluded anywhere? adoptium/aqa-tests#5419 excludes a different test for JDK17 on s390x-linux. I do not see this being mentioned in the problem list for JDK23.

[pshipton]

It seems there was a mistake, and this test was not excluded. Closing this issue since it can no longer be reproduced.