Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A fatal error has been detected by the Java Runtime Environment: on large JFR report request #5

Closed
andrewazores opened this issue Dec 20, 2021 · 1 comment · Fixed by #7
Assignees
Labels
bug Something isn't working

Comments

@andrewazores
Copy link
Member

exec java -Dquarkus.http.host=0.0.0.0 -Djava.util.logging.manager=org.jboss.logmanager.LogManager -XX:+ExitOnOutOfMemoryError -XX:+UseSerialGC -XX:UseSSE=2 -cp . -jar /deployments/quarkus-run.jar
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/deployments/lib/main/org.jboss.slf4j.slf4j-jboss-logmanager-1.1.0.Final.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/deployments/lib/main/org.slf4j.slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Slf4jLoggerFactory]
__  ____  __  _____   ___  __ ____  ______ 
 --/ __ \/ / / / _ | / _ \/ //_/ / / / __/ 
 -/ /_/ / /_/ / __ |/ , _/ ,< / /_/ /\ \   
--\___\_\____/_/ |_/_/|_/_/|_|\____/___/   
2021-12-20 17:04:22,752 INFO  [io.quarkus] (main) cryostat-reports 1.0.0-SNAPSHOT on JVM (powered by Quarkus 2.5.3.Final) started in 1.881s. Listening on: http://0.0.0.0:8080
2021-12-20 17:04:22,842 INFO  [io.quarkus] (main) Profile prod activated. 
2021-12-20 17:04:22,842 INFO  [io.quarkus] (main) Installed features: [cdi, resteasy-reactive, smallrye-context-propagation, vertx]
2021-12-20 17:04:23,958 INFO  [io.cry.rep.ReportResource] (executor-thread-0) Received request for otel.jfr (1441656 bytes)
2021-12-20 17:04:26,642 INFO  [io.cry.rep.ReportResource] (executor-thread-0) Completed request for otel.jfr after 2683ms
2021-12-20 17:04:29,959 INFO  [io.cry.rep.ReportResource] (executor-thread-1) Received request for foo.jfr (10352883 bytes)
2021-12-20 17:04:46,439 INFO  [io.cry.rep.ReportResource] (executor-thread-1) Completed request for foo.jfr after 16479ms
2021-12-20 17:05:02,038 INFO  [io.cry.rep.ReportResource] (executor-thread-0) Received request for vertx-fib-demo-6f4775cdbf-82dvl_150mb_20211006T152006Z.jfr (156212847 bytes)
[thread 177 also had an error]
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007fcdf866f76e, pid=1, tid=181
#
# JRE version: OpenJDK Runtime Environment 18.9 (11.0.13+8) (build 11.0.13+8-LTS)
# Java VM: OpenJDK 64-Bit Server VM 18.9 (11.0.13+8-LTS, mixed mode, sharing, tiered, compressed oops, serial gc, linux-amd64)
# Problematic frame:
# j  org.openjdk.jmc.common.item.Aggregators$MinMaxConsumer.consume(Lorg/openjdk/jmc/common/item/IItem;)V+11
#
# Core dump will be written. Default location: Core dumps may be processed with "/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h" (or dumping to /deployments/core.1)
#
# An error report file with more information is saved as:
# /deployments/hs_err_pid1.log
Could not load hsdis-amd64.so; library not loadable; PrintAssembly is disabled
[thread 176 also had an error][thread 175 also had an error]

[thread 178 also had an error]
#
# If you would like to submit a bug report, please visit:
#   https://bugzilla.redhat.com/enter_bug.cgi?product=Red%20Hat%20Enterprise%20Linux%208&component=java-11-openjdk
#

[error occurred during error reporting (), id 0xb, SIGSEGV (0xb) at pc=0x00007fce168c4e91]

This definitely appears to be a HotSpot bug, but I'm not sure how or why it's being triggered exactly. When I run the container with 1 CPU and 1G of memory and make a report request where the uploaded file is ~150MB then it crashes with this message.

@andrewazores andrewazores added the bug Something isn't working label Dec 20, 2021
@andrewazores
Copy link
Member Author

https://bugzilla.redhat.com/show_bug.cgi?id=1328503 looks probably related, though this is for JDK 8.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant