Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SIGSEGV/SIGBUS/other error when running amd64 Java images on arm64 M1 and M2 Macs upgraded to Sonoma #7006

Closed
patthomasrick opened this issue Oct 2, 2023 · 132 comments

Comments

@patthomasrick
Copy link

Description

I have been getting strange SIGSEGV/SIGBUS errors when running certain images. Can't tell if it is a bug in Rosetta Sonoma or Docker.

Commonalities between all images that get the same error:

  • All machines are Apple Silicon Macbooks (one is M1 Pro Max 64GB, one is M2 Pro 8GB) running MacOS Sonoma 14.0 (attached logs are on the M2, 14.0 (23A344))
  • All are linux/amd64 images running on linux/arm64 with the "Use Rosetta for x86/amd64 emulation on Apple Silicon" option checked
  • All images are Java applications
    • Have tried installing different JVM implementations, all run into the same issue; doesn't seem like it is specific to any one JVM implementation (have tried Corretto, GraalVM, OpenJDK)

I've seen SIGSEGV errors (most common) as well as a few SIGBUS and more generic but out-of-place Java errors.

I was able to replicate it with an old public Cassandra image, but it takes multiple tries (around 4 or 5). The 64GB M1 Pro Max seemed to crash more reliably than the same command on the 8GB M2. There might be another application that more reliably crashes, particularly ones that are very memory hungry.

Output of full log with error is in additional information.

Related error in adoptium issues: adoptium/adoptium-support#904

Reproduce

  1. On Apple Silicon Mac running MacOS 14.0 (Sonoma):
  2. Run docker run -it --rm --name cass-3.11 --platform linux/amd64 cassandra:3.11
  3. Should fail in around 5-10 seconds
  4. If it doesn't, you might have to try multiple times before it crashes

Also crashes:

docker run -it --rm --name jenkins --platform linux/amd64 jenkins/jenkins

Expected behavior

Image should behave like the arm64 variant; image should start successfully.

Successful command:

docker run -it --rm --name cass-3.11 --platform linux/arm64 cassandra:3.11

Log of successful (arm64) output is in additional information.

docker version

Client: Docker Engine - Community
 Version:           24.0.6
 API version:       1.43
 Go version:        go1.21.0
 Git commit:        ed223bc820
 Built:             Thu Aug 31 17:24:32 2023
 OS/Arch:           darwin/arm64
 Context:           desktop-linux

Server: Docker Desktop 4.24.0 (122432)
 Engine:
  Version:          24.0.6
  API version:      1.43 (minimum version 1.12)
  Go version:       go1.20.7
  Git commit:       1a79695
  Built:            Mon Sep  4 12:31:36 2023
  OS/Arch:          linux/arm64
  Experimental:     false
 containerd:
  Version:          1.6.22
  GitCommit:        8165feabfdfe38c65b599c4993d227328c231fca
 runc:
  Version:          1.1.8
  GitCommit:        v1.1.8-0-g82f18fe
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

docker info

Client: Docker Engine - Community
 Version:    24.0.6
 Context:    desktop-linux
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.11.2-desktop.5
    Path:     /Users/thomas/.docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.22.0-desktop.2
    Path:     /Users/thomas/.docker/cli-plugins/docker-compose
  dev: Docker Dev Environments (Docker Inc.)
    Version:  v0.1.0
    Path:     /Users/thomas/.docker/cli-plugins/docker-dev
  extension: Manages Docker extensions (Docker Inc.)
    Version:  v0.2.20
    Path:     /Users/thomas/.docker/cli-plugins/docker-extension
  init: Creates Docker-related starter files for your project (Docker Inc.)
    Version:  v0.1.0-beta.8
    Path:     /Users/thomas/.docker/cli-plugins/docker-init
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
    Version:  0.6.0
    Path:     /Users/thomas/.docker/cli-plugins/docker-sbom
  scan: Docker Scan (Docker Inc.)
    Version:  v0.26.0
    Path:     /Users/thomas/.docker/cli-plugins/docker-scan
  scout: Docker Scout (Docker Inc.)
    Version:  v1.0.7
    Path:     /Users/thomas/.docker/cli-plugins/docker-scout

Server:
 Containers: 1
  Running: 1
  Paused: 0
  Stopped: 0
 Images: 2
 Server Version: 24.0.6
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 8165feabfdfe38c65b599c4993d227328c231fca
 runc version: v1.1.8-0-g82f18fe
 init version: de40ad0
 Security Options:
  seccomp
   Profile: unconfined
  cgroupns
 Kernel Version: 6.4.16-linuxkit
 Operating System: Docker Desktop
 OSType: linux
 Architecture: aarch64
 CPUs: 9
 Total Memory: 3.841GiB
 Name: docker-desktop
 ID: 601a2ee6-f3c4-4bcd-841c-2f5050e43986
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http.docker.internal:3128
 HTTPS Proxy: http.docker.internal:3128
 No Proxy: hubproxy.docker.internal
 Username: patthomasrick
 Experimental: false
 Insecure Registries:
  hubproxy.docker.internal:5555
  127.0.0.0/8
 Live Restore Enabled: false

Diagnostics ID

AA9BC4C0-C4EB-412B-9A43-91744219A5ED/20231002230347

Additional Info

Log of output with error:

CompilerOracle: dontinline org/apache/cassandra/db/Columns$Serializer.serializeLargeSubset (Ljava/util/Collection;ILorg/apache/cassandra/db/Columns;ILorg/apache/cassandra/io/util/DataOutputPlus;)V
CompilerOracle: dontinline org/apache/cassandra/db/Columns$Serializer.serializeLargeSubsetSize (Ljava/util/Collection;ILorg/apache/cassandra/db/Columns;I)I
CompilerOracle: dontinline org/apache/cassandra/db/commitlog/AbstractCommitLogSegmentManager.advanceAllocatingFrom (Lorg/apache/cassandra/db/commitlog/CommitLogSegment;)V
CompilerOracle: dontinline org/apache/cassandra/db/transform/BaseIterator.tryGetMoreContents ()Z
CompilerOracle: dontinline org/apache/cassandra/db/transform/StoppingTransformation.stop ()V
CompilerOracle: dontinline org/apache/cassandra/db/transform/StoppingTransformation.stopInPartition ()V
CompilerOracle: dontinline org/apache/cassandra/io/util/BufferedDataOutputStreamPlus.doFlush (I)V
CompilerOracle: dontinline org/apache/cassandra/io/util/BufferedDataOutputStreamPlus.writeExcessSlow ()V
CompilerOracle: dontinline org/apache/cassandra/io/util/BufferedDataOutputStreamPlus.writeSlow (JI)V
CompilerOracle: dontinline org/apache/cassandra/io/util/RebufferingInputStream.readPrimitiveSlowly (I)J
CompilerOracle: inline org/apache/cassandra/db/rows/UnfilteredSerializer.serializeRowBody (Lorg/apache/cassandra/db/rows/Row;ILorg/apache/cassandra/db/SerializationHeader;Lorg/apache/cassandra/io/util/DataOutputPlus;)V
CompilerOracle: inline org/apache/cassandra/io/util/Memory.checkBounds (JJ)V
CompilerOracle: inline org/apache/cassandra/io/util/SafeMemory.checkBounds (JJ)V
CompilerOracle: inline org/apache/cassandra/utils/AsymmetricOrdering.selectBoundary (Lorg/apache/cassandra/utils/AsymmetricOrdering/Op;II)I
CompilerOracle: inline org/apache/cassandra/utils/AsymmetricOrdering.strictnessOfLessThan (Lorg/apache/cassandra/utils/AsymmetricOrdering/Op;)I
CompilerOracle: inline org/apache/cassandra/utils/BloomFilter.indexes (Lorg/apache/cassandra/utils/IFilter/FilterKey;)[J
CompilerOracle: inline org/apache/cassandra/utils/BloomFilter.setIndexes (JJIJ[J)V
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare (Ljava/nio/ByteBuffer;[B)I
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare ([BLjava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compareUnsigned (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/lang/Object;JI)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/vint/VIntCoding.encodeVInt (JI)[B
INFO  [main] 2023-10-02 22:48:36,451 YamlConfigurationLoader.java:93 - Configuration location: file:/etc/cassandra/cassandra.yaml
INFO  [main] 2023-10-02 22:48:36,934 Config.java:555 - Node configuration:[allocate_tokens_for_keyspace=null; allow_extra_insecure_udfs=false; allow_insecure_udfs=false; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; back_pressure_strategy=org.apache.cassandra.net.RateBasedBackPressure{high_ratio=0.9, factor=5, flow=FAST}; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=172.17.0.2; broadcast_rpc_address=172.17.0.2; buffer_pool_use_heap_if_exhausted=true; cache_load_timeout_seconds=30; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=0; check_for_duplicate_rows_during_compaction=true; check_for_duplicate_rows_during_reads=true; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=null; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=NaN; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11a9e7c8; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_drop_compact_storage=false; enable_materialized_views=true; enable_sasi_indexes=true; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=<REDACTED>; endpoint_snitch=SimpleSnitch; file_cache_round_up=null; file_cache_size_in_mb=null; force_new_prepared_statement_behaviour=false; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=null; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=dc; internode_recv_buff_size_in_bytes=0; internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=172.17.0.2; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=0; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_flush_in_batches_legacy=true; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_concurrent_requests_in_bytes=-1; native_transport_max_concurrent_requests_in_bytes_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_negotiable_protocol_version=-2147483648; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=256; otc_backlog_expiration_interval_ms=200; otc_coalescing_enough_coalesced_messages=8; otc_coalescing_strategy=DISABLED; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; repair_session_max_tree_depth=18; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=null; seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=172.17.0.2}; server_encryption_options=<REDACTED>; slow_query_log_timeout_in_ms=500; snapshot_before_compaction=false; snapshot_on_duplicate_row_detection=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_keep_alive_period_in_secs=300; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@3901d134; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO  [main] 2023-10-02 22:48:36,935 DatabaseDescriptor.java:381 - DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO  [main] 2023-10-02 22:48:36,936 DatabaseDescriptor.java:439 - Global memtable on-heap threshold is enabled at 249MB
INFO  [main] 2023-10-02 22:48:36,936 DatabaseDescriptor.java:443 - Global memtable off-heap threshold is enabled at 249MB
WARN  [main] 2023-10-02 22:48:37,046 DatabaseDescriptor.java:579 - Only 56.150GiB free across all data volumes. Consider adding more capacity to your cluster or removing obsolete snapshots
INFO  [main] 2023-10-02 22:48:37,063 RateBasedBackPressure.java:123 - Initialized back-pressure with high ratio: 0.9, factor: 5, flow: FAST, window size: 2000.
INFO  [main] 2023-10-02 22:48:37,063 DatabaseDescriptor.java:781 - Back-pressure is disabled with strategy org.apache.cassandra.net.RateBasedBackPressure{high_ratio=0.9, factor=5, flow=FAST}.
INFO  [main] 2023-10-02 22:48:37,188 JMXServerUtils.java:256 - Configured JMX server at: service:jmx:rmi://127.0.0.1/jndi/rmi://127.0.0.1:7199/jmxrmi
INFO  [main] 2023-10-02 22:48:37,199 CassandraDaemon.java:490 - Hostname: 117ca8a37ea1
INFO  [main] 2023-10-02 22:48:37,200 CassandraDaemon.java:497 - JVM vendor/version: OpenJDK 64-Bit Server VM/1.8.0_382
INFO  [main] 2023-10-02 22:48:37,200 CassandraDaemon.java:498 - Heap size: 998.438MiB/998.438MiB
INFO  [main] 2023-10-02 22:48:37,203 CassandraDaemon.java:503 - Code Cache Non-heap memory: init = 2555904(2496K) used = 4747520(4636K) committed = 4784128(4672K) max = 251658240(245760K)
INFO  [main] 2023-10-02 22:48:37,204 CassandraDaemon.java:503 - Metaspace Non-heap memory: init = 0(0K) used = 19823592(19358K) committed = 20578304(20096K) max = -1(-1K)
INFO  [main] 2023-10-02 22:48:37,204 CassandraDaemon.java:503 - Compressed Class Space Non-heap memory: init = 0(0K) used = 2343536(2288K) committed = 2490368(2432K) max = 1073741824(1048576K)
INFO  [main] 2023-10-02 22:48:37,204 CassandraDaemon.java:503 - Par Eden Space Heap memory: init = 214827008(209792K) used = 94561864(92345K) committed = 214827008(209792K) max = 214827008(209792K)
INFO  [main] 2023-10-02 22:48:37,204 CassandraDaemon.java:503 - Par Survivor Space Heap memory: init = 26804224(26176K) used = 0(0K) committed = 26804224(26176K) max = 26804224(26176K)
INFO  [main] 2023-10-02 22:48:37,204 CassandraDaemon.java:503 - CMS Old Gen Heap memory: init = 805306368(786432K) used = 0(0K) committed = 805306368(786432K) max = 805306368(786432K)
INFO  [main] 2023-10-02 22:48:37,204 CassandraDaemon.java:505 - Classpath: /etc/cassandra:/opt/cassandra/build/classes/main:/opt/cassandra/build/classes/thrift:/opt/cassandra/lib/HdrHistogram-2.1.9.jar:/opt/cassandra/lib/ST4-4.0.8.jar:/opt/cassandra/lib/airline-0.6.jar:/opt/cassandra/lib/antlr-runtime-3.5.2.jar:/opt/cassandra/lib/apache-cassandra-3.11.16.jar:/opt/cassandra/lib/apache-cassandra-thrift-3.11.16.jar:/opt/cassandra/lib/asm-5.0.4.jar:/opt/cassandra/lib/caffeine-2.2.6.jar:/opt/cassandra/lib/cassandra-driver-core-3.0.1-shaded.jar:/opt/cassandra/lib/commons-cli-1.1.jar:/opt/cassandra/lib/commons-codec-1.9.jar:/opt/cassandra/lib/commons-lang3-3.1.jar:/opt/cassandra/lib/commons-math3-3.2.jar:/opt/cassandra/lib/compress-lzf-0.8.4.jar:/opt/cassandra/lib/concurrent-trees-2.4.0.jar:/opt/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/opt/cassandra/lib/disruptor-3.0.1.jar:/opt/cassandra/lib/ecj-4.4.2.jar:/opt/cassandra/lib/guava-18.0.jar:/opt/cassandra/lib/high-scale-lib-1.0.6.jar:/opt/cassandra/lib/hppc-0.5.4.jar:/opt/cassandra/lib/jackson-annotations-2.13.2.jar:/opt/cassandra/lib/jackson-core-2.13.2.jar:/opt/cassandra/lib/jackson-databind-2.13.2.2.jar:/opt/cassandra/lib/jamm-0.3.0.jar:/opt/cassandra/lib/javax.inject-1.jar:/opt/cassandra/lib/jbcrypt-0.4.jar:/opt/cassandra/lib/jcl-over-slf4j-1.7.25.jar:/opt/cassandra/lib/jctools-core-1.2.1.jar:/opt/cassandra/lib/jna-4.2.2.jar:/opt/cassandra/lib/joda-time-2.4.jar:/opt/cassandra/lib/json-simple-1.1.jar:/opt/cassandra/lib/libthrift-0.9.2.jar:/opt/cassandra/lib/log4j-over-slf4j-1.7.25.jar:/opt/cassandra/lib/logback-classic-1.2.9.jar:/opt/cassandra/lib/logback-core-1.2.9.jar:/opt/cassandra/lib/lz4-1.3.0.jar:/opt/cassandra/lib/metrics-core-3.1.5.jar:/opt/cassandra/lib/metrics-jvm-3.1.5.jar:/opt/cassandra/lib/metrics-logback-3.1.5.jar:/opt/cassandra/lib/netty-all-4.0.44.Final.jar:/opt/cassandra/lib/ohc-core-0.4.4.jar:/opt/cassandra/lib/ohc-core-j8-0.4.4.jar:/opt/cassandra/lib/reporter-config-base-3.0.3.jar:/opt/cassandra/lib/reporter-config3-3.0.3.jar:/opt/cassandra/lib/sigar-1.6.4.jar:/opt/cassandra/lib/slf4j-api-1.7.25.jar:/opt/cassandra/lib/snakeyaml-1.26.jar:/opt/cassandra/lib/snappy-java-1.1.1.7.jar:/opt/cassandra/lib/snowball-stemmer-1.3.0.581.1.jar:/opt/cassandra/lib/stream-2.5.2.jar:/opt/cassandra/lib/thrift-server-0.3.7.jar:/opt/cassandra/lib/jsr223/*/*.jar::/opt/cassandra/lib/jamm-0.3.0.jar
INFO  [main] 2023-10-02 22:48:37,206 CassandraDaemon.java:507 - JVM Arguments: [-Xloggc:/opt/cassandra/logs/gc.log, -ea, -XX:+UseThreadPriorities, -XX:ThreadPriorityPolicy=42, -XX:+HeapDumpOnOutOfMemoryError, -Xss256k, -XX:StringTableSize=1000003, -XX:+AlwaysPreTouch, -XX:-UseBiasedLocking, -XX:+UseTLAB, -XX:+ResizeTLAB, -XX:+UseNUMA, -XX:+PerfDisableSharedMem, -Djava.net.preferIPv4Stack=true, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, -XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:CMSWaitDuration=10000, -XX:+CMSParallelInitialMarkEnabled, -XX:+CMSEdenChunksRecordAlways, -XX:+CMSClassUnloadingEnabled, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintHeapAtGC, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -XX:+PrintPromotionFailure, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=10, -XX:GCLogFileSize=10M, -Xms1024M, -Xmx1024M, -Xmn256M, -XX:+UseCondCardMark, -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler, -javaagent:/opt/cassandra/lib/jamm-0.3.0.jar, -Dcassandra.jmx.local.port=7199, -Dcom.sun.management.jmxremote.authenticate=false, -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password, -Djava.library.path=/opt/cassandra/lib/sigar-bin, -Dcassandra.libjemalloc=/usr/local/lib/libjemalloc.so, -XX:OnOutOfMemoryError=kill -9 %p, -Dlogback.configurationFile=logback.xml, -Dcassandra.logdir=/opt/cassandra/logs, -Dcassandra.storagedir=/opt/cassandra/data, -Dcassandra-foreground=yes]
WARN  [main] 2023-10-02 22:48:37,332 NativeLibrary.java:189 - Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially with mmapped I/O enabled. Increase RLIMIT_MEMLOCK or run Cassandra as root.
INFO  [main] 2023-10-02 22:48:37,335 StartupChecks.java:140 - jemalloc seems to be preloaded from /usr/local/lib/libjemalloc.so
WARN  [main] 2023-10-02 22:48:37,336 StartupChecks.java:169 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info.
INFO  [main] 2023-10-02 22:48:37,338 SigarLibrary.java:44 - Initializing SIGAR library
WARN  [main] 2023-10-02 22:48:37,362 SigarLibrary.java:174 - Cassandra server running in degraded mode. Is swap disabled? : false,  Address space adequate? : true,  nofile limit adequate? : true, nproc limit adequate? : true 
WARN  [main] 2023-10-02 22:48:37,370 StartupChecks.java:311 - Maximum number of memory map areas per process (vm.max_map_count) 262144 is too low, recommended value: 1048575, you can change it with sysctl.
WARN  [main] 2023-10-02 22:48:37,402 StartupChecks.java:332 - Directory /opt/cassandra/data/data doesn't exist
WARN  [main] 2023-10-02 22:48:37,419 StartupChecks.java:332 - Directory /opt/cassandra/data/commitlog doesn't exist
WARN  [main] 2023-10-02 22:48:37,426 StartupChecks.java:332 - Directory /opt/cassandra/data/saved_caches doesn't exist
WARN  [main] 2023-10-02 22:48:37,427 StartupChecks.java:332 - Directory /opt/cassandra/data/hints doesn't exist
INFO  [main] 2023-10-02 22:48:37,483 QueryProcessor.java:121 - Initialized prepared statement caches with 10 MB (native) and 10 MB (Thrift)
INFO  [main] 2023-10-02 22:48:37,926 ColumnFamilyStore.java:432 - Initializing system.IndexInfo
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007ffffe5387df, pid=1, tid=0x00007fffec9ff700
#
# JRE version: OpenJDK Runtime Environment (8.0_382-b05) (build 1.8.0_382-b05)
# Java VM: OpenJDK 64-Bit Server VM (25.382-b05 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# V  [libjvm.so+0x98e7df]  ParScanThreadState::trim_queues(int)+0x1df
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /tmp/hs_err_pid1.log
#
# If you would like to submit a bug report, please visit:
#   https://github.com/adoptium/adoptium-support/issues
#

[error occurred during error reporting , id 0xb]

Log of output without error:

CompilerOracle: dontinline org/apache/cassandra/db/Columns$Serializer.deserializeLargeSubset (Lorg/apache/cassandra/io/util/DataInputPlus;Lorg/apache/cassandra/db/Columns;I)Lorg/apache/cassandra/db/Columns;
CompilerOracle: dontinline org/apache/cassandra/db/Columns$Serializer.serializeLargeSubset (Ljava/util/Collection;ILorg/apache/cassandra/db/Columns;ILorg/apache/cassandra/io/util/DataOutputPlus;)V
CompilerOracle: dontinline org/apache/cassandra/db/Columns$Serializer.serializeLargeSubsetSize (Ljava/util/Collection;ILorg/apache/cassandra/db/Columns;I)I
CompilerOracle: dontinline org/apache/cassandra/db/commitlog/AbstractCommitLogSegmentManager.advanceAllocatingFrom (Lorg/apache/cassandra/db/commitlog/CommitLogSegment;)V
CompilerOracle: dontinline org/apache/cassandra/db/transform/BaseIterator.tryGetMoreContents ()Z
CompilerOracle: dontinline org/apache/cassandra/db/transform/StoppingTransformation.stop ()V
CompilerOracle: dontinline org/apache/cassandra/db/transform/StoppingTransformation.stopInPartition ()V
CompilerOracle: dontinline org/apache/cassandra/io/util/BufferedDataOutputStreamPlus.doFlush (I)V
CompilerOracle: dontinline org/apache/cassandra/io/util/BufferedDataOutputStreamPlus.writeExcessSlow ()V
CompilerOracle: dontinline org/apache/cassandra/io/util/BufferedDataOutputStreamPlus.writeSlow (JI)V
CompilerOracle: dontinline org/apache/cassandra/io/util/RebufferingInputStream.readPrimitiveSlowly (I)J
CompilerOracle: inline org/apache/cassandra/db/rows/UnfilteredSerializer.serializeRowBody (Lorg/apache/cassandra/db/rows/Row;ILorg/apache/cassandra/db/SerializationHeader;Lorg/apache/cassandra/io/util/DataOutputPlus;)V
CompilerOracle: inline org/apache/cassandra/io/util/Memory.checkBounds (JJ)V
CompilerOracle: inline org/apache/cassandra/io/util/SafeMemory.checkBounds (JJ)V
CompilerOracle: inline org/apache/cassandra/utils/AsymmetricOrdering.selectBoundary (Lorg/apache/cassandra/utils/AsymmetricOrdering/Op;II)I
CompilerOracle: inline org/apache/cassandra/utils/AsymmetricOrdering.strictnessOfLessThan (Lorg/apache/cassandra/utils/AsymmetricOrdering/Op;)I
CompilerOracle: inline org/apache/cassandra/utils/BloomFilter.indexes (Lorg/apache/cassandra/utils/IFilter/FilterKey;)[J
CompilerOracle: inline org/apache/cassandra/utils/BloomFilter.setIndexes (JJIJ[J)V
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare (Ljava/nio/ByteBuffer;[B)I
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compare ([BLjava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/ByteBufferUtil.compareUnsigned (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/lang/Object;JI)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/lang/Object;JILjava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/FastByteOperations$UnsafeOperations.compareTo (Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)I
CompilerOracle: inline org/apache/cassandra/utils/vint/VIntCoding.encodeVInt (JI)[B
INFO  [main] 2023-10-02 23:02:11,158 YamlConfigurationLoader.java:93 - Configuration location: file:/etc/cassandra/cassandra.yaml
INFO  [main] 2023-10-02 23:02:11,288 Config.java:555 - Node configuration:[allocate_tokens_for_keyspace=null; allow_extra_insecure_udfs=false; allow_insecure_udfs=false; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; back_pressure_strategy=org.apache.cassandra.net.RateBasedBackPressure{high_ratio=0.9, factor=5, flow=FAST}; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=172.17.0.2; broadcast_rpc_address=172.17.0.2; buffer_pool_use_heap_if_exhausted=true; cache_load_timeout_seconds=30; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=0; check_for_duplicate_rows_during_compaction=true; check_for_duplicate_rows_during_reads=true; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=null; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=NaN; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11a9e7c8; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_drop_compact_storage=false; enable_materialized_views=true; enable_sasi_indexes=true; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=<REDACTED>; endpoint_snitch=SimpleSnitch; file_cache_round_up=null; file_cache_size_in_mb=null; force_new_prepared_statement_behaviour=false; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=null; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=dc; internode_recv_buff_size_in_bytes=0; internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=172.17.0.2; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=0; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_flush_in_batches_legacy=true; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_concurrent_requests_in_bytes=-1; native_transport_max_concurrent_requests_in_bytes_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_negotiable_protocol_version=-2147483648; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=256; otc_backlog_expiration_interval_ms=200; otc_coalescing_enough_coalesced_messages=8; otc_coalescing_strategy=DISABLED; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; repair_session_max_tree_depth=18; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=null; seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=172.17.0.2}; server_encryption_options=<REDACTED>; slow_query_log_timeout_in_ms=500; snapshot_before_compaction=false; snapshot_on_duplicate_row_detection=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_keep_alive_period_in_secs=300; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@3901d134; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO  [main] 2023-10-02 23:02:11,289 DatabaseDescriptor.java:381 - DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO  [main] 2023-10-02 23:02:11,289 DatabaseDescriptor.java:439 - Global memtable on-heap threshold is enabled at 249MB
INFO  [main] 2023-10-02 23:02:11,289 DatabaseDescriptor.java:443 - Global memtable off-heap threshold is enabled at 249MB
WARN  [main] 2023-10-02 23:02:11,391 DatabaseDescriptor.java:579 - Only 55.928GiB free across all data volumes. Consider adding more capacity to your cluster or removing obsolete snapshots
INFO  [main] 2023-10-02 23:02:11,404 RateBasedBackPressure.java:123 - Initialized back-pressure with high ratio: 0.9, factor: 5, flow: FAST, window size: 2000.
INFO  [main] 2023-10-02 23:02:11,404 DatabaseDescriptor.java:781 - Back-pressure is disabled with strategy org.apache.cassandra.net.RateBasedBackPressure{high_ratio=0.9, factor=5, flow=FAST}.
INFO  [main] 2023-10-02 23:02:11,461 JMXServerUtils.java:256 - Configured JMX server at: service:jmx:rmi://127.0.0.1/jndi/rmi://127.0.0.1:7199/jmxrmi
INFO  [main] 2023-10-02 23:02:11,464 CassandraDaemon.java:490 - Hostname: 1321dfbf2802
INFO  [main] 2023-10-02 23:02:11,464 CassandraDaemon.java:497 - JVM vendor/version: OpenJDK 64-Bit Server VM/1.8.0_382
INFO  [main] 2023-10-02 23:02:11,464 CassandraDaemon.java:498 - Heap size: 998.438MiB/998.438MiB
INFO  [main] 2023-10-02 23:02:11,464 CassandraDaemon.java:503 - Code Cache Non-heap memory: init = 2555904(2496K) used = 4688320(4578K) committed = 4718592(4608K) max = 134217728(131072K)
INFO  [main] 2023-10-02 23:02:11,465 CassandraDaemon.java:503 - Metaspace Non-heap memory: init = 0(0K) used = 19606264(19146K) committed = 20316160(19840K) max = -1(-1K)
INFO  [main] 2023-10-02 23:02:11,465 CassandraDaemon.java:503 - Compressed Class Space Non-heap memory: init = 0(0K) used = 2330376(2275K) committed = 2490368(2432K) max = 1073741824(1048576K)
INFO  [main] 2023-10-02 23:02:11,465 CassandraDaemon.java:503 - Par Eden Space Heap memory: init = 214827008(209792K) used = 90288880(88172K) committed = 214827008(209792K) max = 214827008(209792K)
INFO  [main] 2023-10-02 23:02:11,465 CassandraDaemon.java:503 - Par Survivor Space Heap memory: init = 26804224(26176K) used = 0(0K) committed = 26804224(26176K) max = 26804224(26176K)
INFO  [main] 2023-10-02 23:02:11,465 CassandraDaemon.java:503 - CMS Old Gen Heap memory: init = 805306368(786432K) used = 0(0K) committed = 805306368(786432K) max = 805306368(786432K)
INFO  [main] 2023-10-02 23:02:11,465 CassandraDaemon.java:505 - Classpath: /etc/cassandra:/opt/cassandra/build/classes/main:/opt/cassandra/build/classes/thrift:/opt/cassandra/lib/HdrHistogram-2.1.9.jar:/opt/cassandra/lib/ST4-4.0.8.jar:/opt/cassandra/lib/airline-0.6.jar:/opt/cassandra/lib/antlr-runtime-3.5.2.jar:/opt/cassandra/lib/apache-cassandra-3.11.16.jar:/opt/cassandra/lib/apache-cassandra-thrift-3.11.16.jar:/opt/cassandra/lib/asm-5.0.4.jar:/opt/cassandra/lib/caffeine-2.2.6.jar:/opt/cassandra/lib/cassandra-driver-core-3.0.1-shaded.jar:/opt/cassandra/lib/commons-cli-1.1.jar:/opt/cassandra/lib/commons-codec-1.9.jar:/opt/cassandra/lib/commons-lang3-3.1.jar:/opt/cassandra/lib/commons-math3-3.2.jar:/opt/cassandra/lib/compress-lzf-0.8.4.jar:/opt/cassandra/lib/concurrent-trees-2.4.0.jar:/opt/cassandra/lib/concurrentlinkedhashmap-lru-1.4.jar:/opt/cassandra/lib/disruptor-3.0.1.jar:/opt/cassandra/lib/ecj-4.4.2.jar:/opt/cassandra/lib/guava-18.0.jar:/opt/cassandra/lib/high-scale-lib-1.0.6.jar:/opt/cassandra/lib/hppc-0.5.4.jar:/opt/cassandra/lib/jackson-annotations-2.13.2.jar:/opt/cassandra/lib/jackson-core-2.13.2.jar:/opt/cassandra/lib/jackson-databind-2.13.2.2.jar:/opt/cassandra/lib/jamm-0.3.0.jar:/opt/cassandra/lib/javax.inject-1.jar:/opt/cassandra/lib/jbcrypt-0.4.jar:/opt/cassandra/lib/jcl-over-slf4j-1.7.25.jar:/opt/cassandra/lib/jctools-core-1.2.1.jar:/opt/cassandra/lib/jna-4.2.2.jar:/opt/cassandra/lib/joda-time-2.4.jar:/opt/cassandra/lib/json-simple-1.1.jar:/opt/cassandra/lib/libthrift-0.9.2.jar:/opt/cassandra/lib/log4j-over-slf4j-1.7.25.jar:/opt/cassandra/lib/logback-classic-1.2.9.jar:/opt/cassandra/lib/logback-core-1.2.9.jar:/opt/cassandra/lib/lz4-1.3.0.jar:/opt/cassandra/lib/metrics-core-3.1.5.jar:/opt/cassandra/lib/metrics-jvm-3.1.5.jar:/opt/cassandra/lib/metrics-logback-3.1.5.jar:/opt/cassandra/lib/netty-all-4.0.44.Final.jar:/opt/cassandra/lib/ohc-core-0.4.4.jar:/opt/cassandra/lib/ohc-core-j8-0.4.4.jar:/opt/cassandra/lib/reporter-config-base-3.0.3.jar:/opt/cassandra/lib/reporter-config3-3.0.3.jar:/opt/cassandra/lib/sigar-1.6.4.jar:/opt/cassandra/lib/slf4j-api-1.7.25.jar:/opt/cassandra/lib/snakeyaml-1.26.jar:/opt/cassandra/lib/snappy-java-1.1.1.7.jar:/opt/cassandra/lib/snowball-stemmer-1.3.0.581.1.jar:/opt/cassandra/lib/stream-2.5.2.jar:/opt/cassandra/lib/thrift-server-0.3.7.jar:/opt/cassandra/lib/jsr223/*/*.jar::/opt/cassandra/lib/jamm-0.3.0.jar
INFO  [main] 2023-10-02 23:02:11,465 CassandraDaemon.java:507 - JVM Arguments: [-Xloggc:/opt/cassandra/logs/gc.log, -ea, -XX:+UseThreadPriorities, -XX:ThreadPriorityPolicy=42, -XX:+HeapDumpOnOutOfMemoryError, -Xss256k, -XX:StringTableSize=1000003, -XX:+AlwaysPreTouch, -XX:-UseBiasedLocking, -XX:+UseTLAB, -XX:+ResizeTLAB, -XX:+UseNUMA, -XX:+PerfDisableSharedMem, -Djava.net.preferIPv4Stack=true, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, -XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:CMSWaitDuration=10000, -XX:+CMSParallelInitialMarkEnabled, -XX:+CMSEdenChunksRecordAlways, -XX:+CMSClassUnloadingEnabled, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintHeapAtGC, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -XX:+PrintPromotionFailure, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=10, -XX:GCLogFileSize=10M, -Xms1024M, -Xmx1024M, -Xmn256M, -XX:+UseCondCardMark, -XX:CompileCommandFile=/etc/cassandra/hotspot_compiler, -javaagent:/opt/cassandra/lib/jamm-0.3.0.jar, -Dcassandra.jmx.local.port=7199, -Dcom.sun.management.jmxremote.authenticate=false, -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password, -Djava.library.path=/opt/cassandra/lib/sigar-bin, -Dcassandra.libjemalloc=/usr/local/lib/libjemalloc.so, -XX:OnOutOfMemoryError=kill -9 %p, -Dlogback.configurationFile=logback.xml, -Dcassandra.logdir=/opt/cassandra/logs, -Dcassandra.storagedir=/opt/cassandra/data, -Dcassandra-foreground=yes]
WARN  [main] 2023-10-02 23:02:11,488 NativeLibrary.java:189 - Unable to lock JVM memory (ENOMEM). This can result in part of the JVM being swapped out, especially with mmapped I/O enabled. Increase RLIMIT_MEMLOCK or run Cassandra as root.
INFO  [main] 2023-10-02 23:02:11,489 StartupChecks.java:140 - jemalloc seems to be preloaded from /usr/local/lib/libjemalloc.so
WARN  [main] 2023-10-02 23:02:11,489 StartupChecks.java:169 - JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info.
INFO  [main] 2023-10-02 23:02:11,490 SigarLibrary.java:44 - Initializing SIGAR library
INFO  [main] 2023-10-02 23:02:11,496 SigarLibrary.java:57 - Could not initialize SIGAR library org.hyperic.sigar.Sigar.getFileSystemListNative()[Lorg/hyperic/sigar/FileSystem; 
INFO  [main] 2023-10-02 23:02:11,496 SigarLibrary.java:185 - Sigar could not be initialized, test for checking degraded mode omitted.
WARN  [main] 2023-10-02 23:02:11,496 StartupChecks.java:311 - Maximum number of memory map areas per process (vm.max_map_count) 262144 is too low, recommended value: 1048575, you can change it with sysctl.
WARN  [main] 2023-10-02 23:02:11,509 StartupChecks.java:332 - Directory /opt/cassandra/data/data doesn't exist
WARN  [main] 2023-10-02 23:02:11,513 StartupChecks.java:332 - Directory /opt/cassandra/data/commitlog doesn't exist
WARN  [main] 2023-10-02 23:02:11,513 StartupChecks.java:332 - Directory /opt/cassandra/data/saved_caches doesn't exist
WARN  [main] 2023-10-02 23:02:11,514 StartupChecks.java:332 - Directory /opt/cassandra/data/hints doesn't exist
INFO  [main] 2023-10-02 23:02:11,555 QueryProcessor.java:121 - Initialized prepared statement caches with 10 MB (native) and 10 MB (Thrift)
INFO  [main] 2023-10-02 23:02:11,770 ColumnFamilyStore.java:432 - Initializing system.IndexInfo
INFO  [main] 2023-10-02 23:02:12,286 ColumnFamilyStore.java:432 - Initializing system.batches
INFO  [main] 2023-10-02 23:02:12,289 ColumnFamilyStore.java:432 - Initializing system.paxos
INFO  [main] 2023-10-02 23:02:12,293 ColumnFamilyStore.java:432 - Initializing system.local
INFO  [main] 2023-10-02 23:02:12,295 ColumnFamilyStore.java:432 - Initializing system.peers
INFO  [main] 2023-10-02 23:02:12,298 ColumnFamilyStore.java:432 - Initializing system.peer_events
INFO  [main] 2023-10-02 23:02:12,300 ColumnFamilyStore.java:432 - Initializing system.range_xfers
INFO  [main] 2023-10-02 23:02:12,301 ColumnFamilyStore.java:432 - Initializing system.compaction_history
INFO  [main] 2023-10-02 23:02:12,303 ColumnFamilyStore.java:432 - Initializing system.sstable_activity
INFO  [main] 2023-10-02 23:02:12,305 ColumnFamilyStore.java:432 - Initializing system.size_estimates
INFO  [main] 2023-10-02 23:02:12,307 ColumnFamilyStore.java:432 - Initializing system.available_ranges
INFO  [main] 2023-10-02 23:02:12,309 ColumnFamilyStore.java:432 - Initializing system.transferred_ranges
INFO  [main] 2023-10-02 23:02:12,312 ColumnFamilyStore.java:432 - Initializing system.views_builds_in_progress
INFO  [main] 2023-10-02 23:02:12,313 ColumnFamilyStore.java:432 - Initializing system.built_views
INFO  [main] 2023-10-02 23:02:12,315 ColumnFamilyStore.java:432 - Initializing system.hints
INFO  [main] 2023-10-02 23:02:12,317 ColumnFamilyStore.java:432 - Initializing system.batchlog
INFO  [main] 2023-10-02 23:02:12,318 ColumnFamilyStore.java:432 - Initializing system.prepared_statements
INFO  [main] 2023-10-02 23:02:12,320 ColumnFamilyStore.java:432 - Initializing system.schema_keyspaces
INFO  [main] 2023-10-02 23:02:12,360 ColumnFamilyStore.java:432 - Initializing system.schema_columnfamilies
INFO  [main] 2023-10-02 23:02:12,363 ColumnFamilyStore.java:432 - Initializing system.schema_columns
INFO  [main] 2023-10-02 23:02:12,364 ColumnFamilyStore.java:432 - Initializing system.schema_triggers
INFO  [main] 2023-10-02 23:02:12,366 ColumnFamilyStore.java:432 - Initializing system.schema_usertypes
INFO  [main] 2023-10-02 23:02:12,367 ColumnFamilyStore.java:432 - Initializing system.schema_functions
INFO  [main] 2023-10-02 23:02:12,368 ColumnFamilyStore.java:432 - Initializing system.schema_aggregates
INFO  [main] 2023-10-02 23:02:12,370 ViewManager.java:137 - Not submitting build tasks for views in keyspace system as storage service is not initialized
INFO  [main] 2023-10-02 23:02:12,399 ApproximateTime.java:44 - Scheduling approximate time-check task with a precision of 10 milliseconds
INFO  [main] 2023-10-02 23:02:12,408 ColumnFamilyStore.java:432 - Initializing system_schema.keyspaces
INFO  [main] 2023-10-02 23:02:12,410 ColumnFamilyStore.java:432 - Initializing system_schema.tables
INFO  [main] 2023-10-02 23:02:12,412 ColumnFamilyStore.java:432 - Initializing system_schema.columns
INFO  [main] 2023-10-02 23:02:12,413 ColumnFamilyStore.java:432 - Initializing system_schema.triggers
INFO  [main] 2023-10-02 23:02:12,415 ColumnFamilyStore.java:432 - Initializing system_schema.dropped_columns
INFO  [main] 2023-10-02 23:02:12,416 ColumnFamilyStore.java:432 - Initializing system_schema.views
INFO  [main] 2023-10-02 23:02:12,418 ColumnFamilyStore.java:432 - Initializing system_schema.types
INFO  [main] 2023-10-02 23:02:12,419 ColumnFamilyStore.java:432 - Initializing system_schema.functions
INFO  [main] 2023-10-02 23:02:12,421 ColumnFamilyStore.java:432 - Initializing system_schema.aggregates
INFO  [main] 2023-10-02 23:02:12,422 ColumnFamilyStore.java:432 - Initializing system_schema.indexes
INFO  [main] 2023-10-02 23:02:12,423 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_schema as storage service is not initialized
WARN  [main] 2023-10-02 23:02:12,454 SystemKeyspace.java:1197 - No host ID found, created d90a22e8-9e8b-44e9-898b-3c35cdca772f (Note: This should happen exactly once per node).
INFO  [MemtableFlushWriter:1] 2023-10-02 23:02:12,617 CacheService.java:103 - Initializing key cache with capacity of 49 MBs.
INFO  [MemtableFlushWriter:1] 2023-10-02 23:02:12,620 CacheService.java:125 - Initializing row cache with capacity of 0 MBs
INFO  [MemtableFlushWriter:1] 2023-10-02 23:02:12,620 CacheService.java:154 - Initializing counter cache with capacity of 24 MBs
INFO  [MemtableFlushWriter:1] 2023-10-02 23:02:12,621 CacheService.java:165 - Scheduling counter cache save to every 7200 seconds (going to save all keys).
INFO  [MemtableFlushWriter:2] 2023-10-02 23:02:12,645 BufferPool.java:251 - Global buffer pool is enabled, when pool is exhausted (max is 249.000MiB) it will allocate on heap
INFO  [main] 2023-10-02 23:02:12,745 StorageService.java:773 - Populating token metadata from system tables
INFO  [main] 2023-10-02 23:02:12,753 StorageService.java:780 - Token metadata: 
INFO  [pool-4-thread-1] 2023-10-02 23:02:12,761 AutoSavingCache.java:174 - Completed loading (0 ms; 2 keys) KeyCache cache
INFO  [main] 2023-10-02 23:02:12,768 CommitLog.java:164 - No commitlog files found; skipping replay
INFO  [main] 2023-10-02 23:02:12,768 StorageService.java:773 - Populating token metadata from system tables
INFO  [main] 2023-10-02 23:02:12,772 StorageService.java:780 - Token metadata: 
INFO  [main] 2023-10-02 23:02:12,799 QueryProcessor.java:174 - Preloaded 0 prepared statements
INFO  [main] 2023-10-02 23:02:12,799 StorageService.java:791 - Cassandra version: 3.11.16
INFO  [main] 2023-10-02 23:02:12,799 StorageService.java:792 - Thrift API version: 20.1.0
INFO  [main] 2023-10-02 23:02:12,799 StorageService.java:793 - CQL supported versions: 3.4.4 (default: 3.4.4)
INFO  [main] 2023-10-02 23:02:12,799 StorageService.java:795 - Native protocol supported versions: 3/v3, 4/v4, 5/v5-beta (default: 4/v4)
INFO  [main] 2023-10-02 23:02:12,812 IndexSummaryManager.java:87 - Initializing index summary manager with a memory pool size of 49 MB and a resize interval of 60 minutes
INFO  [main] 2023-10-02 23:02:12,817 MessagingService.java:750 - Starting Messaging Service on /172.17.0.2:7000 (eth0)
INFO  [main] 2023-10-02 23:02:12,826 StorageService.java:723 - Unable to gossip with any peers but continuing anyway since node is in its own seed list
INFO  [main] 2023-10-02 23:02:12,833 StorageService.java:877 - Loading persisted ring state
INFO  [main] 2023-10-02 23:02:12,833 StorageService.java:1008 - Starting up server gossip
INFO  [main] 2023-10-02 23:02:12,861 StorageService.java:1091 - This node will not auto bootstrap because it is configured to be a seed node.
INFO  [main] 2023-10-02 23:02:12,866 BootStrapper.java:228 - Generated random tokens. tokens are [-1798349201955824457, 4661447672249904835, 4103154813723787536, 16019235791079349, -4074958584357467834, -3795899582324311897, 7561232937411552203, -8349054747765846023, 3647237170953337906, 3909410286760344127, -3954110679282777423, -4829578122184033643, -6280316010744964750, -8362596424476726256, -7350306640183143067, -1380885744444004791, -4620084303873094326, 5457754206139345741, -4382099884128543134, -7697595596901898600, 8521543370437707263, 1758599119248284120, 6674939440804800244, -7081755713213396753, -754970481419414281, 397108957159720803, -6602816451183806622, -5086168882693371875, 2214814137216005893, 6725630875707100254, -6610882159035766002, 3081403045239327864, 2573448984606458052, 3995375999262322258, 510391097008421137, 7554233117446519195, -2424873510843603324, -3302794905659836970, -6977214402039687761, 6536167411565710738, 8878591852871752561, -3649101843868105461, 2283165715582984830, -4373717951301501071, -9146749210783336231, 5761428144293580365, -7657454274117315246, -3344864695391336997, 3435893078626168555, -7514555520918141205, -7666634982794220030, 8837742992540508717, 5179396007352955902, -8872778193794760298, 6083705095661561018, 6253761360670645938, 8893566541247081758, -6280918290510969196, 252416707037484286, 177693172073836147, -3629847599969480458, -4335886397366388339, -56481695440657563, -3870486019902213063, -5351667170889444064, -4312447083034378859, 6135342081974513981, -6075514641589600528, 1388569964637944539, 1217499669877861891, -5057692230786444191, -356151696790118680, 4308612063122622938, -5650669212401175826, 872878236600265261, 759165430180948860, -5898796230157505642, -6722360930413377284, 4684050143256524689, 5724834032518617514, 1660681043461475732, -2972110213879845987, -1733605406223949556, -1301751562142024129, -930270658367672467, 4930199373578949785, 1231382196510319101, 6864074025076944838, -857103300007234424, -9102598833812984754, -1370675489535197136, -3616079838822368744, -3124640587436923754, -1973472351718403382, 4213594534581164651, 4811882232239422156, 9112073460441683157, 1464849230924218041, -5307976828428242900, 9061378532254429876, 542372115503546217, 6475644315084773725, 4753015389328954265, -5829886627506778010, 6523256455677552144, 7802854359686326546, -4014164499859770926, 7011565006487035822, -5478847589183787006, -7506325925124682814, 4925105376631239419, -143015826060501174, -2328745641339754301, 1493597148586982383, 6681603952388622033, -2155043244197153422, 8680888818291581955, 1236146622382103167, 7822467389310909988, -7627159068872561259, 1380595756316785918, 7986292673073333720, 3622872710713618497, 7506875256921872786, 6030464872672995141, 7960583107436115180, -2507297440809673674, -6891591509816241386, 3906742126324398309, -933715967791423245, -7311223394697009894, -8210241400767625502, 5595939980204970491, -8181367653090847054, 6343771267230015192, 914190531988445429, 2043132581047347547, -7982709379052556206, -4341802058120361977, -3734155484151273096, -4004786192333864493, -2494712058955964948, -5176933691127165017, 5367003422125335143, 5751289972009966302, 6789827872421667030, 7593433098308309821, -5182418550789219807, -8682194571907428348, 5052545166600062703, -6609555273614606350, -6357840295382110194, 2140811692957327839, -5473404719473580148, -8637451781539403134, -4960674149210657563, 5298934847671109373, 6420831827863561352, 4899250714430688533, -9063072967747034207, 5718210679991841674, 8195723362735173940, -5548441250163250358, 7413920824899582236, 1413262161135866791, 4701287303579119987, -5852559449079234180, 1211030323822578078, -6512317999295010266, -4409522974916999543, -1010464580477202954, 2814023403335269978, -4372209232761385146, -8881337862509183672, -1229641889454057820, -729523971502846948, -8189506849785275, -8174349565135760506, 5431953366365447292, -2875042354968634709, -1576343845827139206, 4436374441241977121, -1418066238956154763, 5904257914200669170, 2922528541207142736, -1253007245654870875, -7433253346226470297, -7635651917027764879, 3824287949254582761, 4998188136282309166, -4820454347391261424, 1137227578540224402, 9103488395687057015, 4798473670911578048, -871552941289437146, 4025994643273660777, 8798177501509909523, -3315546244859542294, 6442046631727689492, 1328037180203446711, 1996633721411482795, -80113899938069199, -281008800565444105, 4477949195225327886, 6397821189253135051, 8422014524940899490, 3787374132823892957, -653897574618745457, 6537132557972274149, 3048187725043663005, -6790901721036919887, -3646955740023916656, -2399232591932039191, 9004560050038645195, 5192089251061665712, -2552289334236762701, -6342912189702341121, 7961603935878038286, -276523647584223458, -4839666421880259997, -5795604980095747771, -3229910343938845079, 2544984744710292353, -5585940843757372758, -3860217620173612807, 1607794225154297332, 6386045802096591562, -8347410489798670159, 5148110921075726394, 3502007662243232927, 8095742343872506588, -5895768365857598200, -5387290409727770812, -4386217508139612886, -6505403363496204208, 987302768911453300, -489404096778083665, -6172424698209385562, 3037227131944682374, 7635912520766658465, -8534023987544081452, 8116944323479958076, -7768550016972616882, 8949737866444759230, -1108157884272028222, -6994449514530150618, -5286799124495667980, 9044344422892097002, -4680143729745475495, -1626723819036797058, 6050822490573408622, -4925645381461607000, -2152182709959824900, 6829274216846221143, -1838768562108466842, 1522091668376344457]
INFO  [MigrationStage:1] 2023-10-02 23:02:13,018 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_traces as storage service is not initialized
INFO  [MigrationStage:1] 2023-10-02 23:02:13,019 ColumnFamilyStore.java:432 - Initializing system_traces.events
INFO  [MigrationStage:1] 2023-10-02 23:02:13,022 ColumnFamilyStore.java:432 - Initializing system_traces.sessions
INFO  [MigrationStage:1] 2023-10-02 23:02:13,027 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_distributed as storage service is not initialized
INFO  [MigrationStage:1] 2023-10-02 23:02:13,027 ColumnFamilyStore.java:432 - Initializing system_distributed.parent_repair_history
INFO  [MigrationStage:1] 2023-10-02 23:02:13,029 ColumnFamilyStore.java:432 - Initializing system_distributed.repair_history
INFO  [MigrationStage:1] 2023-10-02 23:02:13,031 ColumnFamilyStore.java:432 - Initializing system_distributed.view_build_status
INFO  [MigrationStage:1] 2023-10-02 23:02:13,032 ViewManager.java:137 - Not submitting build tasks for views in keyspace system_auth as storage service is not initialized
INFO  [MigrationStage:1] 2023-10-02 23:02:13,033 ColumnFamilyStore.java:432 - Initializing system_auth.resource_role_permissons_index
INFO  [MigrationStage:1] 2023-10-02 23:02:13,034 ColumnFamilyStore.java:432 - Initializing system_auth.role_members
INFO  [MigrationStage:1] 2023-10-02 23:02:13,036 ColumnFamilyStore.java:432 - Initializing system_auth.role_permissions
INFO  [MigrationStage:1] 2023-10-02 23:02:13,046 ColumnFamilyStore.java:432 - Initializing system_auth.roles
INFO  [main] 2023-10-02 23:02:13,060 StorageService.java:1679 - JOINING: Finish joining ring
INFO  [main] 2023-10-02 23:02:13,115 Gossiper.java:1896 - Waiting for gossip to settle...
INFO  [main] 2023-10-02 23:02:21,129 Gossiper.java:1930 - No gossip backlog; proceeding
INFO  [main] 2023-10-02 23:02:21,285 NativeTransportService.java:73 - Netty using Java NIO event loop
INFO  [main] 2023-10-02 23:02:21,326 Server.java:158 - Using Netty Version: [netty-buffer=netty-buffer-4.0.44.Final.452812a, netty-codec=netty-codec-4.0.44.Final.452812a, netty-codec-haproxy=netty-codec-haproxy-4.0.44.Final.452812a, netty-codec-http=netty-codec-http-4.0.44.Final.452812a, netty-codec-socks=netty-codec-socks-4.0.44.Final.452812a, netty-common=netty-common-4.0.44.Final.452812a, netty-handler=netty-handler-4.0.44.Final.452812a, netty-tcnative=netty-tcnative-1.1.33.Fork26.142ecbb, netty-transport=netty-transport-4.0.44.Final.452812a, netty-transport-native-epoll=netty-transport-native-epoll-4.0.44.Final.452812a, netty-transport-rxtx=netty-transport-rxtx-4.0.44.Final.452812a, netty-transport-sctp=netty-transport-sctp-4.0.44.Final.452812a, netty-transport-udt=netty-transport-udt-4.0.44.Final.452812a]
INFO  [main] 2023-10-02 23:02:21,327 Server.java:159 - Starting listening for CQL clients on /0.0.0.0:9042 (unencrypted)...
INFO  [main] 2023-10-02 23:02:21,346 CassandraDaemon.java:564 - Not starting RPC server as requested. Use JMX (StorageService->startRPCServer()) or nodetool (enablethrift) to start it
INFO  [main] 2023-10-02 23:02:21,346 CassandraDaemon.java:650 - Startup complete
INFO  [OptionalTasks:1] 2023-10-02 23:02:23,251 CassandraRoleManager.java:374 - Created default superuser role 'cassandra'

Jenkins crash:

webroot: /var/jenkins_home/war
2023-10-02 23:19:02.329+0000 [id=1]	INFO	winstone.Logger#logInternal: Beginning extraction from war file
2023-10-02 23:19:03.699+0000 [id=1]	WARNING	o.e.j.s.handler.ContextHandler#setContextPath: Empty contextPath
2023-10-02 23:19:03.776+0000 [id=1]	INFO	org.eclipse.jetty.server.Server#doStart: jetty-10.0.16; built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4; jvm 11.0.20.1+1
2023-10-02 23:19:04.198+0000 [id=1]	INFO	o.e.j.w.StandardDescriptorProcessor#visitServlet: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
2023-10-02 23:19:04.302+0000 [id=1]	INFO	o.e.j.s.s.DefaultSessionIdManager#doStart: Session workerName=node0
2023-10-02 23:19:04.984+0000 [id=1]	INFO	hudson.WebAppMain#contextInitialized: Jenkins home directory: /var/jenkins_home found at: EnvVars.masterEnvVars.get("JENKINS_HOME")
2023-10-02 23:19:05.263+0000 [id=1]	INFO	o.e.j.s.handler.ContextHandler#doStart: Started w.@332820f4{Jenkins v2.425,/,file:///var/jenkins_home/war/,AVAILABLE}{/var/jenkins_home/war}
2023-10-02 23:19:05.286+0000 [id=1]	INFO	o.e.j.server.AbstractConnector#doStart: Started ServerConnector@37efd131{HTTP/1.1, (http/1.1)}{0.0.0.0:8080}
2023-10-02 23:19:05.312+0000 [id=1]	INFO	org.eclipse.jetty.server.Server#doStart: Started Server@6b7906b3{STARTING}[10.0.16,sto=0] @4037ms
2023-10-02 23:19:05.315+0000 [id=25]	INFO	winstone.Logger#logInternal: Winstone Servlet Engine running: controlPort=disabled
2023-10-02 23:19:05.574+0000 [id=33]	INFO	jenkins.InitReactorRunner$1#onAttained: Started initialization
2023-10-02 23:19:05.665+0000 [id=38]	INFO	jenkins.InitReactorRunner$1#onAttained: Listed all plugins
2023-10-02 23:19:06.712+0000 [id=38]	INFO	jenkins.InitReactorRunner$1#onAttained: Prepared all plugins
2023-10-02 23:19:06.730+0000 [id=43]	INFO	jenkins.InitReactorRunner$1#onAttained: Started all plugins
2023-10-02 23:19:06.763+0000 [id=40]	INFO	jenkins.InitReactorRunner$1#onAttained: Augmented all extensions
2023-10-02 23:19:07.046+0000 [id=35]	INFO	jenkins.InitReactorRunner$1#onAttained: System config loaded
2023-10-02 23:19:07.048+0000 [id=34]	INFO	jenkins.InitReactorRunner$1#onAttained: System config adapted
2023-10-02 23:19:07.056+0000 [id=34]	INFO	jenkins.InitReactorRunner$1#onAttained: Loaded all jobs
2023-10-02 23:19:07.060+0000 [id=34]	INFO	jenkins.InitReactorRunner$1#onAttained: Configuration for all jobs updated
2023-10-02 23:19:07.186+0000 [id=59]	INFO	hudson.util.Retrier#start: Attempt #1 to do the action check updates server
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.codehaus.groovy.vmplugin.v7.Java7$1 (file:/var/jenkins_home/war/WEB-INF/lib/groovy-all-2.4.21.jar) to constructor java.lang.invoke.MethodHandles$Lookup(java.lang.Class,int)
WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.vmplugin.v7.Java7$1
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2023-10-02 23:19:08.146+0000 [id=34]	INFO	jenkins.install.SetupWizard#init: 

*************************************************************
*************************************************************
*************************************************************

Jenkins initial setup is required. An admin user has been created and a password generated.
Please use the following password to proceed to installation:

01cd31382622440a89d0ab301077df4d

This may also be found at: /var/jenkins_home/secrets/initialAdminPassword

*************************************************************
*************************************************************
*************************************************************

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007ffffea61b81, pid=7, tid=53
#
# JRE version: OpenJDK Runtime Environment Temurin-11.0.20.1+1 (11.0.20.1+1) (build 11.0.20.1+1)
# Java VM: OpenJDK 64-Bit Server VM Temurin-11.0.20.1+1 (11.0.20.1+1, mixed mode, tiered, compressed oops, g1 gc, linux-amd64)
# Problematic frame:
# V  [libjvm.so+0x661b81]  oopDesc::size_given_klass(Klass*)+0x1
#
# No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /tmp/hs_err_pid7.log
#
# If you would like to submit a bug report, please visit:
#   https://github.com/adoptium/adoptium-support/issues
#
@gonzalopardogms
Copy link

gonzalopardogms commented Oct 3, 2023

Exactly same behaviour on my end after updating to Sonoma in my Apple M1 Pro 16GB.

Amd64 images that run Java 8/11 processes as CMD started to throw same error:

*************************************************************
*************************************************************
*************************************************************
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007ffffea61b81, pid=7, tid=53
#
# JRE version: OpenJDK Runtime Environment Temurin-11.0.20.1+1 (11.0.20.1+1) (build 11.0.20.1+1)
# Java VM: OpenJDK 64-Bit Server VM Temurin-11.0.20.1+1 (11.0.20.1+1, mixed mode, tiered, compressed oops, g1 gc, linux-amd64)
# Problematic frame:
# V  [libjvm.so+0x661b81]  oopDesc::size_given_klass(Klass*)+0x1
#
# No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /tmp/hs_err_pid7.log
#
# If you would like to submit a bug report, please visit:
#   https://github.com/adoptium/adoptium-support/issues
#

Other images such docker.elastic.co/elasticsearch/elasticsearch:8.10.2 which runs java under the hood fail on start-up:

Exception in thread "main" java.io.UncheckedIOException: java.io.IOException: Cannot run program "/usr/share/elasticsearch/jdk/bin/java": error=0, Failed to exec spawn helper: pid: 38, exit value: 1
	at org.elasticsearch.server.cli.ServerProcess.start(ServerProcess.java:119)
	at org.elasticsearch.server.cli.ServerProcess.start(ServerProcess.java:88)
	at org.elasticsearch.server.cli.ServerCli.startServer(ServerCli.java:239)
	at org.elasticsearch.server.cli.ServerCli.execute(ServerCli.java:100)
	at org.elasticsearch.common.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:54)
	at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:85)
	at org.elasticsearch.cli.Command.main(Command.java:50)
	

Docker version 24.0.6, build ed223bc
Docker Compose version v2.22.0-desktop.2

@Ayyub-Omer
Copy link

Ayyub-Omer commented Oct 3, 2023

I am also facing this issue after updating to Sonoma on my Apple M1 Pro 32GB. I have an Amd64 image running Java 11 which throws the below error. Interestingly, this error goes away if I uncheck the "Use Rosetta for x86/amd64 Emulation on Apple Silicon" checkbox, but unfortunately, in my case, unchecking this option makes the container run far too slowly.

#2023-10-03 13:29:12 # A fatal error has been detected by the Java Runtime Environment:
2023-10-03 13:29:12 #
2023-10-03 13:29:12 #  SIGSEGV (0xb) at pc=0x00007ffffe439800, pid=252, tid=256
2023-10-03 13:29:12 #
2023-10-03 13:29:12 # JRE version: OpenJDK Runtime Environment 18.9 (11.0.8+10) (build 11.0.8+10-LTS)
2023-10-03 13:29:12 # Java VM: OpenJDK 64-Bit Server VM 18.9 (11.0.8+10-LTS, mixed mode, sharing, tiered, compressed oops, g1 gc, linux-amd64)
2023-10-03 13:29:12 # Problematic frame:
2023-10-03 13:29:12 # V  [libjvm.so+0x7d0800]  void OopOopIterateBoundedDispatch<G1AdjustClosure>::Table::oop_oop_iterate_bounded<InstanceMirrorKlass, unsigned int>(G1AdjustClosure*, oopDesc*, Klass*, MemRegion)+0x40
2023-10-03 13:29:12 #
2023-10-03 13:29:12 # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
2023-10-03 13:29:12 #
2023-10-03 13:29:12 # An error report file with more information is saved as:
2023-10-03 13:29:12 # /opt/jboss/wildfly/bin/hs_err_pid252.log
2023-10-03 13:29:12 #
2023-10-03 13:29:12 # If you would like to submit a bug report, please visit:
2023-10-03 13:29:12 #   https://bugreport.java.com/bugreport/crash.jsp

Docker Desktop 4.24.0 (122432)

@JasringStw
Copy link

JasringStw commented Oct 3, 2023

I'm having the same issue but found a workaround for this, it seems a bit slower but at least it works again. I added an additional argument
vmargs= -XX:+UseZGC
This prevents the cash most of the times, however I have still seen it a few times.

I hope there will be a solution for this.
the other additional agruent I have to use from the start Rosetta was supported in docker is this one: -Djdk.lang.Process.launchMechanism=vfork

I'm happy it all works but the performance in some parts of my application is still way slower than it was on my previous Intel based machine.

@fredAlm
Copy link

fredAlm commented Oct 3, 2023

Same problem here on my M2 Pro 32GB after Sonoma upgrade. I'm running different docker images with java support using rosetta2 (they are all amd64 based images).
Getting errors like the one below pretty much on every app startup.

Not sure if it's related but I see a bad number of reported cores allocated for the containers as well (at the top of the Containers view). I've allocated 4 cores but CPU usage reports: (5 cores allocated).

2023-10-03 14:14:42 weblogic  | #
2023-10-03 14:14:42 weblogic  | # A fatal error has been detected by the Java Runtime Environment:
2023-10-03 14:14:42 weblogic  | #
2023-10-03 14:14:42 weblogic  | #  [thread 140737461089856 also had an error]
2023-10-03 14:14:42 weblogic  | SIGSEGV (0xb) at pc=0x00007fffff2b5090, pid=50, tid=0x00007ffffe1ff640
2023-10-03 14:14:42 weblogic  | #
2023-10-03 14:14:42 weblogic  | # JRE version: Java(TM) SE Runtime Environment (7.0_311-b07) (build 1.7.0_311-b07)
2023-10-03 14:14:42 weblogic  | # Java VM: Java HotSpot(TM) 64-Bit Server VM (24.311-b07 mixed mode linux-amd64 compressed oops)
2023-10-03 14:14:42 weblogic  | # Problematic frame:
2023-10-03 14:14:42 weblogic  | # V  [libjvm.so+0x8b5090]  StealTask::do_it(GCTaskManager*, unsigned int)+0x220
2023-10-03 14:14:42 weblogic  | #
2023-10-03 14:14:42 weblogic  | # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
2023-10-03 14:14:42 weblogic  | #
2023-10-03 14:14:42 weblogic  | # An error report file with more information is saved as:
2023-10-03 14:14:42 weblogic  | # /opt/oracle/domain/hs_err_pid50.log
2023-10-03 14:14:42 weblogic  | #
2023-10-03 14:14:42 weblogic  | # If you would like to submit a bug report, please visit:
2023-10-03 14:14:42 weblogic  | #   http://bugreport.java.com/bugreport/crash.jsp
2023-10-03 14:14:42 weblogic  | #
2023-10-03 14:14:42 weblogic  | Aborted

Problem seems to be worse when allocating more cores for the containers.

@ndobb
Copy link

ndobb commented Oct 3, 2023

Same issues on my M1 16GB after Sonoma upgrade. The errors seem to occur on startup for just about any Java-based image.

example:

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007ffffe3ac734, pid=109, tid=155
#
# JRE version: OpenJDK Runtime Environment (11.0.1+13) (build 11.0.1+13-LTS)
# Java VM: OpenJDK 64-Bit Server VM (11.0.1+13-LTS, mixed mode, sharing, tiered, compressed oops, g1 gc, linux-amd64)
# Problematic frame:
# V  [libjvm.so+0x7e5734]
#
# No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#

Like others I also noticed that the error summary seems to assume one more core than I've actually allocated:

---------------  S U M M A R Y ------------

Command Line: -D[Standalone] -Xms64m -Xmx512m -XX:MetaspaceSize=96M -XX:MaxMetaspaceSize=256m -Djava.net.preferIPv4Stack=true -Djboss.modules.system.pkgs=org.jboss.byteman -Djava.awt.headless=true --add-exports=java.base/sun.nio.ch=ALL-UNNAMED --add-exports=jdk.unsupported/sun.misc=ALL-UNNAMED --add-exports=jdk.unsupported/sun.reflect=ALL-UNNAMED -Dorg.jboss.boot.log.file=/opt/jboss/wildfly/standalone/log/server.log -Dlogging.configuration=file:/opt/jboss/wildfly/standalone/configuration/logging.properties /opt/jboss/wildfly/jboss-modules.jar -mp /opt/jboss/wildfly/modules org.jboss.as.standalone -Djboss.home.dir=/opt/jboss/wildfly -Djboss.server.base.dir=/opt/jboss/wildfly/standalone -b 0.0.0.0 -c standalone.xml -Djboss.http.port=8080

Host: x86_64, 11 cores, 11G, CentOS Linux release 7.6.1810 (Core) 

Notice the 11 cores. I actually have 10:

image

Docker Desktop v4.24.0
Docker version 24.0.6, build ed223bc
Docker Compose version v2.22.0-desktop.2

@nicekiwi
Copy link

nicekiwi commented Oct 4, 2023

@ndobb extra cores issue also reported here. #7010

@ndobb
Copy link

ndobb commented Oct 4, 2023

Update: I'm not sure if this is a generalizable workaround for others, but in Docker Desktop under Features in development -> Beta features, unchecking Use Rosetta for x86/amd64 emulation on Apple Silicon seems to at least prevent the Java-based containers from going down on startup for me.

@gonzalopardogms
Copy link

gonzalopardogms commented Oct 5, 2023

In my case when I uncheck Use Rosetta for x86/amd64 emulation on Apple Silicon I would get:

qemu: uncaught target signal 11 (Segmentation fault) - core dumped Segmentation fault

And docker container stops.

@aturri
Copy link

aturri commented Oct 6, 2023

Same problem here. In our company we asked to stop updating to macOS 14 until there is a solution, since we are using Docker containers with Java images.

@ian0cordova
Copy link

Guess I'll revert my OS until there's a fix? I'm on the same boat that when I uncheck Rosetta, the container doesn't fully start.

@gonzalopardogms
Copy link

I'll give it a couple of weeks more, waiting for Sonoma 14.1 version; nevertheless no mention about this issue there so far...

@ch-tstrickland
Copy link

Has anyone raised a ticket with Apple about this? If so, do you have a ticket number?

@marjonrafael
Copy link

Same problem here with a container with Java 17 and Sonoma 14.0.

@cameron-corteva
Copy link

We're experiencing the same issue on a couple M1 Macs updated to Sonoma 14.0. I tried 14.1 Beta 3 and have the same issue, unfortunately.

@JoelClemence
Copy link

There does seem to be something fishy going on with CPU handling, like @ndobb the setting is set as 8:
Screenshot 2023-10-12 at 14 26 33

But when running the CPUS are showing as 900% (i.e. 9):
Screenshot 2023-10-12 at 14 25 46

I've noticed it will consistently allocate it an extra core (not sure if I am misinterpretting this setting) but there does seem to be an interesting behaviour here.

We have noticed this SEGV issue in containers running multiple Java versions across different distros.

@its-me-peter
Copy link

Having the same issue, now with "Use Rosetta vor x86/x64 emulation" on docker won't start up at all. But now I've got it so that at least it starts. it just stakes about 15 minutes...

@bfrcpz
Copy link

bfrcpz commented Oct 13, 2023

Limiting cpu ressources to one CPU is fixing the problem for me

@Sangeppato
Copy link

Have you tried rolling back to Docker Desktop 4.23? Does the problem occur there as well?

@bjorgvino
Copy link

Limiting cpu ressources to one CPU is fixing the problem for me

With Rosetta and 8 CPU cores:

12.29 #
12.29 # A fatal error has been detected by the Java Runtime Environment:
12.29 #
12.29 #  SIGSEGV (0xb) at pc=0x00007fffff196e4f, pid=1, tid=43
12.29 #
12.29 # JRE version: OpenJDK Runtime Environment Corretto-17.0.8.8.1 (17.0.8.1+8) (build 17.0.8.1+8-LTS)
12.29 # Java VM: OpenJDK 64-Bit Server VM Corretto-17.0.8.8.1 (17.0.8.1+8-LTS, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64)
12.29 # Problematic frame:
12.29 # V  [libjvm.so+0x738e4f]  G1ParScanThreadState::trim_queue_to_threshold(unsigned int)+0x355f
12.30 #
12.30 # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
12.30 #
12.30 # An error report file with more information is saved as:
12.30 # /usr/app/hs_err_pid1.log
12.32 #
12.32 # If you would like to submit a bug report, please visit:
12.32 #   https://github.com/corretto/corretto-17/issues/
12.32 #
12.32
12.32 [error occurred during error reporting (), id 0xb, SIGSEGV (0xb) at pc=0x00007fffffdbb898]

With Rosetta and 1 CPU: No error, build is successful.

Docker Desktop 4.24.2 (124339)

@ian0cordova
Copy link

ian0cordova commented Oct 13, 2023

With Rosetta and 1 CPU: No error, build is successful.

Docker Desktop 4.24.2 (124339)

Rosetta and 1 CPU "fixed" this for me as well.

Mac M1 Pro - Docker Desktop 4.24.0 (122432)

@bsousaa
Copy link
Contributor

bsousaa commented Oct 13, 2023

This is caused by a bug in Rosetta and we've reported to Apple.

Until a fix is released, and as workaround, please try the parameter --env JAVA_OPTS="-XX:-UseG1GC -XX:+UseZGC" in your docker run command.

Example: docker run -it --rm --name jenkins --platform linux/amd64 jenkins/jenkins --env JAVA_OPTS="-XX:-UseG1GC -XX:+UseZGC

@dbulaj
Copy link

dbulaj commented Oct 16, 2023

@bsousaa is it possible to somehow use this with docker compose? I couldn't make it work (I mean setting the parameter --env JAVA_OPTS="-XX:-UseG1GC -XX:+UseZGC")

@sbleon
Copy link

sbleon commented Jun 12, 2024

Hi everyone, here's an internal build that you could try: Docker.dmg

This worked for my team as well. Thanks @dgageot !

@kimseunghyun-kr
Copy link

kimseunghyun-kr commented Jun 13, 2024

this seems related buy jvm crashing when i do docker buildx build --platform=linux/amd64 where the dockerfile contains gradlew specifically. m3 max, docker version 4.31.0

this seems relevant as downgrading to 4.27.2 also solved my problem. surprisingly worked for m1 max

@c-hoeger
Copy link

Hi everyone, here's an internal build that you could try: Docker.dmg We believe it fixes your issues. I would be happy to find out if it does.

Solves this issue for me as well, thanks!

@cvakiitho
Copy link

cvakiitho commented Jun 13, 2024

Do I need some new docker cli?

No. Have you tried restarting Docker? If the problem persists, can you share a diagnostic id?

restarting macbook helped, thanks.

EDIT:
Also confirming jdk now compiles without issues.

@fredAlm
Copy link

fredAlm commented Jun 14, 2024

Yes 4.32 seems to have solved the issue for me as well running rosetta2 emulated amd64 java based pods

@joelrivera79
Copy link

FINALLY!
I have spent the last 3 days figuring out what was happening. I though it was the images!
Working on my m1 pro now with 4.32!

When will the be officially released?

@lindblomj
Copy link

Hi everyone, here's an internal build that you could try: Docker.dmg We believe it fixes your issues. I would be happy to find out if it does.

This version takes care of business and resolves this issue for us!
Have tried two of our docker images that stopped working after the Sonoma 14.5 upgrade. Was forced to downgrade to 4.27.2 as a workaround as none of the newer versions available at that time worked (4.28 - 4.30).
On a M2 Max using Rosetta emulation.

@StephanDoens
Copy link

StephanDoens commented Jun 20, 2024

I installed it replacing 4.31, but now it's not showing any of my images or containers.

Error
An error occurred while loading the images list.

(macbook M2)

Update... after fully uninstalling docker (bug button) and reinstalling the internal Build, all has been running stable for the past week.

@daer-o
Copy link

daer-o commented Jun 20, 2024

Hi everyone, here's an internal build that you could try: Docker.dmg We believe it fixes your issues. I would be happy to find out if it does.

This solved my problem completely. No more JVM Seg Fault. Yay. It is slightly slower it seems than before, but it works, which is better than the alternative!

Has anyone tried out the developer beta for macOS Sequoia yet? What were your results regarding this issue?
@elmnic

According to MacRumors, Docker Desktop's Rosetta integration is completely broken in Sequoia. The build in this thread may fix that. Grain of salt.

@vasuarv
Copy link

vasuarv commented Jun 20, 2024 via email

@cjbeatty
Copy link

@dgageot Any ideas on the ETA for this in GA?

@MichaelrMentele
Copy link

This is interesting, I was on Sonoma 14.5 and upgraded to 4.31.1 and no I cannot start docker at all on my M2. I'm not sure what version of docker I was running before.

@trmartinscwx
Copy link

trmartinscwx commented Jun 26, 2024

Hi everyone, here's an internal build that you could try: Docker.dmg We believe it fixes your issues. I would be happy to find out if it does.

@dgageot tried unpacking and installing the linked release. Now Docker Desktop won't start. Restarted my mac and reinstalled multiple times. When booting up 'Docker Desktop' it gets stuck on the initial loading screen. 'Starting Docker Engine' or similar. I'm installing the standard release now and hoping it will boot up.

EDIT: reinstalling the current base release worked fine.

EDIT2: After installing the standard release, removing it, and then installing the relase you mentioend in your post, Docker was able to start. However like others mentioned, all saved images are lost.

EDIT3: Currently on the release provided in this thread. Unable to run any containers or build any images. On Docker Desktop it only displays 'An error occurred while loading the images list'.

@tiarebalbi
Copy link

Hi everyone, here's an internal build that you could try: Docker.dmg We believe it fixes your issues. I would be happy to find out if it does.

Fixed for me here

@tiarebalbi
Copy link

Any idea of when this fix will be available in the stable package?

@dgageot
Copy link
Member

dgageot commented Jul 1, 2024

Docker Desktop 4.32 should be out early this week.

@lorenrh
Copy link
Member

lorenrh commented Jul 5, 2024

A fix has been issued for this in the latest Docker Desktop 4.32.0, see https://docs.docker.com/desktop/release-notes/

If the issue persists, don't hesitate to reach out!

@lorenrh lorenrh closed this as completed Jul 5, 2024
@iilyak
Copy link

iilyak commented Jul 9, 2024

Docker Desktop 4.32 should be out early this week.

This bug seem to affect me as well on lima without docker desktop. Do you have any pointers on what has been updated to fix the issue.

@dalmarcogd
Copy link

The latest version(4.32) solved the issue.

@chuvincent
Copy link

If the issue persists, don't hesitate to reach out!

The issue still persist after upgrading to 4.32 with the same callstack.

@mgazanayi
Copy link

Got the same error after Sonoma upgrade on Mac M2 Max 32Gb, solved by updating Docker desktop to 4.32.0 (157355)

@nhoover
Copy link

nhoover commented Jul 22, 2024

4.32 also fixed my issues on Mac M3 Max

@ccykevin
Copy link

A fix has been issued for this in the latest Docker Desktop 4.32.0, see https://docs.docker.com/desktop/release-notes/

If the issue persists, don't hesitate to reach out!

Seems don't solve yet
docker run -e 'ACCEPT_EULA=Y' -e 'MSSQL_SA_PASSWORD=<YourPassword123456!>' --name sql_server --platform linux/amd64 -p 1433:1433 -d https://mcr.microsoft.com/mssql/server:2022-latest
after few minutes error code 139 will appear

@Imatgay
Copy link

Imatgay commented Aug 14, 2024

4.32 also fixed my issues on Mac M3 Max

Yes, it worked great for me too!

@iilyak
Copy link

iilyak commented Aug 14, 2024

Docker Desktop 4.32 should be out early this week.

This bug seem to affect me as well on lima without docker desktop. Do you have any pointers on what has been updated to fix the issue.

Any pointers?

@anderssonq
Copy link

4.32 also fixed my issues on Mac M3 Max

Me 2!!!!! Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests