Kafbat is not working with Kraft mode cluster

[senthil13]

Hi Experts,

The kafbat is not working with cluster those are running in Kraft mode a.k.a no zookeeper mode. It's showing the broker details, but when I click on topics its hour glasing and not showing details..

error logs

2024-07-31 11:16:05,102 INFO  [kafka-admin-client-thread | kafbat-ui-admin-1722438899-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafbat-ui-admin-1722438899-1] Retrying to fetch metadata.
2024-07-31 11:16:05,103 INFO  [kafka-admin-client-thread | kafbat-ui-admin-1722438899-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafbat-ui-admin-1722438899-1] Retrying to fetch metadata.
2024-07-31 11:16:05,104 INFO  [kafka-admin-client-thread | kafbat-ui-admin-1722438899-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafbat-ui-admin-1722438899-1] Retrying to fetch metadata.
2024-07-31 11:16:05,105 INFO  [kafka-admin-client-thread | kafbat-ui-admin-1722438899-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafbat-ui-admin-1722438899-1] Retrying to fetch metadata.
2024-07-31 11:16:05,106 INFO  [kafka-admin-client-thread | kafbat-ui-admin-1722438899-1] o.a.k.c.u.AppInfoParser: App info kafka.admin.client for kafbat-ui-admin-1722438899-1 unregistered
2024-07-31 11:16:05,110 ERROR [parallel-6] o.s.b.a.w.r.e.AbstractErrorWebExceptionHandler: [1fb498b7-42]  500 Server Error for HTTP GET "/api/clusters/local/topics?page=1&perPage=25&showInternal=true"
org.apache.kafka.common.errors.TimeoutException: The AdminClient thread is not accepting new calls.
        Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException:
Error has been observed at the following site(s):
        *__checkpoint ⇢ Handler io.kafbat.ui.controller.TopicsController#getTopics(String, Integer, Integer, Boolean, String, TopicColumnsToSortDTO, SortOrderDTO, ServerWebExchange) [DispatcherHandler]
        *__checkpoint ⇢ io.kafbat.ui.config.CorsGlobalConfiguration$$Lambda$869/0x00007f7bc05cd2d0 [DefaultWebFilterChain]
        *__checkpoint ⇢ io.kafbat.ui.config.CustomWebFilter [DefaultWebFilterChain]
        *__checkpoint ⇢ io.kafbat.ui.config.ReadOnlyModeFilter [DefaultWebFilterChain]
        *__checkpoint ⇢ AuthorizationWebFilter [DefaultWebFilterChain]
        *__checkpoint ⇢ ExceptionTranslationWebFilter [DefaultWebFilterChain]
        *__checkpoint ⇢ LogoutWebFilter [DefaultWebFilterChain]

Any help on this will be much appriciated.

Thanks ~ Senthil

[Haarolean]

• which msk version are you on?
• does it happen right on start?

[senthil13]

Thanks for the response.

Kafka version : 7.7.0
Type: Confluent community
Kafbat version: kafbat-ui-v1.0.0.jar
Running on : on-perm vm
OS: OEL 8

Issue happens, When I click on the topics on the UI. Broker details are showing fine. only when I click on topics its happening, that too in Kraft mode only. not in zookeeper mode.

Thanks
Senthil.

[Haarolean]

confluent 7.7 is kafka 3.7.
I'm running this compose with the following changes in order to upgrade from 7.2.1 to 7.7.0:

Subject: [PATCH] confluent 7.7
---
Index: .dev/dev_arm64.yaml
IDEA additional info:
Subsystem: com.intellij.openapi.diff.impl.patch.CharsetEP
<+>UTF-8
===================================================================
diff --git a/.dev/dev_arm64.yaml b/.dev/dev_arm64.yaml
--- a/.dev/dev_arm64.yaml	(revision 4de0d5330d0c615e70fd9693bba265e6536029e9)
+++ b/.dev/dev_arm64.yaml	(date 1722533490003)
@@ -11,7 +11,7 @@
 
   kafbat-ui:
     container_name: kafbat-ui
-    image: ghcr.io/kafbat/kafka-ui:latest
+    image: ghcr.io/kafbat/kafka-ui:main
     ports:
       - 8080:8080
     depends_on:
@@ -32,7 +32,8 @@
       KAFKA_CLUSTERS_0_AUDIT_CONSOLEAUDITENABLED: 'true'
 
   kafka0:
-    image: confluentinc/cp-kafka:7.2.1.arm64
+    image: confluentinc/cp-kafka:7.7.0.arm64
+    user: "0:0"
     hostname: kafka0
     container_name: kafka0
     ports:
@@ -49,6 +50,7 @@
       KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
       KAFKA_PROCESS_ROLES: 'broker,controller'
       KAFKA_NODE_ID: 1
+      CLUSTER_ID: 'MkU3OEVBNTcwNTJENDM2Qk'
       KAFKA_CONTROLLER_QUORUM_VOTERS: '1@kafka0:29093'
       KAFKA_LISTENERS: 'PLAINTEXT://kafka0:29092,CONTROLLER://kafka0:29093,PLAINTEXT_HOST://0.0.0.0:9092'
       KAFKA_CONTROLLER_LISTENER_NAMES: 'CONTROLLER'
@@ -56,9 +58,9 @@
       KAFKA_JMX_PORT: 9997
 #      KAFKA_JMX_HOSTNAME: localhost # uncomment this line and comment the next one if running with kafka-ui as a jar
       KAFKA_JMX_OPTS: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djava.rmi.server.hostname=kafka0 -Dcom.sun.management.jmxremote.rmi.port=9997
-    volumes:
-      - ../documentation/compose/scripts/update_run.sh:/tmp/update_run.sh
-    command: "bash -c 'if [ ! -f /tmp/update_run.sh ]; then echo \"ERROR: Did you forget the update_run.sh file that came with this docker-compose.yml file?\" && exit 1 ; else /tmp/update_run.sh && /etc/confluent/docker/run ; fi'"
+#    volumes:
+#      - ../documentation/compose/scripts/update_run.sh:/tmp/update_run.sh
+#    command: "bash -c 'if [ ! -f /tmp/update_run.sh ]; then echo \"ERROR: Did you forget the update_run.sh file that came with this docker-compose.yml file?\" && exit 1 ; else /tmp/update_run.sh && /etc/confluent/docker/run ; fi'"
 
   schema-registry0:
     image: confluentinc/cp-schema-registry:7.2.1.arm64

Works fine for me, I'm able to see brokers and topics, consume and produce messages.

We'd need a minimal reproducible example to reproduce the issue.

[senthil13]

Thanks for the reply.
I am not sure what caused the issue, Since this is a new environment, I cleared, removed all, and re-installed Kafka + Controller. Now, with the same install files, it is working fine. I am not sure what caused the issue.

Thanks ~ Senthil