Support prometheus as a metrics interface

[siddarthsreeni]

This is more of a bug on the existing minimalistic dashboard. I am connected to AWS MSK and Currently I do not see any realtime production/consumption metrics under tab General. There is no error in the logs.

[germanosin]

Hi @siddarthsreeni, thank you for creating this issue. Could you please share your config? Please make sure to pass jmx address to collect metrics.

[siddarthsreeni]

@germanosin Thanks for the input, I am currently using Aws MSK & have enabled "Open Monitoring" Under which the port 11001 can be used by the JMX port. I tried like you suggested. I am getting the following errors when I add -e KAFKA_CLUSTERS_0_JMXPORT=11001

But I understand that this is "Open Monitoring" JMX port provides metrics from JMX, but it is Prometheus protocol. (Came here searching for whether Prometheus fetching had been added yet.) I was getting the following error

ERROR com.provectus.kafka.ui.util.JmxClusterUtil - Cannot invalidate object in pool, service:jmx:rmi:///jndi/rmi://xxx.xxxx.xxxx.kafka.us-east-1.amazonaws.com:11001/jmxrmi
       java.net.SocketTimeoutException: Read timed out]
        at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:370) ~[?:?]
        at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:270) ~[?:?]
        at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:229) ~[?:?]
        at com.provectus.kafka.ui.util.JmxPoolFactory.create(JmxPoolFactory.java:17) ~[classes!/:?]
        at com.provectus.kafka.ui.util.JmxPoolFactory.create(JmxPoolFactory.java:12) ~[classes!/:?]
        at org.apache.commons.pool2.BaseKeyedPooledObjectFactory.makeObject(BaseKeyedPooledObjectFactory.ja

Please not, In my configuration I have 2 different kafka cluster specificied, out of which I'm only looking forward to monitoring one of them (which is in MSK)

[Haarolean]

hey @siddarthsreeni, sorry for the delay, somehow this issue mired in the abyss for some time 😅 I'll investigate the problem and will get back to you.

[Haarolean]

Turns out there's no more JMX for MSK, there was one previously but they probably disabled. We'll have to implement prometheus support for such things.

[Haarolean]

@MaratGumarov please note that there's a branch issues/442