Skip to content

Cannot find storm consumers and kafka consumers #779

@ShainyJain91

Description

@ShainyJain91

Hi,

We were trying to use Burrow tool for monitoring lags in our storm and Kafka consumers.
However we do not see any storm consumers returned via API. Also not all Kafka consumers are returned.Can someone help to figure out the issue.

Below is the config we are using:

[general]
pidfile="burrow.pid"
stdout-logfile="burrow.out"
access-control-allow-origin="*"

[logging]
filename="logs/burrow.log"
level="info"
maxsize=100
maxbackups=30
maxage=10
use-localtime=false
use-compression=true

[zookeeper]
servers=["localhost:2181" ]
timeout=6 #expiration timeout for zookeeper sessions.
root-path="/kafka" #full path to zookeeper node that burrow will be allowed to write into.

[client-profile.myclient]
client-id="burrow-myclient"
kafka-version="0.10.1"

[cluster.local]
class-name="kafka"
servers=[ "localhost:6667" ]
client-profile="myclient" #profile name defined as in client profile subheading.
topic-refresh=10
offset-refresh=10

[consumer.local]
class-name="kafka"
cluster="local" # sub heading name defined in above cluster configuration
servers=[ "localhost:6667" ]
client-profile="myclient"

[consumer.local_zk]
class-name="kafka_zk"
cluster="local"
servers=["localhost:2181" ]
zookeeper-timeout=30
zookeeper-path=""
zookeeper-offsets=true

[httpserver.mylistener]
address=":8080"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions