Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Burrow for consumer lag monitoring #125

Merged
merged 10 commits into from
Jan 31, 2018
Merged

Add Burrow for consumer lag monitoring #125

merged 10 commits into from
Jan 31, 2018

Conversation

solsson
Copy link
Contributor

@solsson solsson commented Jan 17, 2018

It's a quite useful REST API, but I will try to add Prometheus scrape support (pending linkedin/Burrow#318).

@solsson
Copy link
Contributor Author

solsson commented Jan 17, 2018

There's no service now, so to test run kubectl port-forward 8000:8000 and curl for example http://localhost:8000/v3/kafka/local/consumer
Use 8080:8080 for metrics, with http://localhost:8080/metrics

@solsson
Copy link
Contributor Author

solsson commented Jan 31, 2018

We've found Burrow truly useful. It's lightweight, fast and in addition to crucial metrics it provides quick access to for example topic listings, e.g. (from inside your cluster) curl -s http://burrow.kafka/v3/kafka/local/topic | jq -r ".topics|.[]" and consumer listings curl -s http://burrow.kafka:8000/v3/kafka/local/consumer | jq -r ".consumers|.[]".

With Prometheus, this PRs title is realized with the metric kafka_burrow_partition_lag and its labels topic and group.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant