Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Overview dashboard's "Manager" billboard says "Online Online" when scylla_manager_servers.yml has the new port #1121

Closed
ziggythehamster opened this issue Nov 10, 2020 · 4 comments
Labels
bug Something isn't working right

Comments

@ziggythehamster
Copy link

ziggythehamster commented Nov 10, 2020

In Scylla Monitoring 3.5, due to the change introduced in #1014, if you have the new port configured, you end up with two jobs, scylla_manager and scylla_manager1. They both report the same thing because they both point at :5090. The query doesn't do any aggregation or filtering to prevent this from displaying:

image

@ziggythehamster ziggythehamster added the bug Something isn't working right label Nov 10, 2020
@ziggythehamster
Copy link
Author

Changing the query to this seems to fix it:

(1+sum(scylla_manager_task_active_count{type=~"repair",cluster=~"$cluster|$^"}) + sum(scylla_manager_task_active_count{type=~"backup",cluster=~"$cluster|$^"}) * 2) or (1+max(scylla_manager_server_current_version))

But I have no experience with grafana to know if that's really the right thing to do here or not. The regex anchors being backwards is also super odd to me, but maybe it's supposed to be that way

@amnonh
Copy link
Collaborator

amnonh commented Nov 10, 2020

Should be fixed by #1118

@amnonh
Copy link
Collaborator

amnonh commented Nov 10, 2020

Closing as duplicate of #1109 and the fix in #1118 re-open if you are still seeing issues after those fixes

@amnonh amnonh closed this as completed Nov 10, 2020
@ziggythehamster
Copy link
Author

This happens with #1118's patch applied. If you look at this comment, you would be able to see the query being used is the one from #1118.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working right
Projects
None yet
Development

No branches or pull requests

2 participants