Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature(BaseMonitorSet): Implement monitoring template #9855

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

k0machi
Copy link
Contributor

@k0machi k0machi commented Jan 20, 2025

This commit adds a new templating mechanism for monitoring dashboards,
allowing SCT to be in sync with changes in scylla-monitoring repo, by
first separating SCT metrics into a separate file, and then injecting
them into the overview template on the monitoring node, then
regenerating said template. This allows monitoring dashboard to always
be up to date with regards to changes on the monitoring side.

Fixes scylladb/qa-tasks#1444

Testing

PR pre-checks (self review)

  • I added the relevant backport labels
  • I didn't leave commented-out/debugging code

Reminders

  • Add New configuration option and document them (in sdcm/sct_config.py)
  • Add unit tests to cover my changes (under unit-test/ folder)
  • Update the Readme/doc folder relevant to this change (if needed)

@k0machi k0machi self-assigned this Jan 20, 2025
@k0machi k0machi added the backport/none Backport is not required label Jan 20, 2025
@k0machi k0machi force-pushed the monitoring-improved-dash-logic branch 4 times, most recently from 5f70e7b to 9b4018c Compare January 20, 2025 11:58
@k0machi k0machi marked this pull request as ready for review January 20, 2025 12:01
@k0machi
Copy link
Contributor Author

k0machi commented Jan 20, 2025

Demo:

image

One more thing that's missing are previously available template variables for event filtering - I'll add them soon.

@k0machi k0machi requested review from fruch and soyacz January 20, 2025 12:02
@fruch fruch added test-provision-aws Run provision test on AWS test-provision-docker labels Jan 21, 2025
@scylladbbot
Copy link

@k0machi new branch branch-2025.1 was added, please add backport label if needed

@k0machi k0machi force-pushed the monitoring-improved-dash-logic branch 6 times, most recently from 448e001 to a6f5dac Compare January 28, 2025 11:17
@k0machi
Copy link
Contributor Author

k0machi commented Jan 28, 2025

Added annotations, template variables for event types, added logic to change default values (currently just hardcoded to change the by var, open for suggestions on the format if we want something more generic), re-arranged widgets to be more in line with the previous dash.

@k0machi
Copy link
Contributor Author

k0machi commented Jan 28, 2025

This run has the updated dashboard, monitoring node is set to keep so will be alive for now.

This commit adds a new templating mechanism for monitoring dashboards,
allowing SCT to be in sync with changes in scylla-monitoring repo, by
first separating SCT metrics into a separate file, and then injecting
them into the overview template on the monitoring node, then
regenerating said template. This allows monitoring dashboard to always
be up to date with regards to changes on the monitoring side.

Fixes scylladb/qa-tasks#1444
@k0machi k0machi force-pushed the monitoring-improved-dash-logic branch from a6f5dac to 9eeebf4 Compare January 28, 2025 13:12
@soyacz
Copy link
Contributor

soyacz commented Jan 29, 2025

requests served per instance shows whole numbers (like 30000 instead of 30k) and miss unit (ops/s)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport/none Backport is not required test-provision-aws Run provision test on AWS test-provision-docker
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants