Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added possibility to report histograms as single-counter as well as multiple-counters in TRequestCounters::TStatCounters #2007

Merged
merged 6 commits into from
Oct 15, 2024

Conversation

dvrazumov
Copy link
Collaborator

@dvrazumov dvrazumov commented Sep 11, 2024

This pull request adds options to report histograms as either single or multiple counters, providing more flexibility in how monitoring data is collected and reported. Single historgram counter with "le" label makes it possible to calculate quantiles in Grafana monitoring system.

There are a several places in project that report histograms, this PR changes only some of them (specifically THistBase class).

The main changes:

  • Added new configuration options ReportHistogramAsMultipleCounters and ReportHistogramAsSingleCounter to the diagnostics configuration files (diagnostics.proto) and support them in NBS and Filestore
  • Updated the THistBase, TRequestCounters and other related classes to handle the new histogram counter options
  • Added unit tests to verify the new histogram reporting functionality

THistBase is used by TRequestCounters:

TRequestCounters
  TRequestCounters::TStatCounters
    TTimeHist : public THistBase
    TSizeHist : public THistBase

TRequestCounters is used by TVolumeStats and TRequestStats

TVolumeStats
  TVolumeInfo
    TRequestCounters
TRequestStats
  TRequestCounters  

Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🔴 linux-x86_64-relwithdebinfo: some tests FAILED for commit 456c609.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5585 5581 0 4 0 0

Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit 319d200.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5730 5727 0 0 1 2

@dvrazumov dvrazumov force-pushed the users/dvrazumov/single-counter-for-histograms branch from 319d200 to 774a8a8 Compare October 4, 2024 16:20
Copy link
Contributor

github-actions bot commented Oct 4, 2024

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit 774a8a8.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5858 5858 0 0 0 0

@dvrazumov dvrazumov force-pushed the users/dvrazumov/single-counter-for-histograms branch from 774a8a8 to 6b6ad95 Compare October 7, 2024 10:01
Copy link
Contributor

github-actions bot commented Oct 7, 2024

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit 6b6ad95.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5867 5867 0 0 0 0

@dvrazumov dvrazumov marked this pull request as ready for review October 8, 2024 10:40
Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit f8abf52.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
5867 5867 0 0 0 0

@dvrazumov dvrazumov merged commit b40f95d into main Oct 15, 2024
11 of 12 checks passed
@dvrazumov dvrazumov deleted the users/dvrazumov/single-counter-for-histograms branch October 15, 2024 08:45
dvrazumov added a commit that referenced this pull request Oct 15, 2024
…ultiple-counters in TRequestCounters::TStatCounters (#2007)

* Added possibility to report histograms as single-counter as well as multiple-counters in TRequestCounters::TStatCounters
* Add some tests
* review fixes

---------

Co-authored-by: Dmitry Razumov <dvrazumov@yandex-team.ru>
dvrazumov added a commit that referenced this pull request Oct 15, 2024
…ultiple-counters in TRequestCounters::TStatCounters (#2007) (#2279)

* Added possibility to report histograms as single-counter as well as multiple-counters in TRequestCounters::TStatCounters
* Add some tests
* review fixes

---------

Co-authored-by: Dmitry Razumov <dvrazumov@yandex-team.ru>
WilyTiger pushed a commit that referenced this pull request Oct 16, 2024
…ultiple-counters in TRequestCounters::TStatCounters (#2007)

* Added possibility to report histograms as single-counter as well as multiple-counters in TRequestCounters::TStatCounters
* Add some tests
* review fixes

---------

Co-authored-by: Dmitry Razumov <dvrazumov@yandex-team.ru>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[NBS, Filestore] Support suitable for Grafana data format for histograms counters
3 participants