Skip to content

Comments

workload: add support for exporting histogram file in openmetrics format#129221

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
sambhav-jain-16:CRDB-41457
Oct 4, 2024
Merged

workload: add support for exporting histogram file in openmetrics format#129221
craig[bot] merged 1 commit intocockroachdb:masterfrom
sambhav-jain-16:CRDB-41457

Conversation

@sambhav-jain-16
Copy link
Contributor

@sambhav-jain-16 sambhav-jain-16 commented Aug 19, 2024

The workload binary use --histogram flag to export hdr histograms
into a json file which is then used by roachperf to create a
dashboard.

In efforts of deprecating roachperf altogether, we need to move to
openmetrics so that the metrics can be ingested into any sink that
supports openmetrics (prometheus etc). This change adds a new flag
--histogram-export-format which allows the user to choose to export in
either json or openmetrics format. Also --openmetrics-labels
flag is added so that appropriate labels can be added for the
openmetrics exporter

This change makes use of expfmt.MetricFamilyToOpenMetrics function
which is provided by prometheus library.

Epic: none

Release note: None

Part of: #106662

@cockroach-teamcity
Copy link
Member

This change is Reviewable

@sambhav-jain-16 sambhav-jain-16 force-pushed the CRDB-41457 branch 3 times, most recently from 61e7485 to 45f8dfa Compare August 19, 2024 11:15
@sambhav-jain-16 sambhav-jain-16 force-pushed the CRDB-41457 branch 3 times, most recently from d7e0f20 to 95095ba Compare August 27, 2024 07:48
@sambhav-jain-16 sambhav-jain-16 marked this pull request as ready for review August 27, 2024 07:51
@sambhav-jain-16 sambhav-jain-16 requested a review from a team as a code owner August 27, 2024 07:51
@sambhav-jain-16 sambhav-jain-16 requested review from a team, csgourav, nameisbhaskar and srosenberg and removed request for a team August 27, 2024 07:51
@sambhav-jain-16 sambhav-jain-16 force-pushed the CRDB-41457 branch 5 times, most recently from ffcd095 to d5ae901 Compare August 27, 2024 08:53
@sambhav-jain-16
Copy link
Contributor Author

sambhav-jain-16 commented Aug 27, 2024

Example of the metrics emitted as shown in grafana

Screenshot 2024-09-24 at 4 23 12 PM

@sambhav-jain-16 sambhav-jain-16 force-pushed the CRDB-41457 branch 6 times, most recently from c40a6db to 2b8dd22 Compare August 30, 2024 11:20
@sambhav-jain-16 sambhav-jain-16 force-pushed the CRDB-41457 branch 2 times, most recently from 71ffeef to dfb02ee Compare September 2, 2024 04:51
sambhav-jain-16 added a commit to sambhav-jain-16/cockroach that referenced this pull request Nov 15, 2024
cockroachdb#129221 and
cockroachdb#132023 added changes to
exporters to emit openmetrics. This PR makes changes to the roachtests
to make use of the changes in the above PRs. This change also made some
changes to some roachtests that use neither of the above approaches

Epic: https://cockroachlabs.atlassian.net/browse/CRDB-41852

Release note: None
craig bot pushed a commit that referenced this pull request Nov 15, 2024
133035: roachtest: add code changes to benchmarks to emit openmetrics r=nameisbhaskar,DarrylWong a=sambhav-jain-16

#129221 and #132023 added changes to
exporters to emit openmetrics. This PR makes changes to the roachtests
to make use of the changes in the above PRs. This change also made some
changes to some roachtests that use neither of the above approaches

Epic: https://cockroachlabs.atlassian.net/browse/CRDB-41852

Release note: None

Co-authored-by: Sambhav Jain <sambhav.jain@cockroachlabs.com>
sambhav-jain-16 added a commit to sambhav-jain-16/cockroach that referenced this pull request Nov 19, 2024
cockroachdb#129221 and
cockroachdb#132023 added changes to
exporters to emit openmetrics. This PR makes changes to the roachtests
to make use of the changes in the above PRs. This change also made some
changes to some roachtests that use neither of the above approaches

Epic: https://cockroachlabs.atlassian.net/browse/CRDB-41852

Release note: None
sambhav-jain-16 added a commit to sambhav-jain-16/cockroach that referenced this pull request Nov 19, 2024
cockroachdb#129221 and
cockroachdb#132023 added changes to
exporters to emit openmetrics. This PR makes changes to the roachtests
to make use of the changes in the above PRs. This change also made some
changes to some roachtests that use neither of the above approaches

Epic: https://cockroachlabs.atlassian.net/browse/CRDB-41852

Release note: None
sambhav-jain-16 added a commit to sambhav-jain-16/cockroach that referenced this pull request Nov 26, 2024
cockroachdb#129221 and
cockroachdb#132023 added changes to
exporters to emit openmetrics. This PR makes changes to the roachtests
to make use of the changes in the above PRs. This change also made some
changes to some roachtests that use neither of the above approaches

Epic: https://cockroachlabs.atlassian.net/browse/CRDB-41852

Release note: None
sambhav-jain-16 added a commit to sambhav-jain-16/cockroach that referenced this pull request Nov 26, 2024
cockroachdb#129221 and
cockroachdb#132023 added changes to
exporters to emit openmetrics. This PR makes changes to the roachtests
to make use of the changes in the above PRs. This change also made some
changes to some roachtests that use neither of the above approaches

Epic: https://cockroachlabs.atlassian.net/browse/CRDB-41852

Release note: None
@sambhav-jain-16 sambhav-jain-16 deleted the CRDB-41457 branch August 29, 2025 12:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants