Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Broker] Expose topic level storage write and read rate metrics #16855

Conversation

michaeljmarshall
Copy link
Member

Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

Modifications

  • Expose pulsar_storage_read_rate and pulsar_storage_write_rate in topic level metrics

Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

Documentation

  • doc-not-needed

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.

@michaeljmarshall michaeljmarshall added type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages area/broker area/metrics release/2.8.4 release/2.10.2 release/2.9.4 labels Jul 28, 2022
@michaeljmarshall michaeljmarshall added this to the 2.11.0 milestone Jul 28, 2022
@michaeljmarshall michaeljmarshall self-assigned this Jul 28, 2022
@michaeljmarshall michaeljmarshall added doc-not-needed Your PR changes do not impact docs and removed doc-label-missing labels Jul 28, 2022
@apache apache deleted a comment from github-actions bot Jul 28, 2022
Copy link
Contributor

@dlg99 dlg99 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@michaeljmarshall michaeljmarshall merged commit 23b52e4 into apache:master Jul 28, 2022
@michaeljmarshall michaeljmarshall deleted the add-missed-stats-to-topic-stats branch July 28, 2022 21:43
michaeljmarshall added a commit that referenced this pull request Jul 28, 2022
### Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

### Modifications

* Expose `pulsar_storage_read_rate` and `pulsar_storage_write_rate` in topic level metrics

### Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

### Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

### Documentation

- [x] `doc-not-needed`

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.

(cherry picked from commit 23b52e4)
michaeljmarshall added a commit that referenced this pull request Jul 28, 2022
### Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

### Modifications

* Expose `pulsar_storage_read_rate` and `pulsar_storage_write_rate` in topic level metrics

### Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

### Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

### Documentation

- [x] `doc-not-needed`

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.

(cherry picked from commit 23b52e4)
michaeljmarshall added a commit that referenced this pull request Jul 28, 2022
### Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

### Modifications

* Expose `pulsar_storage_read_rate` and `pulsar_storage_write_rate` in topic level metrics

### Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

### Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

### Documentation

- [x] `doc-not-needed`

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.

(cherry picked from commit 23b52e4)
michaeljmarshall added a commit to datastax/pulsar that referenced this pull request Jul 28, 2022
…he#16855)

### Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

### Modifications

* Expose `pulsar_storage_read_rate` and `pulsar_storage_write_rate` in topic level metrics

### Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

### Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

### Documentation

- [x] `doc-not-needed`

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.

(cherry picked from commit 23b52e4)
michaeljmarshall added a commit to datastax/pulsar that referenced this pull request Jul 28, 2022
…he#16855)

### Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

### Modifications

* Expose `pulsar_storage_read_rate` and `pulsar_storage_write_rate` in topic level metrics

### Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

### Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

### Documentation

- [x] `doc-not-needed`

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.

(cherry picked from commit 23b52e4)
Gleiphir2769 pushed a commit to Gleiphir2769/pulsar that referenced this pull request Aug 4, 2022
…he#16855)

### Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

### Modifications

* Expose `pulsar_storage_read_rate` and `pulsar_storage_write_rate` in topic level metrics

### Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

### Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

### Documentation

- [x] `doc-not-needed` 

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.
dragonls pushed a commit to dragonls/pulsar that referenced this pull request Oct 21, 2022
…he#16855)

### Motivation

We collect metrics on storage read/write rate, but we do not expose it at the topic level. We already expose it at the namespace level.

### Modifications

* Expose `pulsar_storage_read_rate` and `pulsar_storage_write_rate` in topic level metrics

### Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

### Does this pull request potentially affect one of the following parts:

This change adds two new metrics.

### Documentation

- [x] `doc-not-needed`

These two metrics are already documented for topic level stats: https://pulsar.apache.org/docs/next/reference-metrics.

(cherry picked from commit 23b52e4)
dragonls pushed a commit to dragonls/pulsar that referenced this pull request Oct 21, 2022
…rge request !49)

[Broker] Expose topic level storage write and read rate metrics (apache#16855)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/broker area/metrics cherry-picked/branch-2.8 Archived: 2.8 is end of life cherry-picked/branch-2.9 Archived: 2.9 is end of life cherry-picked/branch-2.10 doc-not-needed Your PR changes do not impact docs release/2.8.4 release/2.9.4 release/2.10.2 type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants