Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(1173): Record wait time for all reducers #1174

Merged
merged 1 commit into from
Apr 29, 2024

Conversation

joshua-spacetime
Copy link
Collaborator

Fixes #1173.

Previously we were only recording this metric for scheduled reducers. We were also recording it before we acquired access to the module instance. Now we record it for all reducers after we acquire access to the module instance.

This patch also removes max wait time since the histogram should suffice.

Description of Changes

Please describe your change, mention any related tickets, and so on here.

API and ABI breaking changes

If this is an API or ABI breaking change, please apply the
corresponding GitHub label.

Expected complexity level and risk

How complicated do you think these changes are? Grade on a scale from 1 to 5,
where 1 is a trivial change, and 5 is a deep-reaching and complex change.

This complexity rating applies not only to the complexity apparent in the diff,
but also to its interactions with existing and future code.

If you answered more than a 2, explain what is complex about the PR,
and what other components it interacts with in potentially concerning ways.

Testing

Describe any testing you've done, and any testing you'd like your reviewers to do,
so that you're confident that all the changes work as expected!

  • Write a test you've completed here.
  • Write a test you want a reviewer to do here, so they can check it off when they're satisfied.

Comment on lines +646 to +651
// Record the time spent waiting in the queue
let _guard = WORKER_METRICS
.reducer_wait_time
.with_label_values(&self.info.address, reducer)
.start_timer();
self.inner.get_instance(self.info.address).await?
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@coolreader18 do you agree that this is the correct place to be recording this metric? And that this works for all reducers?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for all reducers and for other such calls. but yeah, this seems right.

Comment on lines +646 to +651
// Record the time spent waiting in the queue
let _guard = WORKER_METRICS
.reducer_wait_time
.with_label_values(&self.info.address, reducer)
.start_timer();
self.inner.get_instance(self.info.address).await?
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for all reducers and for other such calls. but yeah, this seems right.

@bfops bfops added the release-any To be landed in any release window label Apr 29, 2024
Base automatically changed from joshua/fix/1170/reducer-queue-length to master April 29, 2024 20:57
Fixes #1173.

Previously we were only recording this metric for scheduled reducers.
We were also recording it before we acquired access to the module instance.
Now we record it for all reducers after we acquire access to the module instance.

This patch also removes max wait time since the histogram should suffice.
@joshua-spacetime joshua-spacetime force-pushed the joshua/fix/1173/reducer-wait-time branch from 1847871 to 3df2a53 Compare April 29, 2024 20:58
@joshua-spacetime joshua-spacetime added this pull request to the merge queue Apr 29, 2024
Merged via the queue into master with commit ac647a0 Apr 29, 2024
6 checks passed
@joshua-spacetime joshua-spacetime deleted the joshua/fix/1173/reducer-wait-time branch April 29, 2024 23:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-any To be landed in any release window
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants