Skip to content
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.

Resource tracking for background processes #3553

Merged
merged 2 commits into from
Jul 18, 2018

Conversation

richvdh
Copy link
Member

@richvdh richvdh commented Jul 18, 2018

This introduces a mechanism for tracking resource usage by background processes, along with an example of how it will be used.

This will help address #3518, but more importantly will give us better insights into things which are happening but not being shown up by the request metrics.

We could do this with Measure blocks, but:

  • I think having them pulled out as a completely separate metric class will make it easier to distinguish top-level processes from those which are nested.

  • I want to be able to report on in-flight background processes, and I don't think we want to do this for all Measure blocks.

This introduces a mechanism for tracking resource usage by background
processes, along with an example of how it will be used.

This will help address #3518, but more importantly will give us better insights
into things which are happening but not being shown up by the request metrics.

We *could* do this with Measure blocks, but:
 - I think having them pulled out as a completely separate metric class will
   make it easier to distinguish top-level processes from those which are
   nested.

 - I want to be able to report on in-flight background processes, and I don't
   think we want to do this for *all* Measure blocks.
@richvdh richvdh requested a review from a team July 18, 2018 10:41
Copy link
Member

@erikjohnston erikjohnston left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, though I haven't looked deeply at the way you've interfaced with prometheus

@richvdh richvdh merged commit 65d6a0e into develop Jul 18, 2018
@richvdh richvdh deleted the rav/background_process_tracking branch July 18, 2018 13:28
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants