Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add extra sentry metrics tagged with repoid #528

Merged
merged 2 commits into from
Jul 2, 2024

Conversation

joseph-sentry
Copy link
Contributor

No description provided.

Signed-off-by: joseph-sentry <joseph.sawaya@sentry.io>
@joseph-sentry joseph-sentry marked this pull request as ready for review June 27, 2024 19:25
@codecov-notifications
Copy link

codecov-notifications bot commented Jun 27, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

✅ All tests successful. No failed tests found.

Impacted file tree graph

@@           Coverage Diff            @@
##             main     #528    +/-   ##
========================================
  Coverage   97.47%   97.48%            
========================================
  Files         418      418            
  Lines       34900    35009   +109     
========================================
+ Hits        34020    34128   +108     
- Misses        880      881     +1     
Flag Coverage Δ
integration 97.48% <100.00%> (+<0.01%) ⬆️
latest-uploader-overall 97.48% <100.00%> (+<0.01%) ⬆️
unit 97.48% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
NonTestCode 94.53% <100.00%> (+<0.01%) ⬆️
OutsideTasks 97.74% <ø> (+<0.01%) ⬆️
Files Coverage Δ
tasks/test_results_finisher.py 95.33% <100.00%> (+0.09%) ⬆️

... and 10 files with indirect coverage changes

@codecov-qa
Copy link

codecov-qa bot commented Jun 27, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.48%. Comparing base (6b8726c) to head (1340daf).
Report is 2 commits behind head on main.

✅ All tests successful. No failed tests found.

Impacted file tree graph

@@           Coverage Diff            @@
##             main     #528    +/-   ##
========================================
  Coverage   97.47%   97.48%            
========================================
  Files         418      418            
  Lines       34900    35009   +109     
========================================
+ Hits        34020    34128   +108     
- Misses        880      881     +1     
Flag Coverage Δ
integration 97.48% <100.00%> (+<0.01%) ⬆️
latest-uploader-overall 97.48% <100.00%> (+<0.01%) ⬆️
unit 97.48% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
NonTestCode 94.53% <100.00%> (+<0.01%) ⬆️
OutsideTasks 97.74% <ø> (+<0.01%) ⬆️
Files Coverage Δ
tasks/test_results_finisher.py 95.33% <100.00%> (+0.09%) ⬆️

... and 10 files with indirect coverage changes

Copy link

codecov-public-qa bot commented Jun 27, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.48%. Comparing base (6b8726c) to head (1340daf).
Report is 2 commits behind head on main.

✅ All tests successful. No failed tests found ☺️

Impacted file tree graph

@@           Coverage Diff            @@
##             main     #528    +/-   ##
========================================
  Coverage   97.47%   97.48%            
========================================
  Files         418      418            
  Lines       34900    35009   +109     
========================================
+ Hits        34020    34128   +108     
- Misses        880      881     +1     
Flag Coverage Δ
integration 97.48% <100.00%> (+<0.01%) ⬆️
latest-uploader-overall 97.48% <100.00%> (+<0.01%) ⬆️
unit 97.48% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
NonTestCode 94.53% <100.00%> (+<0.01%) ⬆️
OutsideTasks 97.74% <ø> (+<0.01%) ⬆️
Files Coverage Δ
tasks/test_results_finisher.py 95.33% <100.00%> (+0.09%) ⬆️

... and 10 files with indirect coverage changes

Copy link

codecov bot commented Jun 27, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 97.60%. Comparing base (6b8726c) to head (1340daf).
Report is 2 commits behind head on main.

Changes have been made to critical files, which contain lines commonly executed in production. Learn more

✅ All tests successful. No failed tests found.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #528      +/-   ##
==========================================
+ Coverage   97.50%   97.60%   +0.09%     
==========================================
  Files         449      449              
  Lines       35623    37173    +1550     
==========================================
+ Hits        34733    36281    +1548     
- Misses        890      892       +2     
Flag Coverage Δ
integration 97.48% <100.00%> (+<0.01%) ⬆️
latest-uploader-overall 97.48% <100.00%> (+<0.01%) ⬆️
unit 97.48% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
NonTestCode 94.72% <100.00%> (+0.13%) ⬆️
OutsideTasks 97.74% <ø> (+<0.01%) ⬆️
Files Coverage Δ
tasks/test_results_finisher.py 96.00% <100.00%> (+0.08%) ⬆️

... and 10 files with indirect coverage changes

This change has been scanned for critical changes. Learn more

@joseph-sentry joseph-sentry requested a review from a team June 28, 2024 14:09
Copy link
Contributor

@michelletran-codecov michelletran-codecov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a question on removal criteria for the metrics and how long we're expecting to be collecting them.

@@ -140,6 +140,17 @@ def process_impl_within_lock(
checkpoints = checkpoints_from_kwargs(TestResultsFlow, kwargs)

checkpoints.log(TestResultsFlow.TEST_RESULTS_FINISHER_BEGIN)

# TODO: remove this later, we can do this now because there aren't many users using this
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you have more details about when we should remove this? Should we have a ticket to remind ourselves?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it depends on the number of unique repos that end up triggering the metrics, the reason we don't want to keep emitting these metrics with the repo tag for too long is because as we get more and more unique repos using this feature the higher the cardinality of the metric will be. At some point it seems the tags will be automatically dropped if their cardinality is too high so this metric will be obsoleted anyways, so we can drop it then.

@joseph-sentry joseph-sentry added this pull request to the merge queue Jul 2, 2024
Merged via the queue into main with commit eb83557 Jul 2, 2024
29 of 30 checks passed
@joseph-sentry joseph-sentry deleted the joseph/extra-test-results-metrics branch July 2, 2024 15:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants