Skip to content

[ISSUE-169] Support metric reporter and Support promethues push gateway#415

Merged
roryqi merged 10 commits intoapache:masterfrom
xianjingfeng:issue_169
Dec 21, 2022
Merged

[ISSUE-169] Support metric reporter and Support promethues push gateway#415
roryqi merged 10 commits intoapache:masterfrom
xianjingfeng:issue_169

Conversation

@xianjingfeng
Copy link
Member

What changes were proposed in this pull request?

Support metric reporter and Support promethues push gateway

Why are the changes needed?

Users can implement custom export plugin to export metrics to their monitoring system. #169

Does this PR introduce any user-facing change?

No

How was this patch tested?

UT

# Conflicts:
#	coordinator/src/main/java/org/apache/uniffle/coordinator/CoordinatorServer.java
@xianjingfeng xianjingfeng changed the title [ISSUE-169] [WIP][ISSUE-169] Support metric reporter and Support promethues push gateway Dec 13, 2022
@codecov-commenter
Copy link

codecov-commenter commented Dec 13, 2022

Codecov Report

Merging #415 (2fce4f4) into master (66c752f) will increase coverage by 0.08%.
The diff coverage is 64.77%.

@@             Coverage Diff              @@
##             master     #415      +/-   ##
============================================
+ Coverage     58.54%   58.62%   +0.08%     
- Complexity     1611     1632      +21     
============================================
  Files           195      198       +3     
  Lines         11035    11130      +95     
  Branches        966      986      +20     
============================================
+ Hits           6460     6525      +65     
- Misses         4195     4218      +23     
- Partials        380      387       +7     
Impacted Files Coverage Δ
.../java/org/apache/uniffle/server/ShuffleServer.java 64.38% <12.50%> (-3.01%) ⬇️
.../apache/uniffle/coordinator/CoordinatorServer.java 61.46% <35.71%> (-3.80%) ⬇️
.../uniffle/common/metrics/MetricReporterFactory.java 57.14% <57.14%> (ø)
...rometheus/PrometheusPushGatewayMetricReporter.java 74.46% <74.46%> (ø)
.../org/apache/uniffle/common/config/RssBaseConf.java 93.82% <100.00%> (+0.19%) ⬆️
...uniffle/common/metrics/AbstractMetricReporter.java 100.00% <100.00%> (ø)
.../java/org/apache/uniffle/common/util/RssUtils.java 58.45% <0.00%> (-2.14%) ⬇️
...rg/apache/uniffle/client/util/DefaultIdHelper.java 100.00% <0.00%> (ø)
...org/apache/uniffle/storage/common/HdfsStorage.java 0.00% <0.00%> (ø)
...pache/hadoop/mapreduce/task/reduce/RssShuffle.java 0.00% <0.00%> (ø)
... and 13 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@roryqi roryqi linked an issue Dec 13, 2022 that may be closed by this pull request
@roryqi
Copy link
Contributor

roryqi commented Dec 15, 2022

Could we add some docs about this feature?

@xianjingfeng
Copy link
Member Author

Could we add some docs about this feature?

Yes

@roryqi
Copy link
Contributor

roryqi commented Dec 21, 2022

Is this pr ready for review?

@xianjingfeng xianjingfeng changed the title [WIP][ISSUE-169] Support metric reporter and Support promethues push gateway [ISSUE-169] Support metric reporter and Support promethues push gateway Dec 21, 2022
@xianjingfeng
Copy link
Member Author

Is this pr ready for review?

Yes

Copy link
Contributor

@roryqi roryqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, @advancedxy do you have another suggestion?

Copy link
Contributor

@advancedxy advancedxy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@roryqi roryqi merged commit 9635d7a into apache:master Dec 21, 2022
@roryqi
Copy link
Contributor

roryqi commented Dec 21, 2022

thanks @advancedxy @xianjingfeng

@xianjingfeng xianjingfeng deleted the issue_169 branch March 1, 2023 12:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Request] Support push metrics to Prometheus Pushgateway

4 participants