How to get metrics value from RSS?

[myandpr]

We want to monitor some RSS cluster using metrics in RemoteShuffleService project, but I dont know how to get these metrics value.

And I can not find any metric reporter, so I dont know where these metrics are emitted to.

So how can I get these metrics to monitor my RSS cluster?

[hiboyang]

RSS uses Uber M3 library to send metrics. You could check https://github.com/uber-java/tally. To send metrics to your own metric server, you could implement a M3 scope builder, and add argument like following when starting the server: -Drss.scopeBuilder=com.uber.rss.metrics.M3DummyScopeBuilder.

[bobyangbo]

Did you set "-Drss.scopeBuilder" when starting RSS server?

…

On Wed, Jan 20, 2021 at 1:57 AM yanmin ***@***.***> wrote: I use default M3DummyScopeBuilder, and I implement StatsReporter like following. ... public class PrintStatsReporter implements StatsReporter { private static final Logger logger = LoggerFactory.getLogger(PrintStatsReporter.class); @OverRide public Capabilities capabilities() { return CapableOf.REPORTING; } @OverRide public void flush() { System.out.println("********* Flushed"); } @OverRide public void close() { System.out.println("************ Closed"); } @OverRide public void reportCounter(String name, Map<String, String> tags, long value) { System.out.format("CounterImpl %s: %d\n", name, value); } @OverRide ....... And then I add PrintStatsReporter() in scopeBuilder in M3Stats.createScopeHelper(), But it doesn't worker，Can you give me some suggestion？ StatsReporter reporter = new PrintStatsReporter(); Scope scope = scopeBuilder.reporter(reporter).reportEvery(Duration.ofSeconds(5)); return scope; — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#32 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABE2465B7MXNUSAB4EFCDR3S22SKJANCNFSM4WI7TBOA> .

[CCweixiao]

RSS uses Uber M3 library to send metrics. You could check https://github.com/uber-java/tally. To send metrics to your own metric server, you could implement a M3 scope builder, and add argument like following when starting the server: -Drss.scopeBuilder=com.uber.rss.metrics.M3DummyScopeBuilder.

public class PrintStatsReporter implements StatsReporter {
private static final Logger logger = LoggerFactory.getLogger(PrintStatsReporter.class);

@Override
public void reportCounter(String name, Map<String, String> tags, long value) {
    System.out.format("CounterImpl %s: %d\n", name, value);
}

@Override
public void reportGauge(String s, Map<String, String> map, double v) {

}

@Override
public void reportTimer(String s, Map<String, String> map, Duration duration) {

}

@Override
public void reportHistogramValueSamples(String s, Map<String, String> map, Buckets buckets, double v, double v1, long l) {

}

@Override
public void reportHistogramDurationSamples(String s, Map<String, String> map, Buckets buckets, Duration duration, Duration duration1, long l) {

}

@Override
public Capabilities capabilities() {
    return CapableOf.REPORTING;
}

@Override
public void flush() {
    System.out.println("********* Flushed");
}

@Override
public void close() {
    System.out.println("************ Closed");
}

}

    StatsReporter reporter = new PrintStatsReporter();
    Scope scope = scopeBuilder.reporter(reporter).reportEvery(Duration.ofSeconds(5));
    return scope;
    
    java -Drss.scopeBuilder=com.uber.rss.metrics.M3DummyScopeBuilder  ....
    
    my reporter is not usefully. What should I do to send metric