Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch metrics in oonipipeline v5 from statsd to opentelemetry #65

Closed
Tracked by #66
hellais opened this issue Apr 25, 2024 · 1 comment
Closed
Tracked by #66

Switch metrics in oonipipeline v5 from statsd to opentelemetry #65

hellais opened this issue Apr 25, 2024 · 1 comment

Comments

@hellais
Copy link
Member

hellais commented Apr 25, 2024

Metrics are important because they help us monitor the processing batch operations and measure performance.

We currently use prometheus in most places (except the new stuff done with a mix of netdata and statsd). It's probably best to stick to the single most widely used metrics in all our system (which is still prometheus). OpenTelemetry is compatible with prometheus and supports also collecting full traces, which are very useful to understanding the performance characteristics of the runs.

Currently in ooni pipeline v5 we were using statsd, but we probably should switch to opentelemetry.

Since OpenTelemetry works by pushing, we don't need to worry about the short running process concerns with exporting them directly via prometheus (that would then have to scraped).

@hellais hellais self-assigned this Apr 25, 2024
@hellais hellais mentioned this issue Apr 25, 2024
13 tasks
@hellais hellais changed the title Switch metrics in oonipipeline v5 from statsd to prometheus Switch metrics in oonipipeline v5 from statsd to opentelemetry Apr 26, 2024
@hellais
Copy link
Member Author

hellais commented Apr 30, 2024

Done in #66

@hellais hellais closed this as completed Apr 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant