[Feature Request] Support to measure latency through the telemetry metrics framework

[mgodwan]

Is your feature request related to a problem? Please describe

Latency metrics are very useful to analyse any issues resulting in performance degradation.
Today, the telemetry metrics framework has support for counters but lack support for latency/resultant histograms.

It will be useful to have this support to measure various operations e.g. document level latencies like field parsing for geo-shapes, analyzers, complete document parsing, translog sync, etc.

Describe the solution you'd like

https://opentelemetry.io/docs/specs/otel/metrics/data-model/#histogram

Related component

Plugins

Describe alternatives you've considered

No response

Additional context

No response

[mgodwan]

@Gaganjuneja Thoughts?

[peternied]

[Triage - attendees 1 2 3 4]
Thanks for creating this issue; however, it isn't being accepted due to being too large of an area - please consult other issues around telemetry and request instrumentation and build off of them or reword for a more specific requests. Please feel free to re-open after addressing the reason.

[reta]

@mgodwan please take a look at #10141, we've working on general metrics APIs, please share your thoughts and which paths / code flows you would like to add metrics for, what kind of metrics, etc.

[Gaganjuneja]

@reta @peternied @mgodwan I am working on adding the histogram support. At present doing the poc to understand the difference between exponential histogram and explicit bucket histogram. @mgodwan as @reta mentioned, could you please provide the list of metrics, you want to publish?