GA OpenTelemetry tracing plugin

[lmolkova]

It includes

• Merge azure-core-tracing-opentelemetry and azure-core-metrics-opentelemetry into a new plugin #41436

• Support configurable OpenTelemetry schema version

  • Set it on tracer instrumentation scope
  • Support 1.12.0 initially only (TBD - will switch to latest by GA)
  • Map attribute names reported by SDKs to corresponding ones in configured schema version. Here's the current list https://github.com/lmolkova/azure-sdk/blob/main/docs/tracing/distributed-tracing-conventions.yml
  • We'll add new versions every once in a while and users will be able to configure them.
  • Don't change attribute names in SDKs

• Cleanups and breaking changes

  • [FEATURE REQ] The SDK Event Hubs service client builder can not use a custom TraceProvider #24086
  • Propagate context using traceparent in addition to Diagnostic-Id on AMQP SDKs
  • Nested logical spans suppression by default
  • [FEATURE REQ] Service Bus/EventHubs tracing conform to the semantic conventions of messaging systems #21686
  • Tracing API clean-up
    • Tracer.addSpanLink should take two contexts #28953
    • [nice-to-have] unify tracing and metrics attributes

• Testing

  • Integration tests for AMQP SDKs, retries, attributes
  • Perf testing: e.g. run storage perf tests with tracing enabled.
  • Sample will latest and greatest OTel and AppInsights agent including AMQP and HTTP SDK.

• Misc

  • Distributed tracing with 3P tools (New Relic, Dynatrace, AppDynamics, Datadog and Grafana) doesn't work #27943
  • [BUG] Tracing is broken for EventHub binder #23035
  • documentation updates
  • TSGs: links to tracing

context:

• https://github.com/microsoft/common-schema/pull/336/files
• https://gist.github.com/lmolkova/605bbf779d5599e8f01fd2c2e38f036e

[lmolkova]

All the changes are done, now waiting for OTel HTTP semconv to get stable and align with them.

[lmolkova]

Remaining work:

• clean up Tracer API - remove deprecated stuff
  • Tracer: add injectContext for HttpHeaderName overload #34495
• use instrumentation scope to populate az.namespace
• add a feature flag to keep messaging stuff experimental
• documentation updates
• TSGs: links to tracing

[github-actions]

Hi @lmolkova, we deeply appreciate your input into this project. Regrettably, this issue has remained unresolved for over 2 years and inactive for 30 days, leading us to the decision to close it. We've implemented this policy to maintain the relevance of our issue queue and facilitate easier navigation for new contributors. If you still believe this topic requires attention, please feel free to create a new issue, referencing this one. Thank you for your understanding and ongoing support.