Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log analysis tool #25115

Closed
6 tasks done
Tracked by #23952
lmolkova opened this issue Oct 30, 2021 · 0 comments
Closed
6 tasks done
Tracked by #23952

Log analysis tool #25115

lmolkova opened this issue Oct 30, 2021 · 0 comments
Assignees
Labels
amqp Label for tracking issues related to AMQP Client This issue points to a problem in the data-plane of the library. feature-request This issue requires a new behavior in the product in order be resolved. Service Bus

Comments

@lmolkova
Copy link
Member

lmolkova commented Oct 30, 2021

AMQP SDKs issue investigation depends heavily on log parsing.
In the long-term, we should rely more on tracing, metrics, and logs being available in users APM tools and user being able to investigate simple issues without SDK's team help.
In the meantime, to analyze existing logs including perf runs, we can build a log analysis tool parsing and sending structured logs to Kusto/Log analytics to be able to query them and automate analysis on top.

Prototype: https://github.com/lmolkova/azure-sdk-log-parser

Related to #25114
TODO:

  • switch to new logging format Structured logging with ClientLogger #25247
  • We should also investigate how it's done in other languages and see if the tool can be reused
    • Go SDKs: use detailed 3rd party library logs
    • .NET SDKs: have comprehensive EventSource -> ILogger bridge with context and ability to export anywhere
    • JS: writes to stdout, can be customized to write anywhere, does not support structured logging
    • Python: uses Python logging library, it supports structured logging out of the box (with extra args )
@ghost ghost added the needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. label Oct 30, 2021
@lmolkova lmolkova self-assigned this Oct 30, 2021
@lmolkova lmolkova added the amqp Label for tracking issues related to AMQP label Oct 30, 2021
@ghost ghost removed the needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. label Oct 30, 2021
@joshfree joshfree added Client This issue points to a problem in the data-plane of the library. feature-request This issue requires a new behavior in the product in order be resolved. Service Bus labels Nov 2, 2021
@github-actions github-actions bot locked and limited conversation to collaborators Apr 11, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
amqp Label for tracking issues related to AMQP Client This issue points to a problem in the data-plane of the library. feature-request This issue requires a new behavior in the product in order be resolved. Service Bus
Projects
Status: Done
Development

No branches or pull requests

2 participants