Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip normalization & obfuscation and coalesce instead #475

Merged
merged 5 commits into from
Jun 7, 2024

Conversation

bwoebi
Copy link
Contributor

@bwoebi bwoebi commented Jun 7, 2024

Turns out the agent ignores the root_span_tags for v0.7 anyway. This is useful to coalesce chunks with common data, allowing us to actually save us from doing redundant requests. As it was currently, the agentful trace sender always sent one trace per request, instead of merging them.

We also skip normalization and rely on the agent to do it, for sake of consistency with other tracers and reduce the potentially duplicated work across tracer and agent. We may change that back in future, but for now we've determined it to be the easiest way to work, also with respect to normalization-unaware testing.

Turns out the agent ignores the root_span_tags for v0.7 anyway.
This is useful to coalesce chunks with common data, allowing us to actually save us from doing redundant requests.
As it was currently, the agentful trace sender always sent one trace per request, instead of merging them.

We also skip normalization and rely on the agent to do it, for sake of consistency with other tracers and reduce the potentially duplicated work across tracer and agent. We may change that back in future, but for now we've determined it to be the easiest way to work, also with respect to normalization-unaware testing.

Signed-off-by: Bob Weinand <bob.weinand@datadoghq.com>
@codecov-commenter
Copy link

codecov-commenter commented Jun 7, 2024

Codecov Report

Attention: Patch coverage is 84.12698% with 10 lines in your changes missing coverage. Please review.

Project coverage is 69.27%. Comparing base (ce04a4d) to head (f51ce0c).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #475      +/-   ##
==========================================
+ Coverage   69.24%   69.27%   +0.03%     
==========================================
  Files         195      195              
  Lines       26051    26106      +55     
==========================================
+ Hits        18039    18086      +47     
- Misses       8012     8020       +8     
Components Coverage Δ
crashtracker 17.62% <ø> (ø)
datadog-alloc 98.76% <ø> (ø)
data-pipeline 51.30% <0.00%> (-0.15%) ⬇️
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 86.43% <ø> (ø)
ddcommon-ffi 74.15% <ø> (ø)
ddtelemetry 56.11% <ø> (ø)
ipc 84.53% <ø> (ø)
profiling 77.83% <ø> (ø)
profiling-ffi 59.61% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 36.25% <0.00%> (-0.05%) ⬇️
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.98% <ø> (ø)
trace-mini-agent 69.36% <100.00%> (+0.02%) ⬆️
trace-normalization 97.79% <ø> (ø)
trace-obfuscation 95.74% <ø> (ø)
trace-protobuf 33.33% <ø> (ø)
trace-utils 91.03% <94.54%> (+0.08%) ⬆️

Copy link
Contributor

@pierotibou pierotibou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nitpicks on comments and one question about the optimization

trace-utils/src/trace_utils.rs Outdated Show resolved Hide resolved
trace-utils/src/trace_utils.rs Show resolved Hide resolved
trace-utils/src/trace_utils.rs Outdated Show resolved Hide resolved
trace-mini-agent/src/trace_processor.rs Outdated Show resolved Hide resolved
bwoebi and others added 3 commits June 7, 2024 13:58
Co-authored-by: Pierre Bonet <pierotibou@gmail.com>
Co-authored-by: Pierre Bonet <pierotibou@gmail.com>
Co-authored-by: Pierre Bonet <pierotibou@gmail.com>
Signed-off-by: Bob Weinand <bob.weinand@datadoghq.com>
@ekump
Copy link
Contributor

ekump commented Jun 7, 2024

bypassing branch protection and merging at @pierotibou's request. dd-gitlab/report_gitlab_CI_status job is not working as expected. Gitlab manually verified to pass.

@ekump ekump merged commit c539a1d into main Jun 7, 2024
27 checks passed
@ekump ekump deleted the bob/agentful-handling branch June 7, 2024 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants