POtel implementation base branch

[sl0thentr0py]

Contains:

• Migrate more type comments to annotations #4651
• ref: Drop experimental logs options in 3.0 #4653
• Polish migration guide #4650
• ref: Remove MAX_EVENT_BYTES #4630
• Add new_trace api to force a new trace #4642
• ref: Rename only_if_parent to only_as_child_span #4617
• Remove eventlet support #4584
• Add custom sampling context testcases #4579
• feat(tracing): Add option to exclude specific span origins #4463
• Cleanup op and description mapping #4560
• Simplify status mapping #4570
• Migrate typing #4500
• Remove OpenAI agents from Potel #4523
• Implement trace_propagation_targets for propagator #4460
• Add span activate and deactivate apis #4447
• Remove scope.span = setter and make sure scope.span reference is correct in context manager regardless of source of span #4439
• Update trace decorator to not use start_child #4440
• Cleanup meta references on flush #4420
• Make use of SPANDATA consistent in AI integrations.` #4376
• Add thread info to HTTP breadcrumbs #4368
• Add top level API for add_atttachment. #4360
• Fix FastAPI recursive exceptions #4334
• Respect parent_sampled decision in propagation_context sentry-trace header #4356
• Add logger.debug for sampler decisions for root spans #4355
• Fix feature flags in potel #4353
• Traces sample rate default change #4335
• Introduce underscore span attributes #4331
• ref: Drop set_measurement #4333
• Test Common w/ multiple OTel versions & add compat with old OTel #4312
• Fix propagate_scope=False in ThreadingIntegration #4310
• ref: Simplify Scope.root_span logic #4274
• ref(scope): Properly type Scope.root_span #4273
• Set SDK version #4322
• (Partially) fix POTel CI #4307
• feat(logging): Do not capture errors from LoggingIntegration to Sentry by default #4300
• ref: Move OTel setup out of integrations/opentelemetry/ #4277
• ref: Move otel scope out of integrations/opentelemetry/ #4276
• ref: Move consts, utils from integrations/opentelemetry/ #4272
• ref: Move contextvars_context out of integrations #4271
• ref: Move propagator out of integrations/opentelemetry/ #4260
• ref: Move span processor out of integrations/opentelemetry/ #4259
• ref: Move sampler out of integrations/opentelemetry/ #4258
• [breaking] Enable Django cache_spans by default #3994
• chore: Make start_span fail if unsupported args are provided #4201
• Deprecate Span.set_data() #4261
• Enable tracing without performance by default #4240
• chore: Drop even more deprecated stuff #4193
• Drop support for old frameworks #4246
• Fixed some tests #4217
• Make continuous profiler work in POtel span_processor #4098
• Update Celery tests #4211
• feat(tracing): Port sample_rand to POTel #4106
• Drop propagate_traces #4206
• Fix trytond tests on potel-base #4205
• Fix AWS Lambda tests #4199
• Use warnings module for deprecation messagse.  #4180
• chore: Drop more deprecated stuff #4176
• Better handling of exception groups #4164
• Remove start/stop_profile_session in favor of start/stop_profiler #4170
• [potel] Fix mypy #4169
• Record number of dropped spans in POTel #4092
• Port sample_rate update to potel-base #4069
• Fix breadcrumb level for HTTP client breadcrumbs in POTel #4104
• Set HTTP client breadcrumb level based on status code #4090
• Tread SystemExit(0) not as a span status of 'internal_error' #4094
• Sync toxgen with master #4061
• Fix circular imports for sphinx #3986
• Cleanup scopes types and no-op old scope tracing methods #3985
• Fix non scope related types #3970
• Remove nullcontext from wsgi and asgi #3983
• Replace old Span/Transaction completely with POTelSpan #3966
• Fix Celery tests in POTel #3772
• Fix AWS tests in POTel #3879
• Fix langchain integration #3921
• Setup scopes before client #3916
• Cleanup start_transaction usages #3884
• Fix OpenAI tests in POTel #3738
• Implement span limits on span processor #3881
• Ignore opentelemetry logger in logging integration #3880
• Fix ray tests in POTel #3877
• Fix arq tests in POTel #3875
• Fix strawberry integration #3874
• Fix grpc aio method handling #3873
• Sampling context improvements #3847
• Move scope context init outside integration #3850
• Fix threading by carrying forward span reference in use_scope #3851
• Fix Huey tests in POTel  #3843
• Fix boto3 tests in POTel  #3844
• Fix pymongo tests in POTel  #3839
• Fix potel tests in potel #3841
• Profiler sampling context #3840
• Fix initial scope handling #3837
• Move PotelSentrySpanProcessor to SentrySpanProcessor #3828
• Use span attrs in GCP sampling context #3818
• Fix httplib #3820
• Fix rust tracing #3817
• Fix socket #3819
• Don't set attribute if value is None #3816
• Span attrs instead of AWS custom sampling context #3814
• Turn custom_sampling_context into span attrs in Celery integration #3813
• Fix asyncio tests #3811
• Fix httpx tests #3810
• Extract span attrs from RQ job object & fix tests #3786
• Fix clickhouse breadcrumbs #3687
• Fix asyncpg breadcrumb serialization #3809
• Fix deferred tracing decisions for twp #3802
• Fix test scopes #3801
• Fix tracing tests #3799
• Fix test_breadcrumbs #3788
• Fix test_dsc and twp baggage handling #3789
• Add sample_rate property and fix test_monitor #3790
• Fix test_api #3787
• Fix flake8 #3783
• Extract span attrs from Tornado request #3784
• Extract span attrs from AIOHTTP request #3782
• Unpack WSGI environ into span attrs accessible in traces sampler #3775
• Remove sampled setter and fix sanic behavior with an event processor #3779
• Fix remote case for only_if_parent #3777
• Use semantic attributes in traces sampler for ASGI spans #3774
• Unpack custom_sampling_context into attributes in ASGI #3764
• Sample on root span level #3767
• Fix aiohttp tests #3771
• Remove custom_sampling_context #3747
• Fix starlette tests #3749
• Add only_if_parent option to POTelSpan and use it in integrations #3748
• Fix ASGI tests #3737
• Fix WSGI tests #3734
• Fix Cohere tests #3731
• Moved _serialize_span_attribute into set_attribute #3732
• Make Anthropic integration work with Potel #3686
• Remove name sanitization for POTelSpan and quote trace state populated values #3705
• Make profiling work with potel #3704
• Fix broken sampler after backpressure change #3702
• Fix pymongo #3688
• Fix asyncpg breadcrumbs #3685
• Enable back pressure monitor in Potel #3602
• Fix breadcrumbs in redis #3680
• Use root span transaction name in populated head DSC #3677
• Add sentry_meta object to Span and pass it through to ReadableSpan #3676
• Move subprocess breadcrumbs from maybe_create_breadcrumbs_from_span to integration. #3637
• Serialize span attrs properly #3668
• Fix Django CI #3659
• Fix asyncpg spans #3639
• Make transaction names work #3643
• Only add to trace state if key does not exist #3645
• Fix clickhouse-driver integration spans #3638
• Remove deprecated span description #3640
• Set internal_error span status on span context manager exit #3642
• Implement set_contexts and fix response context #3630
• Fix database span op. #3628
• Head SDK DSC population #3599
• Fix make aws lambda layer #3586
• Make DSC and trace_context work for outgoing traces #3566
• Make span.finish work #3559
• Make sure op/name/description are set correctly on transactions/spans #3519
• Use POTel use_scope, use_isolation_scope #3522
• Store Baggage object on PropagationContext instead of DSC hash #3523
• Drop metrics #3518
• Remove 3.6 compat #3517
• Potel Sampling #3501
• Add root_span implementation #3513
• Fix some methods in POTelSpan #3492
• Add context-friendly use_scope, use_isolation_scope #3500
• Fix _merge_scopes to work with PotelScope #3499
• Update integrations with new continue_trace callback usage #3486
• Restore original scope #3485
• Set the correct SpanContext in continue_trace  #3475
• Fix some properties #3474
• Improve scope-span management #3472
• Add OpenTelemetryIntegration to DEFAULT_INTEGRATIONS #3471
• Remove active flag on POTelSpan #3470
• Fix "indented block" linter error #3468
• Implement new continue_trace and make WSGI work #3460
• Attribute namespace for tags, measurements #3448
• Cleanup origin handling and defaults #3445
• Fill out more property/method stubs #3441
• Create spans on scope #3442
• Tweak OTel timestamp utils #3436
• Random tweaks #3437
• Extract origin from span attributes #3432
• Fix circular imports #3431
• New Scope implementation based on OTel Context #3389
• Fixing start_transaction #3379
• Proxy POTelSpan.set_data to underlying otel span attributes #3297
• Basic test cases for potel #3286
• feat(potel): Make tracing APIs use OTel in the background #3242
• Remove Hub and related code for good. #3446
• Implement new POTel span processor #3223
• Add simple scope management whenever a context is attached #3159

Simple test

import sentry_sdk
from time import sleep

sentry_sdk.init(
    debug=True,
    traces_sample_rate=1.0,
    _experiments={"otel_powered_performance": True},
)

with sentry_sdk.start_span(description="sentry request"):
    sleep(0.1)
    with sentry_sdk.start_span(description="sentry db"):
        sleep(0.5)
        with sentry_sdk.start_span(description="sentry redis"):
            sleep(0.2)
    with sentry_sdk.start_span(description="sentry http"):
        sleep(1)

References

• JS startSpan & friends
• OTel start_span & friends
• JS new performance API readme

Misc

In OTel, this:

with tracer.start_as_current_span("parent") as parent:
    with tracer.start_span("child1"):
        pass
    with tracer.start_span("child2"):
        pass

is equivalent to

from opentelemetry import trace, context

parent = tracer.start_span("parent")

# Creates a Context object with parent set as current span
ctx = trace.set_span_in_context(parent)

# Set as the implicit current context
token = context.attach(ctx)

# Child will automatically be a child of parent
child1 = tracer.start_span("child1")
child1.end()

# Child will automatically be a child of parent
child2 = tracer.start_span("child2")
child2.end()

# Don't forget to detach or parent will remain the parent above this call stack
context.detach(token)
parent.end()

[codecov]

Codecov Report

❌ Patch coverage is 90.58657% with 199 lines in your changes missing coverage. Please review.
✅ Project coverage is 83.75%. Comparing base (3425d4c) to head (c27ac1f).
⚠️ Report is 1 commits behind head on master.
✅ All tests successful. No failed tests found.

Files with missing lines	Patch %	Lines
sentry_sdk/integrations/aws_lambda.py	26.76%	52 Missing ⚠️
sentry_sdk/integrations/gcp.py	0.00%	35 Missing ⚠️
sentry_sdk/integrations/bottle.py	11.76%	15 Missing ⚠️
sentry_sdk/integrations/ray.py	43.47%	13 Missing ⚠️
sentry_sdk/integrations/asgi.py	86.36%	5 Missing and 4 partials ⚠️
sentry_sdk/integrations/clickhouse_driver.py	79.54%	5 Missing and 4 partials ⚠️
sentry_sdk/integrations/tornado.py	82.22%	5 Missing and 3 partials ⚠️
sentry_sdk/integrations/rq.py	86.04%	2 Missing and 4 partials ⚠️
sentry_sdk/integrations/django/__init__.py	91.37%	5 Missing ⚠️
sentry_sdk/integrations/huey.py	81.48%	3 Missing and 2 partials ⚠️
... and 25 more

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #3152      +/-   ##
==========================================
+ Coverage   80.79%   83.75%   +2.96%     
==========================================
  Files         156      158       +2     
  Lines       16643    15517    -1126     
  Branches     2833     2456     -377     
==========================================
- Hits        13446    12997     -449     
+ Misses       2306     1765     -541     
+ Partials      891      755     -136     

Files with missing lines	Coverage Δ
sentry_sdk/__init__.py	100.00% <100.00%> (ø)
sentry_sdk/_init_implementation.py	100.00% <100.00%> (+23.33%)	⬆️
sentry_sdk/_log_batcher.py	79.76% <100.00%> (+2.11%)	⬆️
sentry_sdk/_lru_cache.py	100.00% <100.00%> (+6.25%)	⬆️
sentry_sdk/_queue.py	62.22% <100.00%> (+1.35%)	⬆️
sentry_sdk/_werkzeug.py	50.00% <100.00%> (+8.06%)	⬆️
sentry_sdk/ai/monitoring.py	89.47% <100.00%> (+2.46%)	⬆️
sentry_sdk/ai/utils.py	73.91% <100.00%> (+7.24%)	⬆️
sentry_sdk/api.py	96.00% <100.00%> (+15.86%)	⬆️
sentry_sdk/attachments.py	100.00% <100.00%> (+6.45%)	⬆️
... and 140 more

... and 1 file with indirect coverage changes