Skip to content

Conversation

@taegyunkim
Copy link
Contributor

@taegyunkim taegyunkim commented Sep 3, 2025

There are two things blocking merging changes to 3.12 release branch

  1. llmobs gitlab test suites: should be addressed by ci(llmobs): skip flaky tests hitting faulty endpoint [backport 3.12] #14484, but then this backport is blocked by system-tests
  2. system-tests: there are just too many system-tests commits that were merged to main, and I don't know up to which point should I need to cherry-pick. So this PR just has all commits that touched .github/workflows/system-tests.yml

And #14461 needs tracer changes introducing forwarded ip support (#14418 and #14400)

Checklist

  • PR author has checked that all the criteria below are met
  • The PR description includes an overview of the change
  • The PR description articulates the motivation for the change
  • The change includes tests OR the PR description describes a testing strategy
  • The PR description notes risks associated with the change, if any
  • Newly-added code is easy to change
  • The change follows the library release note guidelines
  • The change includes or references documentation updates if necessary
  • Backport labels are set (if applicable)

Reviewer Checklist

  • Reviewer has checked that all the criteria below are met
  • Title is accurate
  • All changes are related to the pull request's stated goal
  • Avoids breaking API changes
  • Testing strategy adequately addresses listed risks
  • Newly-added code is easy to change
  • Release note makes sense to a user of the library
  • If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
  • Backport labels are set in a manner that is consistent with the release branch maintenance policy

brettlangdon and others added 6 commits September 3, 2025 12:02
Also update `scripts/update-system-tsts-version.py` to also update
`.gitlab-ci.yml`

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
update system tests pin version.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
## Overview

Optimizes the system tests CI workflow by building wheels once and
reusing them across jobs instead of checking out and building from
source multiple times.

## Motivation

The current system tests workflow checks out the dd-trace-py repository
and builds from source in each job, leading to:
  - Redundant build time across multiple jobs
  - Increased CI resource usage
  - Longer overall workflow execution time
  - Build dependencies required in system-tests

This change centralizes wheel building in a dedicated job and
distributes the pre-built wheels to consuming jobs, eliminating the need
for build dependencies in system test runners.

## Changes

- Created a new build-wheels job that calls the existing
build_python_3.yml reusable workflow
- Replaced "Checkout dd-trace-py" steps with "Download wheels to
binaries directory" in both system-tests-build-weblog and parametric
jobs
- Added job dependencies to ensure wheels are built before being
consumed

## Testing Strategy

Only ci changes. Tested by running the system tests workflow to
completion.

## Risks

- Low risk: If wheel building fails, all dependent jobs will fail fast
rather than building individually
- Mitigation: The reusable workflow build_python_3.yml is already proven
and used in other workflows

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

---------

Co-authored-by: Charles de Beauchesne <charles.de.beauchesne@gmail.com>
Ci was blocked by django errors due to unpinned dependencies version on
weblogs.
This PR update system tests version with problem fixed.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
some of our tests hit our real staging endpoint, which itself could
sometimes be flaky. following up soon with a real fix to record a
response one time and serve it back (since these tests are just checking
logging behavior).

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

(cherry picked from commit 5b0b7c6)
@github-actions
Copy link
Contributor

github-actions bot commented Sep 3, 2025

CODEOWNERS have been resolved as:

.github/workflows/system-tests.yml                                      @DataDog/python-guild @DataDog/apm-core-python
.gitlab-ci.yml                                                          @DataDog/apm-core-python
ddtrace/contrib/internal/trace_utils.py                                 @DataDog/apm-core-python @DataDog/apm-idm-python
scripts/update-system-tests-version.py                                  @DataDog/apm-core-python
tests/llmobs/test_llmobs_eval_metric_agentless_writer.py                @DataDog/ml-observability
tests/llmobs/test_llmobs_evaluator_runner.py                            @DataDog/ml-observability
tests/tracer/test_trace_utils.py                                        @DataDog/apm-sdk-api-python

@taegyunkim taegyunkim changed the title ci: cherry-pick system tests fixes to 3.12 ci: cherry-pick fixes to unblock 3.12 branch Sep 3, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Sep 3, 2025

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 267 ± 6 ms.

The average import time from base is: 267 ± 4 ms.

The import time difference between this PR and base is: -0.7 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.889 ms (0.71%)
ddtrace.bootstrap.sitecustomize 1.215 ms (0.46%)
ddtrace.bootstrap.preload 1.215 ms (0.46%)
ddtrace.internal.remoteconfig.client 0.622 ms (0.23%)
ddtrace 0.674 ms (0.25%)
ddtrace.internal._unpatched 0.032 ms (0.01%)
json 0.032 ms (0.01%)
json.decoder 0.032 ms (0.01%)
re 0.032 ms (0.01%)
enum 0.032 ms (0.01%)
types 0.032 ms (0.01%)

APPSEC-58261

Following guidelines on internal document "Client IP addresses
resolution"

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
Following #14400

This PR improves the support for `forwarded` header by adding ip format
extraction from the forwarded format described in
https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/Forwarded
https://www.rfc-editor.org/rfc/rfc7239

- We only extract the ip from the `for` parameter.
- Also add tests for different possible ip formats (ipv4, ipv6, quoted
or unquoted, with or without port)

This will also be supported by system tests
DataDog/system-tests#5134

APPSEC-58261

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
@taegyunkim taegyunkim changed the title ci: cherry-pick fixes to unblock 3.12 branch ci: cherry-pick backports to unblock 3.12 branch ci Sep 3, 2025
@taegyunkim taegyunkim added changelog/no-changelog A changelog entry is not required for this PR. CI MLObs ML Observability (LLMObs) labels Sep 3, 2025
@pr-commenter
Copy link

pr-commenter bot commented Sep 3, 2025

Performance SLOs

Candidate: taegyunkim/3-12-system-tests (367a2f5)

🔵 No Baseline Data (24 suites)
🔵 coreapiscenario - 12/12 (2 unstable)

🔵 No baseline data available for this suite

⚠️ context_with_data_listeners

Time: ⚠️ 13.800µs (SLO: <20.000µs 📉 -31.0%)

Memory: ✅ 31.320MB (SLO: <33.500MB -6.5%)


✅ context_with_data_no_listeners

Time: ✅ 3.836µs (SLO: <10.000µs 📉 -61.6%)

Memory: ✅ 31.300MB (SLO: <33.500MB -6.6%)


⚠️ context_with_data_only_all_listeners

Time: ⚠️ 13.877µs (SLO: <20.000µs 📉 -30.6%)

Memory: ✅ 31.261MB (SLO: <33.500MB -6.7%)


✅ get_item_exists

Time: ✅ 0.643µs (SLO: <10.000µs 📉 -93.6%)

Memory: ✅ 31.280MB (SLO: <33.500MB -6.6%)


✅ get_item_missing

Time: ✅ 0.693µs (SLO: <10.000µs 📉 -93.1%)

Memory: ✅ 31.241MB (SLO: <33.500MB -6.7%)


✅ set_item

Time: ✅ 24.810µs (SLO: <30.000µs 📉 -17.3%)

Memory: ✅ 31.359MB (SLO: <33.500MB -6.4%)


🔵 djangosimple - 22/22

🔵 No baseline data available for this suite

✅ appsec

Time: ✅ 21.256ms (SLO: <22.300ms -4.7%)

Memory: ✅ 63.867MB (SLO: <66.000MB -3.2%)


✅ exception-replay-enabled

Time: ✅ 1.377ms (SLO: <1.450ms -5.1%)

Memory: ✅ 63.268MB (SLO: <66.000MB -4.1%)


✅ iast

Time: ✅ 21.223ms (SLO: <22.250ms -4.6%)

Memory: ✅ 63.909MB (SLO: <66.000MB -3.2%)


✅ profiler

Time: ✅ 15.335ms (SLO: <16.550ms -7.3%)

Memory: ✅ 51.570MB (SLO: <53.500MB -3.6%)


✅ span-code-origin

Time: ✅ 27.019ms (SLO: <28.200ms -4.2%)

Memory: ✅ 65.980MB (SLO: <68.500MB -3.7%)


✅ tracer

Time: ✅ 21.278ms (SLO: <22.700ms -6.3%)

Memory: ✅ 63.884MB (SLO: <66.000MB -3.2%)


✅ tracer-and-profiler

Time: ✅ 23.252ms (SLO: <24.900ms -6.6%)

Memory: ✅ 65.255MB (SLO: <67.000MB -2.6%)


✅ tracer-no-caches

Time: ✅ 18.859ms (SLO: <19.650ms -4.0%)

Memory: ✅ 63.903MB (SLO: <66.000MB -3.2%)


✅ tracer-no-databases

Time: ✅ 19.144ms (SLO: <20.100ms -4.8%)

Memory: ✅ 63.847MB (SLO: <66.000MB -3.3%)


✅ tracer-no-middleware

Time: ✅ 21.113ms (SLO: <22.500ms -6.2%)

Memory: ✅ 63.847MB (SLO: <66.000MB -3.3%)


✅ tracer-no-templates

Time: ✅ 21.093ms (SLO: <22.250ms -5.2%)

Memory: ✅ 63.826MB (SLO: <66.000MB -3.3%)


🔵 errortrackingdjangosimple - 6/6

🔵 No baseline data available for this suite

✅ errortracking-enabled-all

Time: ✅ 18.554ms (SLO: <19.850ms -6.5%)

Memory: ✅ 63.810MB (SLO: <65.500MB -2.6%)


✅ errortracking-enabled-user

Time: ✅ 18.609ms (SLO: <19.400ms -4.1%)

Memory: ✅ 63.869MB (SLO: <65.500MB -2.5%)


✅ tracer-enabled

Time: ✅ 18.496ms (SLO: <19.450ms -4.9%)

Memory: ✅ 63.782MB (SLO: <65.500MB -2.6%)


🔵 errortrackingflasksqli - 6/6

🔵 No baseline data available for this suite

✅ errortracking-enabled-all

Time: ✅ 2.122ms (SLO: <2.300ms -7.7%)

Memory: ✅ 51.077MB (SLO: <53.500MB -4.5%)


✅ errortracking-enabled-user

Time: ✅ 2.131ms (SLO: <2.250ms -5.3%)

Memory: ✅ 51.058MB (SLO: <53.500MB -4.6%)


✅ tracer-enabled

Time: ✅ 2.124ms (SLO: <2.300ms -7.7%)

Memory: ✅ 51.097MB (SLO: <53.500MB -4.5%)


🔵 flasksimple - 15/15

🔵 No baseline data available for this suite

✅ appsec-get

Time: ✅ 4.619ms (SLO: <4.750ms -2.8%)

Memory: ✅ 61.755MB (SLO: <64.500MB -4.3%)


✅ appsec-post

Time: ✅ 6.652ms (SLO: <6.750ms 🟡 -1.5%)

Memory: ✅ 62.148MB (SLO: <64.500MB -3.6%)


✅ appsec-telemetry

Time: ✅ 4.617ms (SLO: <4.750ms -2.8%)

Memory: ✅ 61.715MB (SLO: <64.500MB -4.3%)


✅ debugger

Time: ✅ 1.859ms (SLO: <2.000ms -7.0%)

Memory: ✅ 44.413MB (SLO: <45.000MB 🟡 -1.3%)


✅ iast-get

Time: ✅ 1.856ms (SLO: <2.000ms -7.2%)

Memory: ✅ 47.000MB (SLO: <49.000MB -4.1%)


✅ profiler

Time: ✅ 1.922ms (SLO: <2.100ms -8.5%)

Memory: ✅ 44.075MB (SLO: <46.500MB -5.2%)


✅ tracer

Time: ✅ 3.389ms (SLO: <3.650ms -7.1%)

Memory: ✅ 51.062MB (SLO: <53.500MB -4.6%)


🔵 flasksqli - 6/6

🔵 No baseline data available for this suite

✅ appsec-enabled

Time: ✅ 3.999ms (SLO: <4.200ms -4.8%)

Memory: ✅ 62.107MB (SLO: <66.000MB -5.9%)


✅ iast-enabled

Time: ✅ 2.577ms (SLO: <2.800ms -8.0%)

Memory: ✅ 57.584MB (SLO: <59.000MB -2.4%)


✅ tracer-enabled

Time: ✅ 2.112ms (SLO: <2.250ms -6.1%)

Memory: ✅ 51.075MB (SLO: <53.500MB -4.5%)


🔵 httppropagationextract - 60/60

🔵 No baseline data available for this suite

✅ all_styles_all_headers

Time: ✅ 86.445µs (SLO: <100.000µs 📉 -13.6%)

Memory: ✅ 31.379MB (SLO: <33.500MB -6.3%)


✅ b3_headers

Time: ✅ 14.303µs (SLO: <20.000µs 📉 -28.5%)

Memory: ✅ 31.398MB (SLO: <33.500MB -6.3%)


✅ b3_single_headers

Time: ✅ 13.388µs (SLO: <20.000µs 📉 -33.1%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 67.074µs (SLO: <80.000µs 📉 -16.2%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 67.871µs (SLO: <80.000µs 📉 -15.2%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


✅ empty_headers

Time: ✅ 1.590µs (SLO: <10.000µs 📉 -84.1%)

Memory: ✅ 31.398MB (SLO: <33.500MB -6.3%)


✅ full_t_id_datadog_headers

Time: ✅ 24.037µs (SLO: <30.000µs 📉 -19.9%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


✅ invalid_priority_header

Time: ✅ 6.528µs (SLO: <10.000µs 📉 -34.7%)

Memory: ✅ 31.398MB (SLO: <33.500MB -6.3%)


✅ invalid_span_id_header

Time: ✅ 6.528µs (SLO: <10.000µs 📉 -34.7%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


✅ invalid_tags_header

Time: ✅ 6.513µs (SLO: <10.000µs 📉 -34.9%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ invalid_trace_id_header

Time: ✅ 6.537µs (SLO: <10.000µs 📉 -34.6%)

Memory: ✅ 31.379MB (SLO: <33.500MB -6.3%)


✅ large_header_no_matches

Time: ✅ 27.538µs (SLO: <30.000µs -8.2%)

Memory: ✅ 31.398MB (SLO: <33.500MB -6.3%)


✅ large_valid_headers_all

Time: ✅ 28.823µs (SLO: <40.000µs 📉 -27.9%)

Memory: ✅ 31.339MB (SLO: <33.500MB -6.4%)


✅ medium_header_no_matches

Time: ✅ 9.844µs (SLO: <20.000µs 📉 -50.8%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ medium_valid_headers_all

Time: ✅ 11.251µs (SLO: <20.000µs 📉 -43.7%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ none_propagation_style

Time: ✅ 1.702µs (SLO: <10.000µs 📉 -83.0%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ tracecontext_headers

Time: ✅ 34.305µs (SLO: <40.000µs 📉 -14.2%)

Memory: ✅ 31.339MB (SLO: <33.500MB -6.4%)


✅ valid_headers_all

Time: ✅ 6.484µs (SLO: <10.000µs 📉 -35.2%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ valid_headers_basic

Time: ✅ 6.115µs (SLO: <10.000µs 📉 -38.9%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ wsgi_empty_headers

Time: ✅ 1.582µs (SLO: <10.000µs 📉 -84.2%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ wsgi_invalid_priority_header

Time: ✅ 6.589µs (SLO: <10.000µs 📉 -34.1%)

Memory: ✅ 31.379MB (SLO: <33.500MB -6.3%)


✅ wsgi_invalid_span_id_header

Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%)

Memory: ✅ 31.379MB (SLO: <33.500MB -6.3%)


✅ wsgi_invalid_tags_header

Time: ✅ 6.574µs (SLO: <10.000µs 📉 -34.3%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.584µs (SLO: <10.000µs 📉 -34.2%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ wsgi_large_header_no_matches

Time: ✅ 28.968µs (SLO: <40.000µs 📉 -27.6%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ wsgi_large_valid_headers_all

Time: ✅ 29.700µs (SLO: <40.000µs 📉 -25.8%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ wsgi_medium_header_no_matches

Time: ✅ 10.266µs (SLO: <20.000µs 📉 -48.7%)

Memory: ✅ 31.379MB (SLO: <33.500MB -6.3%)


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.554µs (SLO: <20.000µs 📉 -42.2%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ wsgi_valid_headers_all

Time: ✅ 6.566µs (SLO: <10.000µs 📉 -34.3%)

Memory: ✅ 31.398MB (SLO: <33.500MB -6.3%)


✅ wsgi_valid_headers_basic

Time: ✅ 6.120µs (SLO: <10.000µs 📉 -38.8%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


🔵 httppropagationinject - 16/16

🔵 No baseline data available for this suite

✅ ids_only

Time: ✅ 22.078µs (SLO: <30.000µs 📉 -26.4%)

Memory: ✅ 31.398MB (SLO: <33.500MB -6.3%)


✅ with_all

Time: ✅ 33.942µs (SLO: <40.000µs 📉 -15.1%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


✅ with_dd_origin

Time: ✅ 28.648µs (SLO: <30.000µs -4.5%)

Memory: ✅ 31.418MB (SLO: <33.500MB -6.2%)


✅ with_priority_and_origin

Time: ✅ 28.433µs (SLO: <40.000µs 📉 -28.9%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


✅ with_sampling_priority

Time: ✅ 21.848µs (SLO: <30.000µs 📉 -27.2%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


✅ with_tags

Time: ✅ 30.592µs (SLO: <40.000µs 📉 -23.5%)

Memory: ✅ 31.339MB (SLO: <33.500MB -6.4%)


✅ with_tags_invalid

Time: ✅ 33.418µs (SLO: <40.000µs 📉 -16.5%)

Memory: ✅ 31.379MB (SLO: <33.500MB -6.3%)


✅ with_tags_max_size

Time: ✅ 31.800µs (SLO: <40.000µs 📉 -20.5%)

Memory: ✅ 31.438MB (SLO: <33.500MB -6.2%)


🔵 iast_aspects - 40/40

🔵 No baseline data available for this suite

✅ re_expand_aspect

Time: ✅ 33.170µs (SLO: <40.000µs 📉 -17.1%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ re_expand_noaspect

Time: ✅ 28.832µs (SLO: <40.000µs 📉 -27.9%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ re_findall_aspect

Time: ✅ 3.701µs (SLO: <10.000µs 📉 -63.0%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ re_findall_noaspect

Time: ✅ 1.408µs (SLO: <10.000µs 📉 -85.9%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ re_finditer_aspect

Time: ✅ 5.150µs (SLO: <10.000µs 📉 -48.5%)

Memory: ✅ 36.687MB (SLO: <39.000MB -5.9%)


✅ re_finditer_noaspect

Time: ✅ 1.417µs (SLO: <10.000µs 📉 -85.8%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ re_fullmatch_aspect

Time: ✅ 3.392µs (SLO: <10.000µs 📉 -66.1%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ re_fullmatch_noaspect

Time: ✅ 1.283µs (SLO: <10.000µs 📉 -87.2%)

Memory: ✅ 36.707MB (SLO: <39.000MB -5.9%)


✅ re_group_aspect

Time: ✅ 3.480µs (SLO: <10.000µs 📉 -65.2%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ re_group_noaspect

Time: ✅ 1.607µs (SLO: <10.000µs 📉 -83.9%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ re_groups_aspect

Time: ✅ 3.591µs (SLO: <10.000µs 📉 -64.1%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ re_groups_noaspect

Time: ✅ 1.675µs (SLO: <10.000µs 📉 -83.2%)

Memory: ✅ 36.726MB (SLO: <39.000MB -5.8%)


✅ re_match_aspect

Time: ✅ 3.429µs (SLO: <10.000µs 📉 -65.7%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ re_match_noaspect

Time: ✅ 1.302µs (SLO: <10.000µs 📉 -87.0%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ re_search_aspect

Time: ✅ 3.316µs (SLO: <10.000µs 📉 -66.8%)

Memory: ✅ 36.864MB (SLO: <39.000MB -5.5%)


✅ re_search_noaspect

Time: ✅ 1.204µs (SLO: <10.000µs 📉 -88.0%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ re_sub_aspect

Time: ✅ 4.726µs (SLO: <10.000µs 📉 -52.7%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ re_sub_noaspect

Time: ✅ 1.534µs (SLO: <10.000µs 📉 -84.7%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ re_subn_aspect

Time: ✅ 4.887µs (SLO: <10.000µs 📉 -51.1%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ re_subn_noaspect

Time: ✅ 1.611µs (SLO: <10.000µs 📉 -83.9%)

Memory: ✅ 36.864MB (SLO: <39.000MB -5.5%)


🔵 iastaspects - 118/118

🔵 No baseline data available for this suite

✅ add_aspect

Time: ✅ 0.330µs (SLO: <10.000µs 📉 -96.7%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ add_inplace_aspect

Time: ✅ 0.331µs (SLO: <10.000µs 📉 -96.7%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ add_inplace_noaspect

Time: ✅ 0.321µs (SLO: <10.000µs 📉 -96.8%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ add_noaspect

Time: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ bytearray_aspect

Time: ✅ 1.847µs (SLO: <10.000µs 📉 -81.5%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ bytearray_extend_aspect

Time: ✅ 1.391µs (SLO: <10.000µs 📉 -86.1%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ bytearray_extend_noaspect

Time: ✅ 0.612µs (SLO: <10.000µs 📉 -93.9%)

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%)


✅ bytearray_noaspect

Time: ✅ 0.479µs (SLO: <10.000µs 📉 -95.2%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ bytes_aspect

Time: ✅ 1.859µs (SLO: <10.000µs 📉 -81.4%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ bytes_noaspect

Time: ✅ 0.490µs (SLO: <10.000µs 📉 -95.1%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ bytesio_aspect

Time: ✅ 1.874µs (SLO: <10.000µs 📉 -81.3%)

Memory: ✅ 36.864MB (SLO: <39.000MB -5.5%)


✅ bytesio_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%)

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%)


✅ capitalize_aspect

Time: ✅ 0.744µs (SLO: <10.000µs 📉 -92.6%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ capitalize_noaspect

Time: ✅ 0.435µs (SLO: <10.000µs 📉 -95.6%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ casefold_aspect

Time: ✅ 0.742µs (SLO: <10.000µs 📉 -92.6%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ casefold_noaspect

Time: ✅ 0.375µs (SLO: <10.000µs 📉 -96.3%)

Memory: ✅ 36.864MB (SLO: <39.000MB -5.5%)


✅ decode_aspect

Time: ✅ 0.733µs (SLO: <10.000µs 📉 -92.7%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ decode_noaspect

Time: ✅ 0.424µs (SLO: <10.000µs 📉 -95.8%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ encode_aspect

Time: ✅ 0.716µs (SLO: <10.000µs 📉 -92.8%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ encode_noaspect

Time: ✅ 0.409µs (SLO: <10.000µs 📉 -95.9%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ format_aspect

Time: ✅ 3.440µs (SLO: <10.000µs 📉 -65.6%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ format_map_aspect

Time: ✅ 3.302µs (SLO: <10.000µs 📉 -67.0%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ format_map_noaspect

Time: ✅ 0.783µs (SLO: <10.000µs 📉 -92.2%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ format_noaspect

Time: ✅ 0.600µs (SLO: <10.000µs 📉 -94.0%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ index_aspect

Time: ✅ 0.343µs (SLO: <10.000µs 📉 -96.6%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ index_noaspect

Time: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ join_aspect

Time: ✅ 1.219µs (SLO: <10.000µs 📉 -87.8%)

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%)


✅ join_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%)

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%)


✅ ljust_aspect

Time: ✅ 10.339µs (SLO: <20.000µs 📉 -48.3%)

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%)


✅ ljust_noaspect

Time: ✅ 0.409µs (SLO: <10.000µs 📉 -95.9%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ lower_aspect

Time: ✅ 2.236µs (SLO: <10.000µs 📉 -77.6%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ lower_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ lstrip_aspect

Time: ✅ 10.277µs (SLO: <20.000µs 📉 -48.6%)

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%)


✅ lstrip_noaspect

Time: ✅ 0.388µs (SLO: <10.000µs 📉 -96.1%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ modulo_aspect

Time: ✅ 0.589µs (SLO: <10.000µs 📉 -94.1%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.241µs (SLO: <10.000µs 📉 -87.6%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ modulo_aspect_for_bytes

Time: ✅ 0.755µs (SLO: <10.000µs 📉 -92.5%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 0.974µs (SLO: <10.000µs 📉 -90.3%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ modulo_noaspect

Time: ✅ 0.632µs (SLO: <10.000µs 📉 -93.7%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ replace_aspect

Time: ✅ 4.737µs (SLO: <10.000µs 📉 -52.6%)

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%)


✅ replace_noaspect

Time: ✅ 0.466µs (SLO: <10.000µs 📉 -95.3%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ repr_aspect

Time: ✅ 0.915µs (SLO: <10.000µs 📉 -90.9%)

Memory: ✅ 36.864MB (SLO: <39.000MB -5.5%)


✅ repr_noaspect

Time: ✅ 0.417µs (SLO: <10.000µs 📉 -95.8%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ rstrip_aspect

Time: ✅ 10.179µs (SLO: <20.000µs 📉 -49.1%)

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%)


✅ rstrip_noaspect

Time: ✅ 0.389µs (SLO: <10.000µs 📉 -96.1%)

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%)


✅ slice_aspect

Time: ✅ 0.480µs (SLO: <10.000µs 📉 -95.2%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ slice_noaspect

Time: ✅ 0.450µs (SLO: <10.000µs 📉 -95.5%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ stringio_aspect

Time: ✅ 2.176µs (SLO: <10.000µs 📉 -78.2%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ stringio_noaspect

Time: ✅ 0.716µs (SLO: <10.000µs 📉 -92.8%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ strip_aspect

Time: ✅ 10.318µs (SLO: <20.000µs 📉 -48.4%)

Memory: ✅ 36.943MB (SLO: <39.000MB -5.3%)


✅ strip_noaspect

Time: ✅ 0.391µs (SLO: <10.000µs 📉 -96.1%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ swapcase_aspect

Time: ✅ 2.432µs (SLO: <10.000µs 📉 -75.7%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ swapcase_noaspect

Time: ✅ 0.537µs (SLO: <10.000µs 📉 -94.6%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ title_aspect

Time: ✅ 2.387µs (SLO: <10.000µs 📉 -76.1%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ title_noaspect

Time: ✅ 0.506µs (SLO: <10.000µs 📉 -94.9%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ translate_aspect

Time: ✅ 3.316µs (SLO: <10.000µs 📉 -66.8%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ translate_noaspect

Time: ✅ 1.045µs (SLO: <10.000µs 📉 -89.6%)

Memory: ✅ 36.726MB (SLO: <39.000MB -5.8%)


✅ upper_aspect

Time: ✅ 2.234µs (SLO: <10.000µs 📉 -77.7%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ upper_noaspect

Time: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


🔵 iastaspectsospath - 24/24

🔵 No baseline data available for this suite

✅ ospathbasename_aspect

Time: ✅ 4.657µs (SLO: <10.000µs 📉 -53.4%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ ospathbasename_noaspect

Time: ✅ 1.092µs (SLO: <10.000µs 📉 -89.1%)

Memory: ✅ 36.726MB (SLO: <39.000MB -5.8%)


✅ ospathjoin_aspect

Time: ✅ 6.041µs (SLO: <10.000µs 📉 -39.6%)

Memory: ✅ 36.746MB (SLO: <39.000MB -5.8%)


✅ ospathjoin_noaspect

Time: ✅ 2.291µs (SLO: <10.000µs 📉 -77.1%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


✅ ospathnormcase_aspect

Time: ✅ 3.463µs (SLO: <10.000µs 📉 -65.4%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ ospathnormcase_noaspect

Time: ✅ 0.576µs (SLO: <10.000µs 📉 -94.2%)

Memory: ✅ 36.726MB (SLO: <39.000MB -5.8%)


✅ ospathsplit_aspect

Time: ✅ 4.804µs (SLO: <10.000µs 📉 -52.0%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ ospathsplit_noaspect

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ ospathsplitdrive_aspect

Time: ✅ 3.655µs (SLO: <10.000µs 📉 -63.5%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ ospathsplitdrive_noaspect

Time: ✅ 0.706µs (SLO: <10.000µs 📉 -92.9%)

Memory: ✅ 36.726MB (SLO: <39.000MB -5.8%)


✅ ospathsplitext_aspect

Time: ✅ 4.553µs (SLO: <10.000µs 📉 -54.5%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


✅ ospathsplitext_noaspect

Time: ✅ 1.396µs (SLO: <10.000µs 📉 -86.0%)

Memory: ✅ 36.785MB (SLO: <39.000MB -5.7%)


🔵 iastaspectssplit - 12/12

🔵 No baseline data available for this suite

✅ rsplit_aspect

Time: ✅ 1.471µs (SLO: <10.000µs 📉 -85.3%)

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%)


✅ rsplit_noaspect

Time: ✅ 0.587µs (SLO: <10.000µs 📉 -94.1%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ split_aspect

Time: ✅ 1.441µs (SLO: <10.000µs 📉 -85.6%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ split_noaspect

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ splitlines_aspect

Time: ✅ 1.414µs (SLO: <10.000µs 📉 -85.9%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ splitlines_noaspect

Time: ✅ 0.597µs (SLO: <10.000µs 📉 -94.0%)

Memory: ✅ 36.825MB (SLO: <39.000MB -5.6%)


🔵 iastpropagation - 8/8

🔵 No baseline data available for this suite

✅ no-propagation

Time: ✅ 49.014µs (SLO: <60.000µs 📉 -18.3%)

Memory: ✅ 36.844MB (SLO: <39.000MB -5.5%)


✅ propagation_enabled

Time: ✅ 145.225µs (SLO: <160.000µs -9.2%)

Memory: ✅ 36.805MB (SLO: <39.000MB -5.6%)


✅ propagation_enabled_100

Time: ✅ 1.592ms (SLO: <1.800ms 📉 -11.5%)

Memory: ✅ 36.923MB (SLO: <39.000MB -5.3%)


✅ propagation_enabled_1000

Time: ✅ 29.079ms (SLO: <30.550ms -4.8%)

Memory: ✅ 36.864MB (SLO: <39.000MB -5.5%)


🔵 otelsdkspan - 24/24

🔵 No baseline data available for this suite

✅ add-event

Time: ✅ 40.525ms (SLO: <42.000ms -3.5%)

Memory: ✅ 34.190MB (SLO: <39.000MB 📉 -12.3%)


✅ add-link

Time: ✅ 36.804ms (SLO: <38.550ms -4.5%)

Memory: ✅ 34.151MB (SLO: <39.000MB 📉 -12.4%)


✅ add-metrics

Time: ✅ 220.436ms (SLO: <232.000ms -5.0%)

Memory: ✅ 34.092MB (SLO: <39.000MB 📉 -12.6%)


✅ add-tags

Time: ✅ 212.907ms (SLO: <221.600ms -3.9%)

Memory: ✅ 34.151MB (SLO: <39.000MB 📉 -12.4%)


✅ get-context

Time: ✅ 29.201ms (SLO: <31.300ms -6.7%)

Memory: ✅ 34.190MB (SLO: <39.000MB 📉 -12.3%)


✅ is-recording

Time: ✅ 29.199ms (SLO: <31.000ms -5.8%)

Memory: ✅ 34.131MB (SLO: <39.000MB 📉 -12.5%)


✅ record-exception

Time: ✅ 63.407ms (SLO: <65.850ms -3.7%)

Memory: ✅ 34.131MB (SLO: <39.000MB 📉 -12.5%)


✅ set-status

Time: ✅ 32.496ms (SLO: <34.150ms -4.8%)

Memory: ✅ 34.170MB (SLO: <39.000MB 📉 -12.4%)


✅ start

Time: ✅ 28.838ms (SLO: <30.150ms -4.4%)

Memory: ✅ 34.053MB (SLO: <39.000MB 📉 -12.7%)


✅ start-finish

Time: ✅ 33.977ms (SLO: <35.350ms -3.9%)

Memory: ✅ 34.151MB (SLO: <39.000MB 📉 -12.4%)


✅ start-finish-telemetry

Time: ✅ 33.707ms (SLO: <35.450ms -4.9%)

Memory: ✅ 34.111MB (SLO: <39.000MB 📉 -12.5%)


✅ update-name

Time: ✅ 30.859ms (SLO: <33.400ms -7.6%)

Memory: ✅ 34.151MB (SLO: <39.000MB 📉 -12.4%)


🔵 otelspan - 22/22

🔵 No baseline data available for this suite

✅ add-event

Time: ✅ 45.132ms (SLO: <47.150ms -4.3%)

Memory: ✅ 44.405MB (SLO: <46.500MB -4.5%)


✅ add-metrics

Time: ✅ 318.721ms (SLO: <344.800ms -7.6%)

Memory: ✅ 559.284MB (SLO: <562.000MB 🟡 -0.5%)


✅ add-tags

Time: ✅ 289.053ms (SLO: <314.000ms -7.9%)

Memory: ✅ 560.148MB (SLO: <563.500MB 🟡 -0.6%)


✅ get-context

Time: ✅ 86.923ms (SLO: <92.350ms -5.9%)

Memory: ✅ 39.470MB (SLO: <46.500MB 📉 -15.1%)


✅ is-recording

Time: ✅ 43.476ms (SLO: <44.500ms -2.3%)

Memory: ✅ 43.725MB (SLO: <46.500MB -6.0%)


✅ record-exception

Time: ✅ 62.719ms (SLO: <67.650ms -7.3%)

Memory: ✅ 39.755MB (SLO: <46.500MB 📉 -14.5%)


✅ set-status

Time: ✅ 48.996ms (SLO: <50.400ms -2.8%)

Memory: ✅ 43.788MB (SLO: <46.500MB -5.8%)


✅ start

Time: ✅ 42.077ms (SLO: <43.450ms -3.2%)

Memory: ✅ 43.689MB (SLO: <46.500MB -6.0%)


✅ start-finish

Time: ✅ 84.964ms (SLO: <88.000ms -3.4%)

Memory: ✅ 33.817MB (SLO: <46.500MB 📉 -27.3%)


✅ start-finish-telemetry

Time: ✅ 88.004ms (SLO: <89.000ms 🟡 -1.1%)

Memory: ✅ 33.699MB (SLO: <46.500MB 📉 -27.5%)


✅ update-name

Time: ✅ 43.942ms (SLO: <45.150ms -2.7%)

Memory: ✅ 44.014MB (SLO: <46.500MB -5.3%)


🔵 packagespackageforrootmodulemapping - 4/4

🔵 No baseline data available for this suite

✅ cache_off

Time: ✅ 344.046ms (SLO: <354.300ms -2.9%)

Memory: ✅ 36.664MB (SLO: <40.000MB -8.3%)


✅ cache_on

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%)

Memory: ✅ 35.415MB (SLO: <39.000MB -9.2%)


🔵 packagesupdateimporteddependencies - 24/24

🔵 No baseline data available for this suite

✅ import_many

Time: ✅ 154.859µs (SLO: <170.000µs -8.9%)

Memory: ✅ 36.314MB (SLO: <38.500MB -5.7%)


✅ import_many_cached

Time: ✅ 121.245µs (SLO: <130.000µs -6.7%)

Memory: ✅ 36.159MB (SLO: <38.500MB -6.1%)


✅ import_many_stdlib

Time: ✅ 1.606ms (SLO: <1.750ms -8.2%)

Memory: ✅ 35.943MB (SLO: <38.500MB -6.6%)


✅ import_many_stdlib_cached

Time: ✅ 0.961ms (SLO: <1.100ms 📉 -12.6%)

Memory: ✅ 36.074MB (SLO: <38.500MB -6.3%)


✅ import_many_unknown

Time: ✅ 826.287µs (SLO: <890.000µs -7.2%)

Memory: ✅ 35.908MB (SLO: <38.500MB -6.7%)


✅ import_many_unknown_cached

Time: ✅ 788.942µs (SLO: <870.000µs -9.3%)

Memory: ✅ 36.052MB (SLO: <38.500MB -6.4%)


✅ import_one

Time: ✅ 19.816µs (SLO: <30.000µs 📉 -33.9%)

Memory: ✅ 35.783MB (SLO: <39.000MB -8.2%)


✅ import_one_cache

Time: ✅ 6.277µs (SLO: <10.000µs 📉 -37.2%)

Memory: ✅ 35.940MB (SLO: <38.500MB -6.6%)


✅ import_one_stdlib

Time: ✅ 18.705µs (SLO: <20.000µs -6.5%)

Memory: ✅ 35.888MB (SLO: <38.500MB -6.8%)


✅ import_one_stdlib_cache

Time: ✅ 6.272µs (SLO: <10.000µs 📉 -37.3%)

Memory: ✅ 35.789MB (SLO: <38.500MB -7.0%)


✅ import_one_unknown

Time: ✅ 45.278µs (SLO: <50.000µs -9.4%)

Memory: ✅ 35.786MB (SLO: <38.500MB -7.0%)


✅ import_one_unknown_cache

Time: ✅ 6.313µs (SLO: <10.000µs 📉 -36.9%)

Memory: ✅ 35.811MB (SLO: <38.500MB -7.0%)


🔵 ratelimiter - 12/12

🔵 No baseline data available for this suite

✅ defaults

Time: ✅ 2.353µs (SLO: <10.000µs 📉 -76.5%)

Memory: ✅ 30.966MB (SLO: <34.000MB -8.9%)


✅ high_rate_limit

Time: ✅ 2.414µs (SLO: <10.000µs 📉 -75.9%)

Memory: ✅ 30.907MB (SLO: <34.000MB -9.1%)


✅ long_window

Time: ✅ 2.346µs (SLO: <10.000µs 📉 -76.5%)

Memory: ✅ 30.887MB (SLO: <34.000MB -9.2%)


✅ low_rate_limit

Time: ✅ 2.355µs (SLO: <10.000µs 📉 -76.5%)

Memory: ✅ 30.966MB (SLO: <34.000MB -8.9%)


✅ no_rate_limit

Time: ✅ 0.822µs (SLO: <10.000µs 📉 -91.8%)

Memory: ✅ 31.005MB (SLO: <34.000MB -8.8%)


✅ short_window

Time: ✅ 2.476µs (SLO: <10.000µs 📉 -75.2%)

Memory: ✅ 30.966MB (SLO: <34.000MB -8.9%)


🔵 recursivecomputation - 8/8

🔵 No baseline data available for this suite

✅ deep

Time: ✅ 309.458ms (SLO: <320.950ms -3.6%)

Memory: ✅ 32.342MB (SLO: <34.500MB -6.3%)


✅ deep-profiled

Time: ✅ 328.820ms (SLO: <359.150ms -8.4%)

Memory: ✅ 35.016MB (SLO: <39.000MB 📉 -10.2%)


✅ medium

Time: ✅ 7.070ms (SLO: <7.400ms -4.5%)

Memory: ✅ 31.261MB (SLO: <34.000MB -8.1%)


✅ shallow

Time: ✅ 0.954ms (SLO: <1.050ms -9.1%)

Memory: ✅ 31.280MB (SLO: <34.000MB -8.0%)


🔵 samplingrules - 8/8

🔵 No baseline data available for this suite

✅ average_match

Time: ✅ 274.497µs (SLO: <290.000µs -5.3%)

Memory: ✅ 31.320MB (SLO: <34.000MB -7.9%)


✅ high_match

Time: ✅ 449.253µs (SLO: <480.000µs -6.4%)

Memory: ✅ 31.241MB (SLO: <34.000MB -8.1%)


✅ low_match

Time: ✅ 110.320µs (SLO: <120.000µs -8.1%)

Memory: ✅ 433.953MB (SLO: <450.000MB -3.6%)


✅ very_low_match

Time: ✅ 7.703ms (SLO: <8.500ms -9.4%)

Memory: ✅ 56.955MB (SLO: <60.000MB -5.1%)


🔵 sethttpmeta - 32/32

🔵 No baseline data available for this suite

✅ all-disabled

Time: ✅ 12.272µs (SLO: <20.000µs 📉 -38.6%)

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%)


✅ all-enabled

Time: ✅ 42.021µs (SLO: <50.000µs 📉 -16.0%)

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%)


✅ collectipvariant_exists

Time: ✅ 42.686µs (SLO: <50.000µs 📉 -14.6%)

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%)


✅ no-collectipvariant

Time: ✅ 41.899µs (SLO: <50.000µs 📉 -16.2%)

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%)


✅ no-useragentvariant

Time: ✅ 40.797µs (SLO: <50.000µs 📉 -18.4%)

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%)


✅ obfuscation-no-query

Time: ✅ 43.176µs (SLO: <50.000µs 📉 -13.6%)

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%)


✅ obfuscation-regular-case-explicit-query

Time: ✅ 78.592µs (SLO: <90.000µs 📉 -12.7%)

Memory: ✅ 32.224MB (SLO: <34.000MB -5.2%)


✅ obfuscation-regular-case-implicit-query

Time: ✅ 79.680µs (SLO: <90.000µs 📉 -11.5%)

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%)


✅ obfuscation-send-querystring-disabled

Time: ✅ 157.301µs (SLO: <170.000µs -7.5%)

Memory: ✅ 32.185MB (SLO: <34.500MB -6.7%)


✅ obfuscation-worst-case-explicit-query

Time: ✅ 151.417µs (SLO: <160.000µs -5.4%)

Memory: ✅ 32.185MB (SLO: <34.500MB -6.7%)


✅ obfuscation-worst-case-implicit-query

Time: ✅ 158.001µs (SLO: <170.000µs -7.1%)

Memory: ✅ 32.204MB (SLO: <34.500MB -6.7%)


✅ useragentvariant_exists_1

Time: ✅ 41.520µs (SLO: <50.000µs 📉 -17.0%)

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%)


✅ useragentvariant_exists_2

Time: ✅ 43.008µs (SLO: <50.000µs 📉 -14.0%)

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%)


✅ useragentvariant_exists_3

Time: ✅ 42.102µs (SLO: <50.000µs 📉 -15.8%)

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%)


✅ useragentvariant_not_exists_1

Time: ✅ 41.531µs (SLO: <50.000µs 📉 -16.9%)

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%)


✅ useragentvariant_not_exists_2

Time: ✅ 41.771µs (SLO: <50.000µs 📉 -16.5%)

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%)


🔵 span - 26/26

🔵 No baseline data available for this suite

✅ add-event

Time: ✅ 24.109ms (SLO: <26.200ms -8.0%)

Memory: ✅ 50.564MB (SLO: <53.000MB -4.6%)


✅ add-metrics

Time: ✅ 91.711ms (SLO: <98.350ms -6.8%)

Memory: ✅ 614.539MB (SLO: <961.000MB 📉 -36.1%)


✅ add-tags

Time: ✅ 150.365ms (SLO: <168.550ms 📉 -10.8%)

Memory: ✅ 615.828MB (SLO: <962.500MB 📉 -36.0%)


✅ get-context

Time: ✅ 22.750ms (SLO: <23.700ms -4.0%)

Memory: ✅ 49.469MB (SLO: <53.000MB -6.7%)


✅ is-recording

Time: ✅ 22.646ms (SLO: <23.900ms -5.2%)

Memory: ✅ 49.398MB (SLO: <53.000MB -6.8%)


✅ record-exception

Time: ✅ 43.208ms (SLO: <44.500ms -2.9%)

Memory: ✅ 42.447MB (SLO: <53.000MB 📉 -19.9%)


✅ set-status

Time: ✅ 24.293ms (SLO: <26.000ms -6.6%)

Memory: ✅ 49.498MB (SLO: <53.000MB -6.6%)


✅ start

Time: ✅ 22.278ms (SLO: <23.500ms -5.2%)

Memory: ✅ 49.491MB (SLO: <53.000MB -6.6%)


✅ start-finish

Time: ✅ 54.527ms (SLO: <55.500ms 🟡 -1.8%)

Memory: ✅ 31.261MB (SLO: <34.000MB -8.1%)


✅ start-finish-telemetry

Time: ✅ 55.605ms (SLO: <58.300ms -4.6%)

Memory: ✅ 31.221MB (SLO: <34.000MB -8.2%)


✅ start-finish-traceid128

Time: ✅ 57.424ms (SLO: <60.050ms -4.4%)

Memory: ✅ 31.280MB (SLO: <34.000MB -8.0%)


✅ start-traceid128

Time: ✅ 22.692ms (SLO: <24.600ms -7.8%)

Memory: ✅ 49.475MB (SLO: <53.000MB -6.7%)


✅ update-name

Time: ✅ 23.135ms (SLO: <24.100ms -4.0%)

Memory: ✅ 50.137MB (SLO: <53.000MB -5.4%)


🔵 telemetryaddmetric - 30/30

🔵 No baseline data available for this suite

✅ 1-count-metric-1-times

Time: ✅ 3.256µs (SLO: <10.000µs 📉 -67.4%)

Memory: ✅ 31.359MB (SLO: <34.000MB -7.8%)


✅ 1-count-metrics-100-times

Time: ✅ 218.511µs (SLO: <240.000µs -9.0%)

Memory: ✅ 31.320MB (SLO: <34.000MB -7.9%)


✅ 1-distribution-metric-1-times

Time: ✅ 3.006µs (SLO: <10.000µs 📉 -69.9%)

Memory: ✅ 31.300MB (SLO: <34.000MB -7.9%)


✅ 1-distribution-metrics-100-times

Time: ✅ 201.076µs (SLO: <210.000µs -4.2%)

Memory: ✅ 31.280MB (SLO: <34.000MB -8.0%)


✅ 1-gauge-metric-1-times

Time: ✅ 2.149µs (SLO: <10.000µs 📉 -78.5%)

Memory: ✅ 31.261MB (SLO: <34.000MB -8.1%)


✅ 1-gauge-metrics-100-times

Time: ✅ 125.150µs (SLO: <140.000µs 📉 -10.6%)

Memory: ✅ 31.261MB (SLO: <34.000MB -8.1%)


✅ 1-rate-metric-1-times

Time: ✅ 3.243µs (SLO: <10.000µs 📉 -67.6%)

Memory: ✅ 31.280MB (SLO: <34.000MB -8.0%)


✅ 1-rate-metrics-100-times

Time: ✅ 219.165µs (SLO: <240.000µs -8.7%)

Memory: ✅ 31.241MB (SLO: <34.000MB -8.1%)


✅ 100-count-metrics-100-times

Time: ✅ 21.912ms (SLO: <22.500ms -2.6%)

Memory: ✅ 31.202MB (SLO: <34.000MB -8.2%)


✅ 100-distribution-metrics-100-times

Time: ✅ 2.079ms (SLO: <2.100ms 🟡 -1.0%)

Memory: ✅ 31.182MB (SLO: <34.000MB -8.3%)


✅ 100-gauge-metrics-100-times

Time: ✅ 1.290ms (SLO: <1.400ms -7.9%)

Memory: ✅ 31.241MB (SLO: <34.000MB -8.1%)


✅ 100-rate-metrics-100-times

Time: ✅ 2.252ms (SLO: <2.400ms -6.2%)

Memory: ✅ 31.280MB (SLO: <34.000MB -8.0%)


✅ flush-1-metric

Time: ✅ 4.300µs (SLO: <10.000µs 📉 -57.0%)

Memory: ✅ 31.280MB (SLO: <34.000MB -8.0%)


✅ flush-100-metrics

Time: ✅ 185.541µs (SLO: <200.000µs -7.2%)

Memory: ✅ 31.379MB (SLO: <34.000MB -7.7%)


✅ flush-1000-metrics

Time: ✅ 2.207ms (SLO: <2.350ms -6.1%)

Memory: ✅ 32.440MB (SLO: <34.500MB -6.0%)


🔵 tracer - 6/6

🔵 No baseline data available for this suite

✅ large

Time: ✅ 29.902ms (SLO: <32.950ms -9.3%)

Memory: ✅ 32.362MB (SLO: <34.500MB -6.2%)


✅ medium

Time: ✅ 2.943ms (SLO: <3.200ms -8.0%)

Memory: ✅ 31.221MB (SLO: <34.000MB -8.2%)


✅ small

Time: ✅ 336.238µs (SLO: <370.000µs -9.1%)

Memory: ✅ 31.221MB (SLO: <34.000MB -8.2%)

@taegyunkim taegyunkim marked this pull request as ready for review September 3, 2025 17:15
@taegyunkim taegyunkim requested review from a team as code owners September 3, 2025 17:15
@taegyunkim taegyunkim changed the title ci: cherry-pick backports to unblock 3.12 branch ci ci: cherry-pick commits to unblock 3.12 branch ci Sep 3, 2025
@erikayasuda erikayasuda merged commit f603a3b into 3.12 Sep 3, 2025
891 of 899 checks passed
@erikayasuda erikayasuda deleted the taegyunkim/3-12-system-tests branch September 3, 2025 18:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR. CI MLObs ML Observability (LLMObs)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants