fix(llmobs): safely output format bedrock cohere rerank spans #15124

Yun-Kim · 2025-11-03T17:37:57Z

Description

Adds safely accessing output response messages in the bedrock integration. This happens when cohere rerank models are invoked, since cohere rerank responses lack a response["text"] field and will return an empty list.

Testing

Added a test invoking cohere rerank models.

Risks

Additional Notes

github-actions · 2025-11-03T17:38:34Z

CODEOWNERS have been resolved as:

releasenotes/notes/fix-bedrock-llmobs-cohere-a1bcb48e9b252d77.yaml      @DataDog/apm-python
tests/contrib/botocore/bedrock_cassettes/cohere_rerank_invoke.yaml      @DataDog/ml-observability
ddtrace/llmobs/_integrations/bedrock.py                                 @DataDog/ml-observability
tests/contrib/botocore/test_bedrock_llmobs.py                           @DataDog/ml-observability

github-actions · 2025-11-03T18:04:16Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 244 ± 4 ms.

The average import time from base is: 246 ± 5 ms.

The import time difference between this PR and base is: -2.0 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.986 ms (0.81%)

ddtrace.bootstrap.sitecustomize 1.301 ms (0.53%)

ddtrace.bootstrap.preload 1.301 ms (0.53%)

ddtrace.internal.remoteconfig.client 0.642 ms (0.26%)

ddtrace 0.685 ms (0.28%)

ddtrace.internal._unpatched 0.029 ms (0.01%)

json 0.029 ms (0.01%)

json.decoder 0.029 ms (0.01%)

re 0.029 ms (0.01%)

enum 0.029 ms (0.01%)

types 0.029 ms (0.01%)

pr-commenter · 2025-11-03T18:34:24Z

Performance SLOs

Comparing candidate yunkim/fix-cohere-bedrock (0dc9937) with baseline main (b2d11f1)

📈 Performance Regressions (2 suites)

📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.3%

Memory: ✅ 37.867MB (SLO: <39.000MB -2.9%) vs baseline: +5.1%

✅ add_inplace_aspect

Time: ✅ 0.408µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.1%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +5.1%

✅ add_inplace_noaspect

Time: ✅ 0.319µs (SLO: <10.000µs 📉 -96.8%) vs baseline: -1.2%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ add_noaspect

Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.8%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ bytearray_aspect

Time: ✅ 1.319µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.3%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +4.6%

✅ bytearray_extend_aspect

Time: ✅ 1.568µs (SLO: <10.000µs 📉 -84.3%) vs baseline: +0.8%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ bytearray_extend_noaspect

Time: ✅ 0.615µs (SLO: <10.000µs 📉 -93.9%) vs baseline: ~same

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

✅ bytearray_noaspect

Time: ✅ 0.482µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +0.6%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.5%

✅ bytes_aspect

Time: ✅ 1.275µs (SLO: <10.000µs 📉 -87.2%) vs baseline: +1.3%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +5.0%

✅ bytes_noaspect

Time: ✅ 0.492µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.3%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ bytesio_aspect

Time: ✅ 1.337µs (SLO: <10.000µs 📉 -86.6%) vs baseline: +1.8%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ bytesio_noaspect

Time: ✅ 0.497µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.6%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ capitalize_aspect

Time: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.4%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ capitalize_noaspect

Time: ✅ 0.434µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -0.4%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

✅ casefold_aspect

Time: ✅ 0.737µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.3%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

✅ casefold_noaspect

Time: ✅ 0.374µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.6%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ decode_aspect

Time: ✅ 0.735µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +1.5%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ decode_noaspect

Time: ✅ 0.420µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.4%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.6%

✅ encode_aspect

Time: ✅ 0.711µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.2%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +5.1%

✅ encode_noaspect

Time: ✅ 0.403µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.3%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ format_aspect

Time: ✅ 3.522µs (SLO: <10.000µs 📉 -64.8%) vs baseline: +3.9%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +4.9%

✅ format_map_aspect

Time: ✅ 3.674µs (SLO: <10.000µs 📉 -63.3%) vs baseline: -0.7%

Memory: ✅ 37.867MB (SLO: <39.000MB -2.9%) vs baseline: +4.9%

✅ format_map_noaspect

Time: ✅ 0.775µs (SLO: <10.000µs 📉 -92.3%) vs baseline: -0.2%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ format_noaspect

Time: ✅ 0.592µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.4%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ index_aspect

Time: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.9%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ index_noaspect

Time: ✅ 0.276µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -1.1%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.8%

✅ join_aspect

Time: ✅ 1.363µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +0.2%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ join_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.1%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.8%

✅ ljust_aspect

Time: ✅ 2.540µs (SLO: <20.000µs 📉 -87.3%) vs baseline: -0.9%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ ljust_noaspect

Time: ✅ 0.403µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.8%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ lower_aspect

Time: ✅ 2.199µs (SLO: <10.000µs 📉 -78.0%) vs baseline: ~same

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.7%

✅ lower_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.4%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +5.0%

✅ lstrip_aspect

Time: ✅ 2.471µs (SLO: <20.000µs 📉 -87.6%) vs baseline: 📈 +10.9%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.8%

✅ lstrip_noaspect

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.4%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ modulo_aspect

Time: ✅ 1.046µs (SLO: <10.000µs 📉 -89.5%) vs baseline: ~same

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +5.0%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.579µs (SLO: <10.000µs 📉 -84.2%) vs baseline: -1.1%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +5.0%

✅ modulo_aspect_for_bytes

Time: ✅ 0.983µs (SLO: <10.000µs 📉 -90.2%) vs baseline: -0.5%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.6%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.290µs (SLO: <10.000µs 📉 -87.1%) vs baseline: +1.1%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.7%

✅ modulo_noaspect

Time: ✅ 0.628µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.5%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +5.0%

✅ replace_aspect

Time: ✅ 4.941µs (SLO: <10.000µs 📉 -50.6%) vs baseline: +0.8%

Memory: ✅ 37.886MB (SLO: <39.000MB -2.9%) vs baseline: +5.0%

✅ replace_noaspect

Time: ✅ 0.462µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.4%

Memory: ✅ 37.886MB (SLO: <39.000MB -2.9%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 0.914µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.2%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ repr_noaspect

Time: ✅ 0.415µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.2%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ rstrip_aspect

Time: ✅ 1.916µs (SLO: <20.000µs 📉 -90.4%) vs baseline: +0.7%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

✅ rstrip_noaspect

Time: ✅ 0.379µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.9%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +4.7%

✅ slice_aspect

Time: ✅ 0.497µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.6%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +4.7%

✅ slice_noaspect

Time: ✅ 0.451µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.8%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ stringio_aspect

Time: ✅ 1.562µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +1.0%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.8%

✅ stringio_noaspect

Time: ✅ 0.713µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.5%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +5.0%

✅ strip_aspect

Time: ✅ 2.492µs (SLO: <20.000µs 📉 -87.5%) vs baseline: 📈 +13.1%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.8%

✅ strip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.4%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.6%

✅ swapcase_aspect

Time: ✅ 2.440µs (SLO: <10.000µs 📉 -75.6%) vs baseline: +1.7%

Memory: ✅ 37.867MB (SLO: <39.000MB -2.9%) vs baseline: +5.1%

✅ swapcase_noaspect

Time: ✅ 0.531µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -0.7%

Memory: ✅ 37.847MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ title_aspect

Time: ✅ 2.421µs (SLO: <10.000µs 📉 -75.8%) vs baseline: +3.8%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

✅ title_noaspect

Time: ✅ 0.502µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.9%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.6%

✅ translate_aspect

Time: ✅ 3.429µs (SLO: <10.000µs 📉 -65.7%) vs baseline: +6.1%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.8%

✅ translate_noaspect

Time: ✅ 1.041µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.3%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.9%

✅ upper_aspect

Time: ✅ 2.222µs (SLO: <10.000µs 📉 -77.8%) vs baseline: +0.4%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

✅ upper_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: ~same

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.118µs (SLO: <10.000µs 📉 -48.8%) vs baseline: 📈 +20.0%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%

✅ ospathbasename_noaspect

Time: ✅ 1.101µs (SLO: <10.000µs 📉 -89.0%) vs baseline: +1.1%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%

✅ ospathjoin_aspect

Time: ✅ 6.988µs (SLO: <10.000µs 📉 -30.1%) vs baseline: 📈 +14.3%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.7%

✅ ospathjoin_noaspect

Time: ✅ 2.316µs (SLO: <10.000µs 📉 -76.8%) vs baseline: +0.9%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.3%

✅ ospathnormcase_aspect

Time: ✅ 3.798µs (SLO: <10.000µs 📉 -62.0%) vs baseline: +7.2%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.7%

✅ ospathnormcase_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.5%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%

✅ ospathsplit_aspect

Time: ✅ 5.984µs (SLO: <10.000µs 📉 -40.2%) vs baseline: 📈 +24.1%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%

✅ ospathsplit_noaspect

Time: ✅ 1.612µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +1.0%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.8%

✅ ospathsplitdrive_aspect

Time: ✅ 4.335µs (SLO: <10.000µs 📉 -56.6%) vs baseline: 📈 +17.2%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +4.8%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.705µs (SLO: <10.000µs 📉 -92.9%) vs baseline: ~same

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.8%

✅ ospathsplitext_aspect

Time: ✅ 4.554µs (SLO: <10.000µs 📉 -54.5%) vs baseline: -0.8%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.8%

✅ ospathsplitext_noaspect

Time: ✅ 1.386µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +1.1%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%

🟡 Near SLO Breach (4 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.402ms (SLO: <22.300ms -8.5%) vs baseline: ~same

Memory: ✅ 66.119MB (SLO: <67.000MB 🟡 -1.3%) vs baseline: +4.9%

✅ exception-replay-enabled

Time: ✅ 1.340ms (SLO: <1.450ms -7.6%) vs baseline: -0.3%

Memory: ✅ 64.077MB (SLO: <67.000MB -4.4%) vs baseline: +4.7%

✅ iast

Time: ✅ 20.479ms (SLO: <22.250ms -8.0%) vs baseline: ~same

Memory: ✅ 66.139MB (SLO: <67.000MB 🟡 -1.3%) vs baseline: +4.9%

✅ profiler

Time: ✅ 15.606ms (SLO: <16.550ms -5.7%) vs baseline: ~same

Memory: ✅ 53.838MB (SLO: <54.500MB 🟡 -1.2%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 20.591ms (SLO: <21.750ms -5.3%) vs baseline: +0.2%

Memory: ✅ 66.060MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 25.361ms (SLO: <28.200ms 📉 -10.1%) vs baseline: -0.2%

Memory: ✅ 67.227MB (SLO: <69.500MB -3.3%) vs baseline: +5.0%

✅ tracer

Time: ✅ 20.435ms (SLO: <21.750ms -6.0%) vs baseline: ~same

Memory: ✅ 66.100MB (SLO: <67.000MB 🟡 -1.3%) vs baseline: +4.9%

✅ tracer-and-profiler

Time: ✅ 22.699ms (SLO: <23.500ms -3.4%) vs baseline: ~same

Memory: ✅ 67.358MB (SLO: <68.000MB 🟡 -0.9%) vs baseline: +4.8%

✅ tracer-dont-create-db-spans

Time: ✅ 19.329ms (SLO: <21.500ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 66.041MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.8%

✅ tracer-minimal

Time: ✅ 16.597ms (SLO: <17.500ms -5.2%) vs baseline: +0.4%

Memory: ✅ 65.622MB (SLO: <67.000MB -2.1%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 20.435ms (SLO: <21.750ms -6.0%) vs baseline: -0.3%

Memory: ✅ 71.472MB (SLO: <72.500MB 🟡 -1.4%) vs baseline: +4.8%

✅ tracer-no-caches

Time: ✅ 18.468ms (SLO: <19.650ms -6.0%) vs baseline: ~same

Memory: ✅ 65.746MB (SLO: <67.000MB 🟡 -1.9%) vs baseline: +4.4%

✅ tracer-no-databases

Time: ✅ 18.791ms (SLO: <20.100ms -6.5%) vs baseline: +0.2%

Memory: ✅ 65.628MB (SLO: <67.000MB -2.0%) vs baseline: +4.7%

✅ tracer-no-middleware

Time: ✅ 20.212ms (SLO: <21.500ms -6.0%) vs baseline: +0.3%

Memory: ✅ 66.080MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.9%

✅ tracer-no-templates

Time: ✅ 20.335ms (SLO: <22.000ms -7.6%) vs baseline: +0.3%

Memory: ✅ 66.055MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.9%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.077ms (SLO: <19.850ms -8.9%) vs baseline: ~same

Memory: ✅ 65.757MB (SLO: <66.500MB 🟡 -1.1%) vs baseline: +5.0%

✅ errortracking-enabled-user

Time: ✅ 18.132ms (SLO: <19.400ms -6.5%) vs baseline: +0.2%

Memory: ✅ 65.765MB (SLO: <66.500MB 🟡 -1.1%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 18.108ms (SLO: <19.450ms -6.9%) vs baseline: ~same

Memory: ✅ 65.628MB (SLO: <66.500MB 🟡 -1.3%) vs baseline: +4.8%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.596ms (SLO: <4.750ms -3.2%) vs baseline: +0.3%

Memory: ✅ 62.351MB (SLO: <65.000MB -4.1%) vs baseline: +4.9%

✅ appsec-post

Time: ✅ 6.637ms (SLO: <6.750ms 🟡 -1.7%) vs baseline: ~same

Memory: ✅ 62.174MB (SLO: <65.000MB -4.3%) vs baseline: +4.7%

✅ appsec-telemetry

Time: ✅ 4.597ms (SLO: <4.750ms -3.2%) vs baseline: ~same

Memory: ✅ 62.248MB (SLO: <65.000MB -4.2%) vs baseline: +4.7%

✅ debugger

Time: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: ~same

Memory: ✅ 45.147MB (SLO: <47.000MB -3.9%) vs baseline: +4.8%

✅ iast-get

Time: ✅ 1.878ms (SLO: <2.000ms -6.1%) vs baseline: +1.2%

Memory: ✅ 42.154MB (SLO: <49.000MB 📉 -14.0%) vs baseline: +5.0%

✅ profiler

Time: ✅ 1.913ms (SLO: <2.100ms -8.9%) vs baseline: ~same

Memory: ✅ 46.156MB (SLO: <47.000MB 🟡 -1.8%) vs baseline: +4.6%

✅ resource-renaming

Time: ✅ 3.368ms (SLO: <3.650ms -7.7%) vs baseline: +0.3%

Memory: ✅ 52.561MB (SLO: <53.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.356ms (SLO: <3.650ms -8.1%) vs baseline: ~same

Memory: ✅ 52.524MB (SLO: <53.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 3.352ms (SLO: <3.650ms -8.2%) vs baseline: ~same

Memory: ✅ 58.019MB (SLO: <60.000MB -3.3%) vs baseline: +4.6%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.966ms (SLO: <4.200ms -5.6%) vs baseline: -0.4%

Memory: ✅ 62.226MB (SLO: <66.000MB -5.7%) vs baseline: +4.7%

✅ iast-enabled

Time: ✅ 2.442ms (SLO: <2.800ms 📉 -12.8%) vs baseline: -0.5%

Memory: ✅ 59.061MB (SLO: <60.000MB 🟡 -1.6%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.057ms (SLO: <2.250ms -8.6%) vs baseline: -0.2%

Memory: ✅ 52.455MB (SLO: <54.500MB -3.8%) vs baseline: +4.7%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.246µs (SLO: <20.000µs 📉 -33.8%) vs baseline: -0.2%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%

✅ context_with_data_no_listeners

Time: ✅ 3.274µs (SLO: <10.000µs 📉 -67.3%) vs baseline: ~same

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.6%

✅ get_item_exists

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.4%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%

✅ get_item_missing

Time: ✅ 0.641µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.9%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ set_item

Time: ✅ 23.951µs (SLO: <30.000µs 📉 -20.2%) vs baseline: -1.4%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ All Tests Passing (17 suites)

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.072ms (SLO: <2.300ms -9.9%) vs baseline: +0.5%

Memory: ✅ 52.298MB (SLO: <53.500MB -2.2%) vs baseline: +4.5%

✅ errortracking-enabled-user

Time: ✅ 2.067ms (SLO: <2.250ms -8.1%) vs baseline: +0.4%

Memory: ✅ 52.199MB (SLO: <53.500MB -2.4%) vs baseline: +4.3%

✅ tracer-enabled

Time: ✅ 2.077ms (SLO: <2.300ms -9.7%) vs baseline: +0.6%

Memory: ✅ 52.160MB (SLO: <53.500MB -2.5%) vs baseline: +4.2%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 83.206µs (SLO: <100.000µs 📉 -16.8%) vs baseline: +2.8%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.8%

✅ b3_headers

Time: ✅ 14.170µs (SLO: <20.000µs 📉 -29.1%) vs baseline: ~same

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.8%

✅ b3_single_headers

Time: ✅ 14.096µs (SLO: <20.000µs 📉 -29.5%) vs baseline: +6.0%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +5.3%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 66.382µs (SLO: <80.000µs 📉 -17.0%) vs baseline: +4.0%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.717µs (SLO: <80.000µs 📉 -16.6%) vs baseline: +1.2%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.6%

✅ empty_headers

Time: ✅ 1.603µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.4%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.6%

✅ full_t_id_datadog_headers

Time: ✅ 23.125µs (SLO: <30.000µs 📉 -22.9%) vs baseline: +0.2%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.8%

✅ invalid_priority_header

Time: ✅ 6.570µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.3%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ invalid_span_id_header

Time: ✅ 6.627µs (SLO: <10.000µs 📉 -33.7%) vs baseline: +1.0%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.7%

✅ invalid_tags_header

Time: ✅ 6.540µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.3%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ invalid_trace_id_header

Time: ✅ 6.537µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.3%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.7%

✅ large_header_no_matches

Time: ✅ 27.628µs (SLO: <30.000µs -7.9%) vs baseline: ~same

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +5.0%

✅ large_valid_headers_all

Time: ✅ 28.743µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.3%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +5.1%

✅ medium_header_no_matches

Time: ✅ 9.908µs (SLO: <20.000µs 📉 -50.5%) vs baseline: +0.2%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ medium_valid_headers_all

Time: ✅ 11.260µs (SLO: <20.000µs 📉 -43.7%) vs baseline: -1.0%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +5.1%

✅ none_propagation_style

Time: ✅ 1.703µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -0.8%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.8%

✅ tracecontext_headers

Time: ✅ 35.816µs (SLO: <40.000µs 📉 -10.5%) vs baseline: +3.7%

Memory: ✅ 31.870MB (SLO: <33.500MB -4.9%) vs baseline: +4.6%

✅ valid_headers_all

Time: ✅ 6.641µs (SLO: <10.000µs 📉 -33.6%) vs baseline: +1.4%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ valid_headers_basic

Time: ✅ 6.147µs (SLO: <10.000µs 📉 -38.5%) vs baseline: +0.6%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ wsgi_empty_headers

Time: ✅ 1.591µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.6%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ wsgi_invalid_priority_header

Time: ✅ 6.659µs (SLO: <10.000µs 📉 -33.4%) vs baseline: +1.3%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.589µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.6%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.9%

✅ wsgi_invalid_tags_header

Time: ✅ 6.590µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.6%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.6%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.649µs (SLO: <10.000µs 📉 -33.5%) vs baseline: +1.4%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ wsgi_large_header_no_matches

Time: ✅ 28.789µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +0.3%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.837µs (SLO: <40.000µs 📉 -25.4%) vs baseline: +0.3%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.245µs (SLO: <20.000µs 📉 -48.8%) vs baseline: +1.0%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.5%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.666µs (SLO: <20.000µs 📉 -41.7%) vs baseline: +0.4%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.8%

✅ wsgi_valid_headers_all

Time: ✅ 6.644µs (SLO: <10.000µs 📉 -33.6%) vs baseline: +1.0%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +5.2%

✅ wsgi_valid_headers_basic

Time: ✅ 6.141µs (SLO: <10.000µs 📉 -38.6%) vs baseline: ~same

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 20.983µs (SLO: <30.000µs 📉 -30.1%) vs baseline: +0.2%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.8%

✅ with_all

Time: ✅ 28.367µs (SLO: <40.000µs 📉 -29.1%) vs baseline: -0.2%

Memory: ✅ 32.027MB (SLO: <33.500MB -4.4%) vs baseline: +5.0%

✅ with_dd_origin

Time: ✅ 24.746µs (SLO: <30.000µs 📉 -17.5%) vs baseline: -0.1%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ with_priority_and_origin

Time: ✅ 24.356µs (SLO: <40.000µs 📉 -39.1%) vs baseline: +0.8%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.9%

✅ with_sampling_priority

Time: ✅ 21.132µs (SLO: <30.000µs 📉 -29.6%) vs baseline: +0.5%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.6%

✅ with_tags

Time: ✅ 26.811µs (SLO: <40.000µs 📉 -33.0%) vs baseline: +1.5%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.9%

✅ with_tags_invalid

Time: ✅ 29.613µs (SLO: <40.000µs 📉 -26.0%) vs baseline: +6.0%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ with_tags_max_size

Time: ✅ 27.088µs (SLO: <40.000µs 📉 -32.3%) vs baseline: +0.7%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.5%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 32.335µs (SLO: <40.000µs 📉 -19.2%) vs baseline: +1.0%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.7%

✅ re_expand_noaspect

Time: ✅ 28.629µs (SLO: <40.000µs 📉 -28.4%) vs baseline: ~same

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.6%

✅ re_findall_aspect

Time: ✅ 2.907µs (SLO: <10.000µs 📉 -70.9%) vs baseline: +0.3%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.8%

✅ re_findall_noaspect

Time: ✅ 1.425µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +1.0%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%

✅ re_finditer_aspect

Time: ✅ 4.402µs (SLO: <10.000µs 📉 -56.0%) vs baseline: -0.7%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%

✅ re_finditer_noaspect

Time: ✅ 1.396µs (SLO: <10.000µs 📉 -86.0%) vs baseline: ~same

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%

✅ re_fullmatch_aspect

Time: ✅ 2.622µs (SLO: <10.000µs 📉 -73.8%) vs baseline: -0.6%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.6%

✅ re_fullmatch_noaspect

Time: ✅ 1.310µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +1.7%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.8%

✅ re_group_aspect

Time: ✅ 2.904µs (SLO: <10.000µs 📉 -71.0%) vs baseline: +0.1%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.8%

✅ re_group_noaspect

Time: ✅ 1.598µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.1%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.6%

✅ re_groups_aspect

Time: ✅ 3.034µs (SLO: <10.000µs 📉 -69.7%) vs baseline: ~same

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +4.8%

✅ re_groups_noaspect

Time: ✅ 1.688µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -1.4%

Memory: ✅ 37.356MB (SLO: <39.000MB -4.2%) vs baseline: +4.6%

✅ re_match_aspect

Time: ✅ 2.768µs (SLO: <10.000µs 📉 -72.3%) vs baseline: +3.7%

Memory: ✅ 37.395MB (SLO: <39.000MB -4.1%) vs baseline: +4.7%

✅ re_match_noaspect

Time: ✅ 1.311µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +1.5%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.7%

✅ re_search_aspect

Time: ✅ 2.523µs (SLO: <10.000µs 📉 -74.8%) vs baseline: +0.4%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%

✅ re_search_noaspect

Time: ✅ 1.209µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.3%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +5.0%

✅ re_sub_aspect

Time: ✅ 3.394µs (SLO: <10.000µs 📉 -66.1%) vs baseline: ~same

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.7%

✅ re_sub_noaspect

Time: ✅ 1.542µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +0.5%

Memory: ✅ 37.434MB (SLO: <39.000MB -4.0%) vs baseline: +5.0%

✅ re_subn_aspect

Time: ✅ 3.814µs (SLO: <10.000µs 📉 -61.9%) vs baseline: +3.0%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.7%

✅ re_subn_noaspect

Time: ✅ 1.608µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.2%

Memory: ✅ 37.375MB (SLO: <39.000MB -4.2%) vs baseline: +4.6%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.496µs (SLO: <10.000µs 📉 -85.0%) vs baseline: +3.4%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.8%

✅ rsplit_noaspect

Time: ✅ 0.588µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +1.7%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%

✅ split_aspect

Time: ✅ 1.423µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +1.1%

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +4.9%

✅ split_noaspect

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +1.0%

Memory: ✅ 37.473MB (SLO: <39.000MB -3.9%) vs baseline: +5.0%

✅ splitlines_aspect

Time: ✅ 1.406µs (SLO: <10.000µs 📉 -85.9%) vs baseline: ~same

Memory: ✅ 37.454MB (SLO: <39.000MB -4.0%) vs baseline: +5.1%

✅ splitlines_noaspect

Time: ✅ 0.583µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.2%

Memory: ✅ 37.415MB (SLO: <39.000MB -4.1%) vs baseline: +4.9%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 48.895µs (SLO: <60.000µs 📉 -18.5%) vs baseline: +0.6%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.1%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.605ms (SLO: <42.000ms -3.3%) vs baseline: +0.4%

Memory: ✅ 34.308MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +4.7%

✅ add-link

Time: ✅ 36.383ms (SLO: <38.550ms -5.6%) vs baseline: +0.5%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 219.985ms (SLO: <232.000ms -5.2%) vs baseline: +0.6%

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.4%

✅ add-tags

Time: ✅ 211.944ms (SLO: <221.600ms -4.4%) vs baseline: -0.5%

Memory: ✅ 34.328MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +4.8%

✅ get-context

Time: ✅ 29.125ms (SLO: <31.300ms -6.9%) vs baseline: -0.3%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +5.0%

✅ is-recording

Time: ✅ 29.114ms (SLO: <31.000ms -6.1%) vs baseline: -0.3%

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 63.200ms (SLO: <65.850ms -4.0%) vs baseline: -0.4%

Memory: ✅ 34.406MB (SLO: <39.000MB 📉 -11.8%) vs baseline: +5.0%

✅ set-status

Time: ✅ 31.993ms (SLO: <34.150ms -6.3%) vs baseline: ~same

Memory: ✅ 34.328MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +4.7%

✅ start

Time: ✅ 29.020ms (SLO: <30.150ms -3.7%) vs baseline: +0.2%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 33.989ms (SLO: <35.350ms -3.9%) vs baseline: +0.4%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 34.172ms (SLO: <35.450ms -3.6%) vs baseline: +0.9%

Memory: ✅ 34.367MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +5.1%

✅ update-name

Time: ✅ 31.114ms (SLO: <33.400ms -6.8%) vs baseline: +0.5%

Memory: ✅ 34.328MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +4.9%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 40.013ms (SLO: <47.150ms 📉 -15.1%) vs baseline: ~same

Memory: ✅ 43.544MB (SLO: <47.000MB -7.4%) vs baseline: +5.0%

✅ add-metrics

Time: ✅ 317.845ms (SLO: <344.800ms -7.8%) vs baseline: +0.1%

Memory: ✅ 652.984MB (SLO: <675.000MB -3.3%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 290.166ms (SLO: <314.000ms -7.6%) vs baseline: +0.4%

Memory: ✅ 653.910MB (SLO: <675.000MB -3.1%) vs baseline: +4.8%

✅ get-context

Time: ✅ 80.393ms (SLO: <92.350ms 📉 -12.9%) vs baseline: +0.3%

Memory: ✅ 39.345MB (SLO: <46.500MB 📉 -15.4%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 38.071ms (SLO: <44.500ms 📉 -14.4%) vs baseline: +0.6%

Memory: ✅ 42.993MB (SLO: <47.500MB -9.5%) vs baseline: +5.2%

✅ record-exception

Time: ✅ 58.006ms (SLO: <67.650ms 📉 -14.3%) vs baseline: ~same

Memory: ✅ 39.707MB (SLO: <47.000MB 📉 -15.5%) vs baseline: +4.9%

✅ set-status

Time: ✅ 43.804ms (SLO: <50.400ms 📉 -13.1%) vs baseline: -0.6%

Memory: ✅ 42.951MB (SLO: <47.000MB -8.6%) vs baseline: +4.7%

✅ start

Time: ✅ 37.292ms (SLO: <43.450ms 📉 -14.2%) vs baseline: +0.4%

Memory: ✅ 42.976MB (SLO: <47.000MB -8.6%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 81.560ms (SLO: <88.000ms -7.3%) vs baseline: +0.1%

Memory: ✅ 34.485MB (SLO: <46.500MB 📉 -25.8%) vs baseline: +5.2%

✅ start-finish-telemetry

Time: ✅ 82.999ms (SLO: <89.000ms -6.7%) vs baseline: -0.2%

Memory: ✅ 34.465MB (SLO: <46.500MB 📉 -25.9%) vs baseline: +5.2%

✅ update-name

Time: ✅ 38.755ms (SLO: <45.150ms 📉 -14.2%) vs baseline: -0.1%

Memory: ✅ 43.209MB (SLO: <47.000MB -8.1%) vs baseline: +4.7%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.787ms (SLO: <354.300ms -3.2%) vs baseline: -1.1%

Memory: ✅ 37.966MB (SLO: <40.000MB -5.1%) vs baseline: +3.2%

✅ cache_on

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.3%

Memory: ✅ 37.471MB (SLO: <39.000MB -3.9%) vs baseline: +6.4%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 156.386µs (SLO: <170.000µs -8.0%) vs baseline: +0.7%

Memory: ✅ 37.085MB (SLO: <38.500MB -3.7%) vs baseline: +4.9%

✅ import_many_cached

Time: ✅ 120.717µs (SLO: <130.000µs -7.1%) vs baseline: -0.3%

Memory: ✅ 36.975MB (SLO: <38.500MB -4.0%) vs baseline: +4.6%

✅ import_many_stdlib

Time: ✅ 1.630ms (SLO: <1.750ms -6.9%) vs baseline: +0.3%

Memory: ✅ 36.550MB (SLO: <38.500MB -5.1%) vs baseline: +2.4%

✅ import_many_stdlib_cached

Time: ✅ 0.978ms (SLO: <1.100ms 📉 -11.1%) vs baseline: +0.6%

Memory: ✅ 37.200MB (SLO: <38.500MB -3.4%) vs baseline: +6.3%

✅ import_many_unknown

Time: ✅ 823.952µs (SLO: <890.000µs -7.4%) vs baseline: -1.3%

Memory: ✅ 37.307MB (SLO: <38.500MB -3.1%) vs baseline: +4.9%

✅ import_many_unknown_cached

Time: ✅ 791.562µs (SLO: <870.000µs -9.0%) vs baseline: ~same

Memory: ✅ 37.143MB (SLO: <38.500MB -3.5%) vs baseline: +4.4%

✅ import_one

Time: ✅ 19.779µs (SLO: <30.000µs 📉 -34.1%) vs baseline: ~same

Memory: ✅ 37.076MB (SLO: <39.000MB -4.9%) vs baseline: +4.5%

✅ import_one_cache

Time: ✅ 6.282µs (SLO: <10.000µs 📉 -37.2%) vs baseline: -0.3%

Memory: ✅ 37.051MB (SLO: <38.500MB -3.8%) vs baseline: +5.8%

✅ import_one_stdlib

Time: ✅ 18.672µs (SLO: <20.000µs -6.6%) vs baseline: +0.3%

Memory: ✅ 37.072MB (SLO: <38.500MB -3.7%) vs baseline: +5.8%

✅ import_one_stdlib_cache

Time: ✅ 6.231µs (SLO: <10.000µs 📉 -37.7%) vs baseline: ~same

Memory: ✅ 37.142MB (SLO: <38.500MB -3.5%) vs baseline: +4.7%

✅ import_one_unknown

Time: ✅ 45.209µs (SLO: <50.000µs -9.6%) vs baseline: -0.2%

Memory: ✅ 36.942MB (SLO: <38.500MB -4.0%) vs baseline: +4.6%

✅ import_one_unknown_cache

Time: ✅ 6.273µs (SLO: <10.000µs 📉 -37.3%) vs baseline: ~same

Memory: ✅ 37.065MB (SLO: <38.500MB -3.7%) vs baseline: +4.9%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.363µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.2%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.7%

✅ high_rate_limit

Time: ✅ 2.404µs (SLO: <10.000µs 📉 -76.0%) vs baseline: +0.2%

Memory: ✅ 31.438MB (SLO: <34.000MB -7.5%) vs baseline: +4.9%

✅ long_window

Time: ✅ 2.342µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.6%

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%

✅ low_rate_limit

Time: ✅ 2.343µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.1%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.9%

✅ no_rate_limit

Time: ✅ 0.825µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.4%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +5.1%

✅ short_window

Time: ✅ 2.472µs (SLO: <10.000µs 📉 -75.3%) vs baseline: -1.2%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.9%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 308.484ms (SLO: <320.950ms -3.9%) vs baseline: ~same

Memory: ✅ 32.696MB (SLO: <34.500MB -5.2%) vs baseline: +4.9%

✅ deep-profiled

Time: ✅ 327.958ms (SLO: <359.150ms -8.7%) vs baseline: +0.3%

Memory: ✅ 37.327MB (SLO: <39.000MB -4.3%) vs baseline: +5.2%

✅ medium

Time: ✅ 7.031ms (SLO: <7.400ms -5.0%) vs baseline: ~same

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.9%

✅ shallow

Time: ✅ 0.944ms (SLO: <1.050ms 📉 -10.1%) vs baseline: +0.4%

Memory: ✅ 31.929MB (SLO: <34.000MB -6.1%) vs baseline: +4.9%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 137.292µs (SLO: <290.000µs 📉 -52.7%) vs baseline: ~same

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%

✅ high_match

Time: ✅ 174.530µs (SLO: <480.000µs 📉 -63.6%) vs baseline: +1.5%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.8%

✅ low_match

Time: ✅ 100.021µs (SLO: <120.000µs 📉 -16.6%) vs baseline: ~same

Memory: ✅ 600.574MB (SLO: <700.000MB 📉 -14.2%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.657ms (SLO: <8.500ms 📉 -68.7%) vs baseline: -0.3%

Memory: ✅ 67.920MB (SLO: <75.000MB -9.4%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.482µs (SLO: <20.000µs 📉 -47.6%) vs baseline: ~same

Memory: ✅ 32.440MB (SLO: <34.000MB -4.6%) vs baseline: +5.0%

✅ all-enabled

Time: ✅ 40.238µs (SLO: <50.000µs 📉 -19.5%) vs baseline: +1.1%

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.5%

✅ collectipvariant_exists

Time: ✅ 40.846µs (SLO: <50.000µs 📉 -18.3%) vs baseline: +0.4%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.5%

✅ no-collectipvariant

Time: ✅ 40.226µs (SLO: <50.000µs 📉 -19.5%) vs baseline: +0.4%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.9%

✅ no-useragentvariant

Time: ✅ 39.558µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +2.2%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.8%

✅ obfuscation-no-query

Time: ✅ 40.547µs (SLO: <50.000µs 📉 -18.9%) vs baseline: -0.2%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.930µs (SLO: <90.000µs 📉 -15.6%) vs baseline: +0.3%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +3.7%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.577µs (SLO: <90.000µs 📉 -14.9%) vs baseline: +0.3%

Memory: ✅ 32.381MB (SLO: <34.000MB -4.8%) vs baseline: +4.9%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.327µs (SLO: <170.000µs -9.2%) vs baseline: +0.2%

Memory: ✅ 32.735MB (SLO: <34.500MB -5.1%) vs baseline: +4.7%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.533µs (SLO: <160.000µs -7.2%) vs baseline: +0.2%

Memory: ✅ 32.834MB (SLO: <34.500MB -4.8%) vs baseline: +5.2%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.155µs (SLO: <170.000µs -8.7%) vs baseline: +0.4%

Memory: ✅ 32.794MB (SLO: <34.500MB -4.9%) vs baseline: +4.9%

✅ useragentvariant_exists_1

Time: ✅ 39.802µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +1.0%

Memory: ✅ 32.440MB (SLO: <34.000MB -4.6%) vs baseline: +5.0%

✅ useragentvariant_exists_2

Time: ✅ 41.096µs (SLO: <50.000µs 📉 -17.8%) vs baseline: +1.3%

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.5%

✅ useragentvariant_exists_3

Time: ✅ 40.192µs (SLO: <50.000µs 📉 -19.6%) vs baseline: +0.3%

Memory: ✅ 32.322MB (SLO: <34.000MB -4.9%) vs baseline: +4.5%

✅ useragentvariant_not_exists_1

Time: ✅ 39.669µs (SLO: <50.000µs 📉 -20.7%) vs baseline: +0.8%

Memory: ✅ 32.342MB (SLO: <34.000MB -4.9%) vs baseline: +4.7%

✅ useragentvariant_not_exists_2

Time: ✅ 39.770µs (SLO: <50.000µs 📉 -20.5%) vs baseline: +0.6%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.8%

✅ span - 26/26

✅ add-event

Time: ✅ 19.985ms (SLO: <22.500ms 📉 -11.2%) vs baseline: +0.2%

Memory: ✅ 48.302MB (SLO: <53.000MB -8.9%) vs baseline: +4.4%

✅ add-metrics

Time: ✅ 90.026ms (SLO: <93.500ms -3.7%) vs baseline: +0.7%

Memory: ✅ 735.338MB (SLO: <961.000MB 📉 -23.5%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 146.346ms (SLO: <155.000ms -5.6%) vs baseline: -0.7%

Memory: ✅ 736.425MB (SLO: <962.500MB 📉 -23.5%) vs baseline: +5.0%

✅ get-context

Time: ✅ 18.721ms (SLO: <20.500ms -8.7%) vs baseline: +2.1%

Memory: ✅ 47.240MB (SLO: <53.000MB 📉 -10.9%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 18.460ms (SLO: <20.500ms -10.0%) vs baseline: -0.3%

Memory: ✅ 47.281MB (SLO: <53.000MB 📉 -10.8%) vs baseline: +5.0%

✅ record-exception

Time: ✅ 37.498ms (SLO: <40.000ms -6.3%) vs baseline: +0.3%

Memory: ✅ 41.572MB (SLO: <53.000MB 📉 -21.6%) vs baseline: +4.8%

✅ set-status

Time: ✅ 20.056ms (SLO: <22.000ms -8.8%) vs baseline: -0.5%

Memory: ✅ 47.277MB (SLO: <53.000MB 📉 -10.8%) vs baseline: +4.9%

✅ start

Time: ✅ 18.271ms (SLO: <20.500ms 📉 -10.9%) vs baseline: +0.6%

Memory: ✅ 47.254MB (SLO: <53.000MB 📉 -10.8%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 50.392ms (SLO: <52.500ms -4.0%) vs baseline: -0.4%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.8%

✅ start-finish-telemetry

Time: ✅ 52.058ms (SLO: <54.500ms -4.5%) vs baseline: ~same

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.9%

✅ start-finish-traceid128

Time: ✅ 53.449ms (SLO: <57.000ms -6.2%) vs baseline: -0.2%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.8%

✅ start-traceid128

Time: ✅ 18.644ms (SLO: <22.500ms 📉 -17.1%) vs baseline: +0.4%

Memory: ✅ 47.209MB (SLO: <53.000MB 📉 -10.9%) vs baseline: +4.7%

✅ update-name

Time: ✅ 18.689ms (SLO: <22.000ms 📉 -15.0%) vs baseline: +0.1%

Memory: ✅ 47.849MB (SLO: <53.000MB -9.7%) vs baseline: +4.8%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.971µs (SLO: <20.000µs 📉 -85.1%) vs baseline: +0.5%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +5.0%

✅ 1-count-metrics-100-times

Time: ✅ 199.897µs (SLO: <220.000µs -9.1%) vs baseline: ~same

Memory: ✅ 31.929MB (SLO: <34.000MB -6.1%) vs baseline: +5.0%

✅ 1-distribution-metric-1-times

Time: ✅ 3.255µs (SLO: <20.000µs 📉 -83.7%) vs baseline: -0.3%

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +5.1%

✅ 1-distribution-metrics-100-times

Time: ✅ 212.069µs (SLO: <220.000µs -3.6%) vs baseline: -0.3%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.7%

✅ 1-gauge-metric-1-times

Time: ✅ 2.197µs (SLO: <20.000µs 📉 -89.0%) vs baseline: +0.7%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.7%

✅ 1-gauge-metrics-100-times

Time: ✅ 137.301µs (SLO: <150.000µs -8.5%) vs baseline: ~same

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.9%

✅ 1-rate-metric-1-times

Time: ✅ 3.065µs (SLO: <20.000µs 📉 -84.7%) vs baseline: +0.2%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.7%

✅ 1-rate-metrics-100-times

Time: ✅ 214.322µs (SLO: <250.000µs 📉 -14.3%) vs baseline: ~same

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +5.1%

✅ 100-count-metrics-100-times

Time: ✅ 20.074ms (SLO: <22.000ms -8.8%) vs baseline: -0.2%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.8%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.229ms (SLO: <2.300ms -3.1%) vs baseline: ~same

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.8%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.413ms (SLO: <1.550ms -8.8%) vs baseline: +0.5%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.9%

✅ 100-rate-metrics-100-times

Time: ✅ 2.194ms (SLO: <2.550ms 📉 -13.9%) vs baseline: +0.6%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.7%

✅ flush-1-metric

Time: ✅ 4.580µs (SLO: <20.000µs 📉 -77.1%) vs baseline: ~same

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.9%

✅ flush-100-metrics

Time: ✅ 175.072µs (SLO: <250.000µs 📉 -30.0%) vs baseline: +0.1%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.9%

✅ flush-1000-metrics

Time: ✅ 2.136ms (SLO: <2.500ms 📉 -14.5%) vs baseline: ~same

Memory: ✅ 32.676MB (SLO: <34.500MB -5.3%) vs baseline: +4.9%

✅ tracer - 6/6

✅ large

Time: ✅ 28.936ms (SLO: <32.950ms 📉 -12.2%) vs baseline: -0.2%

Memory: ✅ 32.696MB (SLO: <34.500MB -5.2%) vs baseline: +4.8%

✅ medium

Time: ✅ 2.897ms (SLO: <3.200ms -9.5%) vs baseline: +0.3%

Memory: ✅ 31.536MB (SLO: <34.000MB -7.2%) vs baseline: +5.1%

✅ small

Time: ✅ 325.734µs (SLO: <370.000µs 📉 -12.0%) vs baseline: -0.5%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

tests/contrib/botocore/bedrock_cassettes/cohere_rerank_invoke.yaml

## Description Closes #14575.  Adds safely accessing output response messages in the bedrock integration. This happens when cohere rerank models are invoked, since cohere rerank responses lack a response["text"] field and will return an empty list. ## Testing Added a test invoking cohere rerank models.  ## Risks  ## Additional Notes  (cherry picked from commit 191f10e)

dd-octo-sts · 2025-11-04T17:12:36Z

The backport to 3.17 failed:

The process '/usr/bin/git' failed with exit code 1

To backport manually, run these commands in your terminal:

# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add .worktrees/backport-3.17 3.17
# Navigate to the new working tree
cd .worktrees/backport-3.17
# Create a new branch
git switch --create backport-15124-to-3.17
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 191f10e1e04bf904557a3e91d2b1b11ef5741627
# Push it to GitHub
git push --set-upstream origin backport-15124-to-3.17
# Go back to the original working tree
cd ../..
# Delete the working tree
git worktree remove .worktrees/backport-3.17

Then, create a pull request where the base branch is 3.17 and the compare/head branch is backport-15124-to-3.17.

## Description Closes #14575.  Adds safely accessing output response messages in the bedrock integration. This happens when cohere rerank models are invoked, since cohere rerank responses lack a response["text"] field and will return an empty list. ## Testing Added a test invoking cohere rerank models.  ## Risks  ## Additional Notes  (cherry picked from commit 191f10e) Signed-off-by: Yun Kim <yun.kim@datadoghq.com>

…rt 3.17] (#15137) Backport 191f10e from #15124 to 3.17. ## Description Closes #14575.  Adds safely accessing output response messages in the bedrock integration. This happens when cohere rerank models are invoked, since cohere rerank responses lack a response["text"] field and will return an empty list. ## Testing Added a test invoking cohere rerank models.  ## Risks  ## Additional Notes  Signed-off-by: Yun Kim <yun.kim@datadoghq.com> Co-authored-by: Yun Kim <35776586+Yun-Kim@users.noreply.github.com>

Fix bedrock cohere models

0dc9937

Yun-Kim requested review from a team as code owners November 3, 2025 17:37

Yun-Kim requested review from quinna-h and tabgok November 3, 2025 17:37

Yun-Kim added the backport 3.17 label Nov 3, 2025

emmettbutler approved these changes Nov 3, 2025

View reviewed changes

sabrenner approved these changes Nov 4, 2025

View reviewed changes

tests/contrib/botocore/bedrock_cassettes/cohere_rerank_invoke.yaml Show resolved Hide resolved

Yun-Kim enabled auto-merge (squash) November 4, 2025 17:09

Yun-Kim merged commit 191f10e into main Nov 4, 2025
972 checks passed

Yun-Kim deleted the yunkim/fix-cohere-bedrock branch November 4, 2025 17:09

Yun-Kim added backport 3.17 and removed backport 3.17 labels Nov 4, 2025

dd-octo-sts bot mentioned this pull request Nov 4, 2025

fix(llmobs): safely output format bedrock cohere rerank spans [backport 3.17] #15137

Merged

Yun-Kim mentioned this pull request Nov 5, 2025

fix(bedrock): check list length before access to prevent IndexError #14956

Closed

fix(llmobs): safely output format bedrock cohere rerank spans #15124

fix(llmobs): safely output format bedrock cohere rerank spans #15124

Uh oh!

Conversation

Yun-Kim commented Nov 3, 2025

Description

Testing

Risks

Additional Notes

Uh oh!

github-actions bot commented Nov 3, 2025

Uh oh!

github-actions bot commented Nov 3, 2025

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Nov 3, 2025

Performance SLOs

✅ add_aspect

✅ add_inplace_aspect

✅ add_inplace_noaspect

✅ add_noaspect

✅ bytearray_aspect

✅ bytearray_extend_aspect

✅ bytearray_extend_noaspect

✅ bytearray_noaspect

✅ bytes_aspect

✅ bytes_noaspect

✅ bytesio_aspect

✅ bytesio_noaspect

✅ capitalize_aspect

✅ capitalize_noaspect

✅ casefold_aspect

✅ casefold_noaspect

✅ decode_aspect

✅ decode_noaspect

✅ encode_aspect

✅ encode_noaspect

✅ format_aspect

✅ format_map_aspect

✅ format_map_noaspect

✅ format_noaspect

✅ index_aspect

✅ index_noaspect

✅ join_aspect

✅ join_noaspect

✅ ljust_aspect

✅ ljust_noaspect

✅ lower_aspect

✅ lower_noaspect

✅ lstrip_aspect

✅ lstrip_noaspect

✅ modulo_aspect

✅ modulo_aspect_for_bytearray_bytearray

✅ modulo_aspect_for_bytes

✅ modulo_aspect_for_bytes_bytearray

✅ modulo_noaspect

✅ replace_aspect

✅ replace_noaspect

✅ repr_aspect

✅ repr_noaspect

✅ rstrip_aspect

✅ rstrip_noaspect

✅ slice_aspect

✅ slice_noaspect

✅ stringio_aspect

✅ stringio_noaspect

✅ strip_aspect

✅ strip_noaspect

✅ swapcase_aspect

✅ swapcase_noaspect

✅ title_aspect

✅ title_noaspect

✅ translate_aspect

✅ translate_noaspect

✅ upper_aspect

✅ upper_noaspect

✅ ospathbasename_aspect

✅ ospathbasename_noaspect