Skip to content

Conversation

@bantonsson
Copy link
Contributor

What does this PR do?

Move live debugger remote configuration functionality behind a feature flag.

Motivation

Avoid pulling in unnecessary dependencies for users that don't need live debugging.

@bantonsson bantonsson requested review from a team as code owners September 26, 2025 07:42
@pr-commenter
Copy link

pr-commenter bot commented Sep 26, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-09-26 07:47:42

Comparing candidate commit f4f7fe7 in PR branch ban/feature-flag-rc with baseline commit 8719ad8 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.262µs 535.116µs ± 0.455µs 535.054µs ± 0.323µs 535.413µs 535.989µs 536.354µs 536.470µs 0.26% 0.567 0.065 0.08% 0.032µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1864036.110op/s 1868753.999op/s ± 1588.452op/s 1868970.749op/s ± 1128.319op/s 1869893.318op/s 1871037.085op/s 1871616.042op/s 1871741.450op/s 0.15% -0.563 0.057 0.08% 112.320op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.951µs 380.679µs ± 0.317µs 380.671µs ± 0.230µs 380.915µs 381.207µs 381.347µs 381.491µs 0.22% 0.078 -0.478 0.08% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2621293.221op/s 2626887.866op/s ± 2184.222op/s 2626937.024op/s ± 1585.525op/s 2628373.249op/s 2630427.864op/s 2631500.882op/s 2631919.531op/s 0.19% -0.074 -0.479 0.08% 154.448op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 193.709µs 194.279µs ± 0.400µs 194.249µs ± 0.138µs 194.388µs 194.681µs 194.799µs 199.000µs 2.45% 8.243 95.293 0.21% 0.028µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5025137.930op/s 5147257.010op/s ± 10421.886op/s 5148031.992op/s ± 3658.786op/s 5151595.778op/s 5158528.526op/s 5161307.215op/s 5162390.949op/s 0.28% -8.064 92.518 0.20% 736.939op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.016µs 36.188µs ± 0.076µs 36.184µs ± 0.050µs 36.231µs 36.330µs 36.366µs 36.376µs 0.53% 0.342 -0.207 0.21% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27490601.058op/s 27633603.946op/s ± 57820.762op/s 27636471.757op/s ± 37984.043op/s 27675521.060op/s 27718248.824op/s 27752159.009op/s 27765730.004op/s 0.47% -0.332 -0.214 0.21% 4088.545op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.964µs 45.069µs ± 0.101µs 45.054µs ± 0.032µs 45.097µs 45.150µs 45.218µs 46.302µs 2.77% 9.274 110.295 0.22% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21597483.112op/s 22188532.414op/s ± 48637.923op/s 22195634.686op/s ± 15589.568op/s 22209114.644op/s 22226063.180op/s 22232641.868op/s 22239798.498op/s 0.20% -9.099 107.402 0.22% 3439.220op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.053µs; 535.179µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868533.854op/s; 1868974.143op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.635µs; 380.723µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2626585.154op/s; 2627190.578op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [194.224µs; 194.334µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5145812.636op/s; 5148701.383op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.177µs; 36.198µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27625590.545op/s; 27641617.348op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.055µs; 45.083µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22181791.666op/s; 22195273.163op/s] or [-0.030%; +0.030%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.920µs 3.921µs 0.22% -0.693 7.459 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255056059.965op/s 255604355.415op/s ± 210242.568op/s 255623146.902op/s ± 119314.685op/s 255741263.855op/s 255849129.345op/s 255940347.438op/s 256952101.897op/s 0.52% 0.716 7.599 0.08% 14866.395op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.504µs 78.439µs ± 0.696µs 78.472µs ± 0.481µs 78.894µs 79.577µs 79.914µs 80.731µs 2.88% 0.128 -0.004 0.88% 0.049µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12386890.992op/s 12749801.787op/s ± 112983.518op/s 12743386.916op/s ± 78538.582op/s 12826735.412op/s 12942971.385op/s 12976666.582op/s 13071143.887op/s 2.57% -0.076 -0.038 0.88% 7989.141op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 69.931µs 71.039µs ± 0.634µs 70.947µs ± 0.422µs 71.411µs 72.191µs 72.742µs 72.989µs 2.88% 0.575 0.138 0.89% 0.045µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13700673.325op/s 14077823.290op/s ± 125115.709op/s 14095074.496op/s ± 83936.050op/s 14172673.218op/s 14271029.299op/s 14290467.771op/s 14299754.703op/s 1.45% -0.527 0.055 0.89% 8847.017op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.888µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.915µs 3.917µs 3.918µs 0.17% -2.607 22.582 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255239777.158op/s 255678492.936op/s ± 180932.179op/s 255673000.937op/s ± 105883.060op/s 255787779.971op/s 255891734.559op/s 255927436.579op/s 257192513.877op/s 0.59% 2.645 22.960 0.07% 12793.837op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 66.765µs 68.139µs ± 0.725µs 68.096µs ± 0.476µs 68.560µs 69.358µs 69.910µs 70.559µs 3.62% 0.499 0.109 1.06% 0.051µs 1 200
credit_card/is_card_number/378282246310005 throughput 14172532.387op/s 14677421.076op/s ± 155390.373op/s 14685132.245op/s ± 102010.951op/s 14795057.126op/s 14912373.458op/s 14965842.728op/s 14977990.956op/s 1.99% -0.441 0.007 1.06% 10987.759op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.148µs 52.197µs ± 0.030µs 52.191µs ± 0.022µs 52.219µs 52.249µs 52.270µs 52.278µs 0.17% 0.510 -0.613 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19128387.144op/s 19158359.571op/s ± 10933.955op/s 19160505.426op/s ± 8186.350op/s 19167278.102op/s 19172647.247op/s 19175378.622op/s 19176054.860op/s 0.08% -0.508 -0.616 0.06% 773.147op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.041µs ± 0.020µs 6.036µs ± 0.004µs 6.039µs 6.074µs 6.117µs 6.197µs 2.67% 4.085 21.983 0.33% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 161361159.775op/s 165523929.855op/s ± 535385.471op/s 165664158.568op/s ± 96453.861op/s 165763856.382op/s 165854744.139op/s 165905702.999op/s 165932803.724op/s 0.16% -4.015 21.144 0.32% 37857.470op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.918µs 3.920µs 0.20% -1.029 6.619 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255116172.179op/s 255618668.286op/s ± 187301.857op/s 255619836.109op/s ± 140295.432op/s 255762594.704op/s 255849238.094op/s 255902071.975op/s 256810114.943op/s 0.47% 1.046 6.735 0.07% 13244.241op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.091µs 64.435µs ± 0.159µs 64.413µs ± 0.083µs 64.526µs 64.757µs 64.940µs 65.020µs 0.94% 0.876 1.415 0.25% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15379907.374op/s 15519545.240op/s ± 38301.895op/s 15524927.661op/s ± 19968.401op/s 15542511.361op/s 15574895.076op/s 15590688.425op/s 15602788.218op/s 0.50% -0.857 1.366 0.25% 2708.353op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.959µs 58.242µs ± 0.140µs 58.219µs ± 0.086µs 58.311µs 58.491µs 58.662µs 58.724µs 0.87% 0.872 0.672 0.24% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17028831.296op/s 17169934.666op/s ± 41186.473op/s 17176578.018op/s ± 25374.905op/s 17200756.413op/s 17222891.203op/s 17233916.937op/s 17253468.499op/s 0.45% -0.858 0.638 0.24% 2912.323op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.892µs 3.911µs ± 0.003µs 3.911µs ± 0.001µs 3.913µs 3.916µs 3.917µs 3.920µs 0.22% -1.232 12.499 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255117261.152op/s 255663921.290op/s ± 173286.046op/s 255683904.699op/s ± 97126.732op/s 255767842.443op/s 255862132.157op/s 255885425.584op/s 256913014.799op/s 0.48% 1.258 12.696 0.07% 12253.174op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.561µs 54.820µs ± 0.192µs 54.793µs ± 0.134µs 54.935µs 55.177µs 55.329µs 55.744µs 1.74% 1.191 2.113 0.35% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17939046.648op/s 18241856.576op/s ± 63490.635op/s 18250580.175op/s ± 44680.906op/s 18293626.045op/s 18315379.884op/s 18323401.917op/s 18328122.671op/s 0.42% -1.163 1.974 0.35% 4489.466op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.146µs 52.206µs ± 0.038µs 52.198µs ± 0.021µs 52.223µs 52.282µs 52.313µs 52.346µs 0.28% 1.033 0.921 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19103607.020op/s 19154974.374op/s ± 13931.297op/s 19157756.191op/s ± 7780.112op/s 19164953.051op/s 19172227.112op/s 19175876.709op/s 19176939.730op/s 0.10% -1.029 0.909 0.07% 985.091op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.036µs ± 0.014µs 6.033µs ± 0.003µs 6.036µs 6.068µs 6.100µs 6.145µs 1.85% 4.549 25.078 0.23% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 162741282.120op/s 165659949.353op/s ± 372815.865op/s 165748274.185op/s ± 72626.937op/s 165815444.912op/s 165879472.468op/s 165897818.219op/s 165904593.545op/s 0.09% -4.506 24.556 0.22% 26362.063op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255575217.818op/s; 255633493.013op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.342µs; 78.535µs] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12734143.358op/s; 12765460.216op/s] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [70.951µs; 71.127µs] or [-0.124%; +0.124%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14060483.457op/s; 14095163.124op/s] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255653417.476op/s; 255703568.396op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.039µs; 68.240µs] or [-0.147%; +0.147%] None None None
credit_card/is_card_number/378282246310005 throughput [14655885.465op/s; 14698956.688op/s] or [-0.147%; +0.147%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.192µs; 52.201µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19156844.230op/s; 19159874.912op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.039µs; 6.044µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/x371413321323331 throughput [165449730.578op/s; 165598129.132op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255592710.050op/s; 255644626.522op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.413µs; 64.457µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15514236.966op/s; 15524853.514op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.222µs; 58.261µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17164226.617op/s; 17175642.715op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255639905.511op/s; 255687937.069op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.793µs; 54.846µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18233057.385op/s; 18250655.768op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.201µs; 52.211µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19153043.630op/s; 19156905.117op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.035µs; 6.038µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165608280.660op/s; 165711618.047op/s] or [-0.031%; +0.031%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 186.520µs 186.911µs ± 0.225µs 186.888µs ± 0.141µs 187.033µs 187.294µs 187.473µs 188.327µs 0.77% 1.530 6.732 0.12% 0.016µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5309906.733op/s 5350156.554op/s ± 6432.916op/s 5350804.424op/s ± 4027.847op/s 5354794.099op/s 5358914.900op/s 5360607.281op/s 5361340.979op/s 0.20% -1.507 6.565 0.12% 454.876op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.651µs 17.749µs ± 0.044µs 17.744µs ± 0.029µs 17.774µs 17.835µs 17.854µs 17.906µs 0.91% 0.641 0.428 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55847150.073op/s 56342314.586op/s ± 138045.324op/s 56355980.068op/s ± 90911.503op/s 56440979.989op/s 56520255.577op/s 56626141.994op/s 56652810.333op/s 0.53% -0.626 0.401 0.24% 9761.278op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 9.868µs 9.992µs ± 0.080µs 9.958µs ± 0.067µs 10.069µs 10.106µs 10.128µs 10.133µs 1.76% 0.163 -1.623 0.80% 0.006µs 1 200
normalization/normalize_name/normalize_name/good throughput 98689761.578op/s 100088412.462op/s ± 798465.987op/s 100423621.020op/s ± 675230.971op/s 100855442.793op/s 101096288.944op/s 101218704.973op/s 101336167.652op/s 0.91% -0.154 -1.627 0.80% 56460.071op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.879µs; 186.942µs] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5349265.014op/s; 5351048.094op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.743µs; 17.755µs] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [56323182.832op/s; 56361446.340op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/good execution_time [9.981µs; 10.003µs] or [-0.111%; +0.111%] None None None
normalization/normalize_name/normalize_name/good throughput [99977752.755op/s; 100199072.168op/s] or [-0.111%; +0.111%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.353ms 14.424ms ± 0.033ms 14.420ms ± 0.021ms 14.442ms 14.476ms 14.535ms 14.537ms 0.81% 0.799 1.188 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.419ms; 14.428ms] or [-0.032%; +0.032%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.410µs 2.442µs ± 0.016µs 2.441µs ± 0.009µs 2.449µs 2.483µs 2.493µs 2.496µs 2.26% 1.256 2.178 0.66% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.440µs; 2.445µs] or [-0.092%; +0.092%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 59.970ms 60.375ms ± 2.162ms 60.106ms ± 0.058ms 60.160ms 60.304ms 67.866ms 82.153ms 36.68% 8.999 82.393 3.57% 0.153ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.076ms; 60.675ms] or [-0.496%; +0.496%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.029µs 5.070µs ± 0.035µs 5.054µs ± 0.019µs 5.083µs 5.134µs 5.138µs 5.238µs 3.63% 1.172 1.567 0.68% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.065µs; 5.075µs] or [-0.095%; +0.095%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.887ns 254.780ns ± 14.739ns 247.564ns ± 3.897ns 262.026ns 284.384ns 300.771ns 302.303ns 22.11% 1.483 1.282 5.77% 1.042ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.737ns; 256.822ns] or [-0.802%; +0.802%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 156.162µs 156.926µs ± 0.566µs 156.801µs ± 0.125µs 156.980µs 157.528µs 158.987µs 161.781µs 3.18% 5.329 36.886 0.36% 0.040µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [156.848µs; 157.005µs] or [-0.050%; +0.050%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.151ms 6.223ms ± 0.070ms 6.201ms ± 0.022ms 6.228ms 6.348ms 6.500ms 6.677ms 7.68% 2.957 11.561 1.12% 0.005ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.213ms; 6.232ms] or [-0.156%; +0.156%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.259µs 3.198µs ± 1.414µs 2.982µs ± 0.026µs 3.013µs 3.663µs 13.840µs 14.921µs 400.33% 7.355 55.270 44.12% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.002µs; 3.394µs] or [-6.129%; +6.129%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.627µs 34.213µs ± 1.072µs 33.726µs ± 0.046µs 33.793µs 36.481µs 36.580µs 37.943µs 12.50% 1.745 1.210 3.13% 0.076µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.064µs; 34.361µs] or [-0.434%; +0.434%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.493ms 10.523ms ± 0.015ms 10.521ms ± 0.010ms 10.531ms 10.547ms 10.558ms 10.611ms 0.85% 1.439 5.629 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.521ms; 10.525ms] or [-0.019%; +0.019%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.658µs 86.906µs ± 0.163µs 86.884µs ± 0.055µs 86.941µs 87.068µs 87.564µs 88.496µs 1.86% 5.795 48.214 0.19% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.884µs; 86.929µs] or [-0.026%; +0.026%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz f4f7fe7 1758872089 ban/feature-flag-rc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.679µs 25.860µs ± 10.187µs 17.957µs ± 0.189µs 35.382µs 43.455µs 53.063µs 70.518µs 292.70% 0.947 0.482 39.29% 0.720µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.449µs; 27.272µs] or [-5.459%; +5.459%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.68%. Comparing base (8719ad8) to head (f4f7fe7).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1246      +/-   ##
==========================================
+ Coverage   71.57%   71.68%   +0.11%     
==========================================
  Files         355      355              
  Lines       56309    56312       +3     
==========================================
+ Hits        40302    40368      +66     
+ Misses      16007    15944      -63     
Components Coverage Δ
datadog-crashtracker 49.30% <ø> (-0.03%) ⬇️
datadog-crashtracker-ffi 5.93% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.46% <ø> (+0.01%) ⬆️
data-pipeline-ffi 88.19% <ø> (ø)
ddcommon 84.29% <ø> (ø)
ddcommon-ffi 73.84% <ø> (ø)
ddtelemetry 59.98% <ø> (ø)
ddtelemetry-ffi 21.24% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (ø)
datadog-profiling 76.90% <ø> (ø)
datadog-profiling-ffi 62.12% <ø> (ø)
datadog-sidecar 37.19% <ø> (+0.83%) ⬆️
datdog-sidecar-ffi 11.87% <ø> (+4.01%) ⬆️
spawn-worker 55.35% <ø> (ø)
tinybytes 92.22% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
datadog-trace-protobuf 59.65% <ø> (ø)
datadog-trace-utils 89.77% <ø> (ø)
datadog-tracer-flare 54.52% <ø> (ø)
datadog-log 76.31% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

endpoint: self.endpoint.clone(),
#[cfg(not(feature = "live-debugger"))]
products: vec![RemoteConfigProduct::ApmTracing],
#[cfg(feature = "live-debugger")]

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

when another product is added as optional this will be require an even more complex setup.
I think the code must be changed to just add to the vector as needed instead of just trying to jam it in as a one-liner

Copy link
Contributor Author

@bantonsson bantonsson Sep 26, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indeed, but this is just a test server and I wanted to make sure that I didn't break anything that relied on the existing code.

The RC create really needs to be refactored to better allow for not knowing about all the types and deserialize them itself. That is a bigger task for Q4.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It conveniently allows storing the deserialized data directly on the storage. I'd like to trade as little convenience as possible.

Is there a fundamental benefit of not having to know about all the types? As long as we can simply enable and disable via feature flags, why not actually?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree that storing the deserialized data directly is very convenient. I don't advocate for throwing that away, but I think that we should explore if there is another way to split things.

Long term, I don't think that feature flags will be maintainable as we add more products, and there is also the circular nature of the RC data types that I think should be defined with the code that uses them, but that code also depends on RC to get the data.

@bantonsson
Copy link
Contributor Author

/merge

@dd-devflow-routing-codex
Copy link

dd-devflow-routing-codex bot commented Sep 26, 2025

View all feedbacks in Devflow UI.

2025-09-26 08:35:52 UTC ℹ️ Start processing command /merge


2025-09-26 08:35:57 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in main is approximately 45m (p90).


2025-09-26 09:11:37 UTC ℹ️ MergeQueue: This merge request was merged

@dd-mergequeue dd-mergequeue bot merged commit 0b59f64 into main Sep 26, 2025
38 checks passed
@dd-mergequeue dd-mergequeue bot deleted the ban/feature-flag-rc branch September 26, 2025 09:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants