Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bump to v13 for release #622

Merged
merged 1 commit into from
Sep 13, 2024
Merged

Bump to v13 for release #622

merged 1 commit into from
Sep 13, 2024

Conversation

gleocadie
Copy link
Contributor

@gleocadie gleocadie commented Sep 12, 2024 •
edited
Loading

What does this PR do?

Bump the version from 12 to 13.

Motivation

Publish a new release of libdatadog.

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@gleocadie gleocadie requested a review from a team as a code owner September 12, 2024 08:13
@pr-commenter
Copy link

pr-commenter bot commented Sep 12, 2024 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2024-09-13 11:50:25

Comparing candidate commit c2d345b in PR branch gleocadie/bump-to-v13 with baseline commit 38545ca in branch main.

Found 16 performance improvements and 14 performance regressions! Performance is the same for 21 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟩 execution_time [-4.523µs; -4.295µs] or [-4.496%; -4.269%]
  • 🟩 throughput [+443872.169op/s; +467979.535op/s] or [+4.466%; +4.708%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟥 execution_time [+1.556µs; +1.648µs] or [+8.020%; +8.491%]
  • 🟥 throughput [-4027410.217op/s; -3816268.305op/s] or [-7.815%; -7.405%]

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

  • 🟥 execution_time [+4.297µs; +4.552µs] or [+4.714%; +4.993%]
  • 🟥 throughput [-521999.731op/s; -493006.975op/s] or [-4.759%; -4.494%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+2.044µs; +2.301µs] or [+2.410%; +2.713%]
  • 🟥 throughput [-311691.397op/s; -276961.135op/s] or [-2.643%; -2.348%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+2.165µs; +2.395µs] or [+2.681%; +2.967%]
  • 🟥 throughput [-356753.598op/s; -322823.030op/s] or [-2.880%; -2.606%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟩 execution_time [-5.060µs; -4.748µs] or [-5.026%; -4.716%]
  • 🟩 throughput [+492902.572op/s; +526398.099op/s] or [+4.962%; +5.299%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+1.619µs; +1.720µs] or [+8.347%; +8.865%]
  • 🟥 throughput [-4189133.853op/s; -3958689.789op/s] or [-8.127%; -7.680%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟩 execution_time [-11.417µs; -10.957µs] or [-4.050%; -3.887%]
  • 🟩 throughput [+143597.667op/s; +149516.912op/s] or [+4.048%; +4.215%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟩 execution_time [-1.958µs; -1.942µs] or [-7.054%; -6.994%]
  • 🟩 throughput [+2709877.146op/s; +2732429.957op/s] or [+7.523%; +7.585%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟩 execution_time [-1.511µs; -1.498µs] or [-8.956%; -8.876%]
  • 🟩 throughput [+5774517.082op/s; +5825575.793op/s] or [+9.745%; +9.832%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

  • 🟩 execution_time [-71.876µs; -71.734µs] or [-12.405%; -12.381%]
  • 🟩 throughput [+243893.704op/s; +244396.027op/s] or [+14.131%; +14.160%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟩 execution_time [-4.028µs; -3.945µs] or [-2.186%; -2.141%]
  • 🟩 throughput [+118737.624op/s; +121236.802op/s] or [+2.188%; +2.234%]

scenario:normalization/normalize_service/normalize_service/[empty string]

  • 🟩 execution_time [-3.334µs; -3.305µs] or [-7.127%; -7.064%]
  • 🟩 throughput [+1625444.036op/s; +1639358.263op/s] or [+7.605%; +7.670%]

scenario:normalization/normalize_service/normalize_service/test_ASCII

  • 🟥 execution_time [+4.957µs; +5.038µs] or [+11.013%; +11.193%]
  • 🟥 throughput [-2240567.012op/s; -2201501.206op/s] or [-10.084%; -9.908%]

scenario:normalization/normalize_trace/test_trace

  • 🟥 execution_time [+46.672ns; +52.242ns] or [+15.469%; +17.315%]

scenario:redis/obfuscate_redis_string

  • 🟥 execution_time [+1.298µs; +1.695µs] or [+3.533%; +4.613%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 74.935µs 75.071µs ± 0.166µs 75.047µs ± 0.039µs 75.097µs 75.192µs 75.301µs 77.182µs 2.85% 10.431 128.796 0.22% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [75.048µs; 75.094µs] or [-0.031%; +0.031%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 140.040µs 140.913µs ± 0.592µs 140.886µs ± 0.211µs 141.083µs 141.486µs 142.146µs 147.547µs 4.73% 7.144 77.003 0.42% 0.042µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [140.831µs; 140.995µs] or [-0.058%; +0.058%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 329.848ns 351.168ns ± 15.310ns 345.390ns ± 7.954ns 365.352ns 380.166ns 386.257ns 389.843ns 12.87% 0.745 -0.619 4.35% 1.083ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [349.046ns; 353.290ns] or [-0.604%; +0.604%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.696µs 2.749µs ± 0.026µs 2.756µs ± 0.007µs 2.760µs 2.776µs 2.785µs 2.899µs 5.21% 1.229 8.857 0.96% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.745µs; 2.752µs] or [-0.133%; +0.133%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.927ms 8.959ms ± 0.021ms 8.957ms ± 0.008ms 8.966ms 8.979ms 8.989ms 9.185ms 2.55% 6.669 71.123 0.23% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.956ms; 8.962ms] or [-0.032%; +0.032%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.347µs 3.205µs ± 1.577µs 3.035µs ± 0.046µs 3.104µs 3.162µs 13.894µs 18.274µs 502.15% 8.014 65.202 49.06% 0.111µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.987µs; 3.424µs] or [-6.817%; +6.817%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.960µs 23.432µs ± 10.281µs 18.518µs ± 0.146µs 23.331µs 37.648µs 43.549µs 99.160µs 435.48% 3.474 18.739 43.77% 0.727µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [22.007µs; 24.857µs] or [-6.081%; +6.081%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.208µs 1.209µs ± 0.002µs 1.209µs ± 0.001µs 1.211µs 1.212µs 1.213µs 1.216µs 0.62% 1.033 0.510 0.13% 0.000µs 1 200
credit_card/is_card_number/ throughput 822187027.429op/s 826828503.707op/s ± 1067496.411op/s 827313234.052op/s ± 467839.012op/s 827673625.236op/s 827897833.889op/s 827955873.333op/s 827966973.373op/s 0.08% -1.028 0.481 0.13% 75483.395op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 108.847µs 111.083µs ± 0.711µs 111.309µs ± 0.328µs 111.557µs 111.828µs 112.139µs 112.894µs 1.42% -1.036 0.616 0.64% 0.050µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8857879.748op/s 9002609.576op/s ± 58027.381op/s 8984025.066op/s ± 26505.956op/s 9030214.912op/s 9126386.501op/s 9173867.269op/s 9187236.805op/s 2.26% 1.065 0.672 0.64% 4103.155op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 101.215µs 103.458µs ± 0.735µs 103.588µs ± 0.367µs 103.874µs 104.303µs 105.175µs 106.681µs 2.99% -0.197 2.300 0.71% 0.052µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9373703.264op/s 9666242.189op/s ± 68830.669op/s 9653611.501op/s ± 34205.646op/s 9699646.784op/s 9797969.122op/s 9858468.984op/s 9879981.650op/s 2.34% 0.286 2.165 0.71% 4867.063op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.208µs 1.210µs ± 0.002µs 1.211µs ± 0.001µs 1.212µs 1.212µs 1.213µs 1.214µs 0.23% -0.005 -1.638 0.13% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 823927261.838op/s 826406611.835op/s ± 1056812.828op/s 825826992.852op/s ± 853666.664op/s 827401961.347op/s 827791741.407op/s 827849431.152op/s 827953453.329op/s 0.26% 0.006 -1.640 0.13% 74727.952op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 98.192µs 99.925µs ± 0.749µs 99.894µs ± 0.413µs 100.301µs 100.940µs 101.723µs 104.817µs 4.93% 1.732 9.762 0.75% 0.053µs 1 200
credit_card/is_card_number/378282246310005 throughput 9540399.825op/s 10008103.663op/s ± 74078.712op/s 10010614.779op/s ± 41435.006op/s 10052545.992op/s 10117363.031op/s 10160933.114op/s 10184085.493op/s 1.73% -1.544 8.495 0.74% 5238.156op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 94.622µs 96.201µs ± 0.702µs 96.347µs ± 0.532µs 96.767µs 97.038µs 97.334µs 97.630µs 1.33% -0.416 -0.882 0.73% 0.050µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 10242734.085op/s 10395437.423op/s ± 76104.396op/s 10379104.803op/s ± 57340.896op/s 10456825.182op/s 10534647.769op/s 10553272.512op/s 10568388.244op/s 1.82% 0.436 -0.867 0.73% 5381.393op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 20.400µs 21.007µs ± 0.306µs 20.967µs ± 0.221µs 21.215µs 21.555µs 21.816µs 21.866µs 4.29% 0.593 -0.265 1.45% 0.022µs 1 200
credit_card/is_card_number/x371413321323331 throughput 45732288.754op/s 47613016.820op/s ± 687705.188op/s 47694910.570op/s ± 498563.972op/s 48171665.287op/s 48537536.867op/s 48791977.077op/s 49018926.352op/s 2.78% -0.534 -0.354 1.44% 48628.100op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.208µs 1.208µs ± 0.000µs 1.208µs ± 0.000µs 1.209µs 1.209µs 1.210µs 1.210µs 0.12% 0.730 -0.214 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 826545823.457op/s 827501561.895op/s ± 319930.845op/s 827548733.740op/s ± 224955.609op/s 827770831.211op/s 827878461.060op/s 827952490.838op/s 827986338.426op/s 0.05% -0.729 -0.218 0.04% 22622.527op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 93.154µs 95.589µs ± 0.743µs 95.680µs ± 0.411µs 96.080µs 96.641µs 96.962µs 97.400µs 1.80% -0.697 0.817 0.78% 0.053µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10266985.628op/s 10462050.342op/s ± 81798.615op/s 10451528.944op/s ± 44740.981op/s 10498117.056op/s 10618768.646op/s 10696261.015op/s 10734955.982op/s 2.71% 0.751 0.912 0.78% 5784.036op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 84.222µs 86.965µs ± 0.728µs 86.971µs ± 0.424µs 87.413µs 88.206µs 88.547µs 88.677µs 1.96% -0.269 0.674 0.84% 0.052µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11276911.962op/s 11499654.698op/s ± 96551.868op/s 11498100.423op/s ± 56043.254op/s 11550318.736op/s 11669990.763op/s 11737095.321op/s 11873399.266op/s 3.26% 0.335 0.784 0.84% 6827.248op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.208µs 1.210µs ± 0.002µs 1.211µs ± 0.001µs 1.212µs 1.213µs 1.214µs 1.216µs 0.43% 0.232 -0.817 0.15% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 822271212.306op/s 826161238.957op/s ± 1246725.315op/s 825803736.253op/s ± 1015074.975op/s 827388675.913op/s 827856893.001op/s 827948047.315op/s 827954531.872op/s 0.26% -0.227 -0.827 0.15% 88156.792op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 81.514µs 83.013µs ± 0.688µs 82.998µs ± 0.350µs 83.325µs 84.192µs 85.181µs 85.772µs 3.34% 0.740 1.549 0.83% 0.049µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11658846.728op/s 12047182.052op/s ± 99333.585op/s 12048538.416op/s ± 50998.177op/s 12106217.304op/s 12204481.010op/s 12242502.001op/s 12267777.810op/s 1.82% -0.667 1.370 0.82% 7023.945op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 93.817µs 95.762µs ± 1.017µs 95.999µs ± 0.883µs 96.720µs 96.986µs 97.070µs 97.287µs 1.34% -0.290 -1.426 1.06% 0.072µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 10278847.338op/s 10443744.080op/s ± 111274.168op/s 10416745.962op/s ± 94916.271op/s 10557283.253op/s 10614497.187op/s 10632545.412op/s 10659100.345op/s 2.33% 0.306 -1.416 1.06% 7868.272op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 20.184µs 21.071µs ± 0.342µs 21.063µs ± 0.260µs 21.291µs 21.600µs 21.966µs 22.129µs 5.06% 0.287 -0.218 1.62% 0.024µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 45188843.411op/s 47472096.118op/s ± 767858.620op/s 47476558.211op/s ± 591229.060op/s 48075762.588op/s 48560544.024op/s 48966620.847op/s 49545238.739op/s 4.36% -0.205 -0.294 1.61% 54295.804op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.209µs; 1.210µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/ throughput [826680558.971op/s; 826976448.443op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [110.985µs; 111.182µs] or [-0.089%; +0.089%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8994567.539op/s; 9010651.613op/s] or [-0.089%; +0.089%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [103.356µs; 103.560µs] or [-0.099%; +0.099%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9656702.920op/s; 9675781.457op/s] or [-0.099%; +0.099%] None None None
credit_card/is_card_number/37828224631 execution_time [1.210µs; 1.210µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/37828224631 throughput [826260147.741op/s; 826553075.929op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/378282246310005 execution_time [99.821µs; 100.028µs] or [-0.104%; +0.104%] None None None
credit_card/is_card_number/378282246310005 throughput [9997837.066op/s; 10018370.259op/s] or [-0.103%; +0.103%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [96.104µs; 96.298µs] or [-0.101%; +0.101%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [10384890.086op/s; 10405984.761op/s] or [-0.101%; +0.101%] None None None
credit_card/is_card_number/x371413321323331 execution_time [20.965µs; 21.049µs] or [-0.202%; +0.202%] None None None
credit_card/is_card_number/x371413321323331 throughput [47517707.495op/s; 47708326.145op/s] or [-0.200%; +0.200%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.208µs; 1.209µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ throughput [827457222.557op/s; 827545901.233op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [95.486µs; 95.692µs] or [-0.108%; +0.108%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10450713.841op/s; 10473386.844op/s] or [-0.108%; +0.108%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [86.864µs; 87.066µs] or [-0.116%; +0.116%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11486273.538op/s; 11513035.859op/s] or [-0.116%; +0.116%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.210µs; 1.211µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [825988454.819op/s; 826334023.095op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [82.917µs; 83.108µs] or [-0.115%; +0.115%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12033415.372op/s; 12060948.731op/s] or [-0.114%; +0.114%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [95.621µs; 95.903µs] or [-0.147%; +0.147%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [10428322.551op/s; 10459165.610op/s] or [-0.148%; +0.148%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [21.023µs; 21.118µs] or [-0.225%; +0.225%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [47365678.298op/s; 47578513.937op/s] or [-0.224%; +0.224%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.195µs 1.370µs ± 0.052µs 1.382µs ± 0.030µs 1.409µs 1.438µs 1.461µs 1.462µs 5.74% -0.841 0.989 3.75% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.363µs; 1.377µs] or [-0.521%; +0.521%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.794µs 38.239µs ± 0.816µs 37.869µs ± 0.043µs 37.952µs 39.964µs 40.024µs 41.488µs 9.55% 1.796 1.584 2.13% 0.058µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.126µs; 38.352µs] or [-0.296%; +0.296%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.715µs 507.603µs ± 0.393µs 507.583µs ± 0.279µs 507.866µs 508.281µs 508.655µs 508.720µs 0.22% 0.319 -0.068 0.08% 0.028µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1965716.971op/s 1970045.105op/s ± 1525.863op/s 1970122.855op/s ± 1083.706op/s 1971137.675op/s 1972210.064op/s 1973139.227op/s 1973497.782op/s 0.17% -0.314 -0.072 0.08% 107.895op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 465.587µs 466.170µs ± 0.267µs 466.143µs ± 0.176µs 466.334µs 466.654µs 466.841µs 466.989µs 0.18% 0.317 -0.010 0.06% 0.019µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2141376.856op/s 2145142.177op/s ± 1227.391op/s 2145265.042op/s ± 811.313op/s 2145913.234op/s 2147035.840op/s 2147603.495op/s 2147825.078op/s 0.12% -0.314 -0.014 0.06% 86.790op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 179.783µs 180.299µs ± 0.249µs 180.275µs ± 0.172µs 180.451µs 180.747µs 180.938µs 181.230µs 0.53% 0.569 0.338 0.14% 0.018µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5517849.503op/s 5546350.552op/s ± 7665.234op/s 5547078.224op/s ± 5279.699op/s 5552004.117op/s 5557798.218op/s 5560673.955op/s 5562247.588op/s 0.27% -0.561 0.320 0.14% 542.014op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 43.327µs 43.465µs ± 0.047µs 43.462µs ± 0.027µs 43.492µs 43.545µs 43.598µs 43.637µs 0.40% 0.447 0.913 0.11% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22916273.711op/s 23006933.370op/s ± 24755.962op/s 23008510.818op/s ± 14539.683op/s 23022152.593op/s 23042966.878op/s 23058570.786op/s 23080165.971op/s 0.31% -0.438 0.901 0.11% 1750.511op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.737µs 50.005µs ± 0.104µs 49.999µs ± 0.047µs 50.047µs 50.118µs 50.170µs 51.075µs 2.15% 5.298 53.641 0.21% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19579139.862op/s 19997949.151op/s ± 41258.941op/s 20000422.231op/s ± 18834.116op/s 20017956.108op/s 20045389.233op/s 20065426.701op/s 20105944.926op/s 0.53% -5.128 51.453 0.21% 2917.448op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.548µs; 507.657µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1969833.635op/s; 1970256.575op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [466.133µs; 466.207µs] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2144972.073op/s; 2145312.282op/s] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.265µs; 180.334µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5545288.225op/s; 5547412.880op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [43.459µs; 43.472µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [23003502.432op/s; 23010364.308op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.991µs; 50.020µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19992231.058op/s; 20003667.243op/s] or [-0.029%; +0.029%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c2d345b 1726227611 gleocadie/bump-to-v13
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 268.833µs 270.716µs ± 0.966µs 270.617µs ± 0.613µs 271.259µs 272.444µs 273.466µs 273.679µs 1.13% 0.598 0.342 0.36% 0.068µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3653911.268op/s 3693959.768op/s ± 13155.344op/s 3695259.807op/s ± 8349.070op/s 3703072.582op/s 3714265.540op/s 3718964.157op/s 3719774.968op/s 0.66% -0.577 0.306 0.36% 930.223op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 25.760µs 25.811µs ± 0.032µs 25.814µs ± 0.026µs 25.832µs 25.866µs 25.901µs 25.934µs 0.46% 0.506 0.241 0.13% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 38560149.468op/s 38743176.278op/s ± 48542.881op/s 38737975.239op/s ± 38765.212op/s 38787506.221op/s 38812214.424op/s 38818855.178op/s 38819932.644op/s 0.21% -0.498 0.219 0.12% 3432.500op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 15.334µs 15.372µs ± 0.029µs 15.361µs ± 0.017µs 15.389µs 15.433µs 15.450µs 15.461µs 0.65% 0.969 0.126 0.19% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 64679537.351op/s 65053502.276op/s ± 124258.639op/s 65100694.196op/s ± 73549.461op/s 65157057.942op/s 65190817.769op/s 65201338.006op/s 65215413.636op/s 0.18% -0.962 0.108 0.19% 8786.413op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [270.582µs; 270.850µs] or [-0.049%; +0.049%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3692136.564op/s; 3695782.973op/s] or [-0.049%; +0.049%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [25.807µs; 25.816µs] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [38736448.702op/s; 38749903.855op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/good execution_time [15.368µs; 15.376µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/good throughput [65036281.224op/s; 65070723.329op/s] or [-0.026%; +0.026%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Sep 12, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.15%. Comparing base (38545ca) to head (c2d345b).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #622      +/-   ##
==========================================
- Coverage   73.19%   73.15%   -0.04%     
==========================================
  Files         252      252              
  Lines       35942    35959      +17     
==========================================
- Hits        26307    26306       -1     
- Misses       9635     9653      +18
Components Coverage Δ
crashtracker 20.48% <ø> (-0.06%) ⬇️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.12% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ipc 83.63% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.12% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 91.66% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 92.86% <ø> (-0.42%) ⬇️

ivoanjo
ivoanjo approved these changes Sep 12, 2024
View reviewed changes
Copy link
Member

@ivoanjo ivoanjo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 LGTM

@gleocadie gleocadie force-pushed the gleocadie/bump-to-v13 branch 2 times, most recently from 8056701 to fad12ba Compare September 13, 2024 07:09
@gleocadie gleocadie merged commit 661432f into main Sep 13, 2024
30 checks passed
@gleocadie gleocadie deleted the gleocadie/bump-to-v13 branch September 13, 2024 12:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ivoanjo ivoanjo ivoanjo approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@gleocadie @codecov-commenter @ivoanjo