Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PROF-10603] Package libdatadog v13.1.0 for Ruby #674

Merged
merged 2 commits into from
Oct 14, 2024

Conversation

ivoanjo
Copy link
Member

@ivoanjo ivoanjo commented Oct 14, 2024

What does this PR do?

This PR includes the changes documented in the "Releasing a new version to rubygems.org" part of the README:
https://github.com/datadog/libdatadog/tree/main/ruby#releasing-a-new-version-to-rubygemsorg

Motivation:

Enable Ruby to use libdatadog v13.1.0.

Additional Notes:

We ended up not releasing 13.0 for Ruby. I don't see any reason to backfill so I've skipped ahead.

How to test the change?

I've tested this release locally using the changes in DataDog/dd-trace-rb#3997 .

As a reminder, new libdatadog releases don't get automatically picked up by dd-trace-rb, so the PR that bumps the Ruby profiler will also test this release against all supported Ruby versions.

**What does this PR do?**

This PR includes the changes documented in the "Releasing a new version
to rubygems.org" part of the README:
https://github.com/datadog/libdatadog/tree/main/ruby#releasing-a-new-version-to-rubygemsorg

**Motivation:**

Enable Ruby to use libdatadog v13.1.0.

**Additional Notes:**

We ended up not releasing 13.0 for Ruby. I don't see any reason
to backfill so I've skipped ahead.

**How to test the change?**

I've tested this release locally using the changes in
DataDog/dd-trace-rb#3997 .

As a reminder, new libdatadog releases don't get automatically picked up
by dd-trace-rb, so the PR that bumps the Ruby profiler will also test
this release against all supported Ruby versions.
@ivoanjo ivoanjo requested review from a team as code owners October 14, 2024 09:56
@ivoanjo ivoanjo requested a review from AlexJF October 14, 2024 09:56
@pr-commenter
Copy link

pr-commenter bot commented Oct 14, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-10-14 10:05:52

Comparing candidate commit 80dee15 in PR branch ivoanjo/libdatadog13_1-ruby with baseline commit 1bae54b in branch main.

Found 1 performance improvements and 1 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟩 execution_time [-40.551ns; -31.732ns] or [-3.312%; -2.592%]

scenario:tags/replace_trace_tags

  • 🟥 execution_time [+72.055ns; +78.808ns] or [+2.695%; +2.947%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.131µs 1.188µs ± 0.023µs 1.190µs ± 0.017µs 1.208µs 1.211µs 1.212µs 1.213µs 1.87% -1.057 0.339 1.90% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.185µs; 1.191µs] or [-0.263%; +0.263%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.229ms 9.271ms ± 0.016ms 9.271ms ± 0.009ms 9.280ms 9.291ms 9.305ms 9.359ms 0.95% 0.933 5.244 0.17% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.269ms; 9.273ms] or [-0.024%; +0.024%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.715µs 2.749µs ± 0.016µs 2.746µs ± 0.008µs 2.755µs 2.786µs 2.792µs 2.795µs 1.78% 0.820 0.717 0.59% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.747µs; 2.752µs] or [-0.082%; +0.082%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.613µs 1.614µs ± 0.001µs 1.614µs ± 0.000µs 1.615µs 1.615µs 1.616µs 1.618µs 0.21% 1.059 1.801 0.04% 0.000µs 1 200
credit_card/is_card_number/ throughput 618226638.592op/s 619465373.058op/s ± 263697.204op/s 619507155.365op/s ± 174437.133op/s 619678622.363op/s 619762618.212op/s 619849528.811op/s 620022617.064op/s 0.08% -1.056 1.786 0.04% 18646.208op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 110.383µs 111.872µs ± 0.723µs 111.901µs ± 0.525µs 112.322µs 113.080µs 113.645µs 114.557µs 2.37% 0.453 0.347 0.64% 0.051µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8729259.401op/s 8939145.976op/s ± 57619.570op/s 8936457.765op/s ± 41964.222op/s 8984070.794op/s 9024830.378op/s 9035178.039op/s 9059352.347op/s 1.38% -0.412 0.246 0.64% 4074.319op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 106.533µs 108.024µs ± 0.707µs 107.788µs ± 0.364µs 108.460µs 109.443µs 109.771µs 110.054µs 2.10% 0.787 0.006 0.65% 0.050µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9086459.124op/s 9257631.279op/s ± 60324.492op/s 9277453.937op/s ± 31299.378op/s 9299880.511op/s 9332780.580op/s 9367732.944op/s 9386757.103op/s 1.18% -0.760 -0.033 0.65% 4265.586op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.613µs 1.614µs ± 0.001µs 1.614µs ± 0.000µs 1.615µs 1.615µs 1.616µs 1.622µs 0.47% 5.629 56.176 0.05% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 616521338.804op/s 619457728.454op/s ± 283466.336op/s 619439233.031op/s ± 142086.310op/s 619661654.235op/s 619743249.225op/s 619776843.818op/s 619880854.797op/s 0.07% -5.593 55.681 0.05% 20044.097op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 102.009µs 103.462µs ± 0.596µs 103.371µs ± 0.310µs 103.726µs 104.765µs 105.133µs 105.309µs 1.87% 0.803 0.937 0.57% 0.042µs 1 200
credit_card/is_card_number/378282246310005 throughput 9495883.143op/s 9665734.682op/s ± 55429.802op/s 9673893.065op/s ± 29125.564op/s 9698373.103op/s 9746056.943op/s 9774753.503op/s 9803010.029op/s 1.33% -0.764 0.879 0.57% 3919.479op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 106.335µs 108.258µs ± 0.600µs 108.472µs ± 0.333µs 108.705µs 108.932µs 109.062µs 109.470µs 0.92% -0.883 0.204 0.55% 0.042µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9134882.433op/s 9237492.667op/s ± 51482.149op/s 9218927.827op/s ± 28176.888op/s 9272139.539op/s 9334000.182op/s 9382203.910op/s 9404268.891op/s 2.01% 0.906 0.266 0.56% 3640.338op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 23.717µs 25.023µs ± 0.466µs 25.023µs ± 0.239µs 25.289µs 25.735µs 25.893µs 26.292µs 5.07% -0.489 0.679 1.86% 0.033µs 1 200
credit_card/is_card_number/x371413321323331 throughput 38034523.776op/s 39977587.317op/s ± 752670.941op/s 39962969.016op/s ± 386044.923op/s 40308286.015op/s 41510454.867op/s 42063954.820op/s 42163768.915op/s 5.51% 0.625 0.817 1.88% 53221.873op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.613µs 1.614µs ± 0.000µs 1.614µs ± 0.000µs 1.615µs 1.615µs 1.615µs 1.616µs 0.12% 0.192 0.333 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 618684450.158op/s 619476344.455op/s ± 180135.439op/s 619414768.538op/s ± 139658.293op/s 619655998.398op/s 619725291.836op/s 619797131.374op/s 619872667.448op/s 0.07% -0.190 0.325 0.03% 12737.499op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 89.778µs 90.536µs ± 0.226µs 90.521µs ± 0.076µs 90.654µs 90.868µs 91.128µs 91.791µs 1.40% 0.406 5.425 0.25% 0.016µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10894302.496op/s 11045372.240op/s ± 27584.075op/s 11047182.318op/s ± 9305.145op/s 11054649.131op/s 11098788.881op/s 11115165.622op/s 11138592.997op/s 0.83% -0.352 5.238 0.25% 1950.489op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 83.711µs 84.869µs ± 0.722µs 84.623µs ± 0.290µs 84.990µs 86.430µs 87.150µs 87.546µs 3.45% 1.521 2.114 0.85% 0.051µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11422585.220op/s 11783655.473op/s ± 98941.237op/s 11817155.570op/s ± 40531.561op/s 11842878.054op/s 11892103.551op/s 11915600.806op/s 11945883.125op/s 1.09% -1.476 1.958 0.84% 6996.202op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.614µs 1.614µs ± 0.001µs 1.614µs ± 0.000µs 1.615µs 1.615µs 1.616µs 1.619µs 0.26% 2.731 15.376 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 617784967.153op/s 619431713.585op/s ± 240827.793op/s 619402877.630op/s ± 128355.478op/s 619621585.246op/s 619697438.705op/s 619746388.858op/s 619769971.800op/s 0.06% -2.719 15.281 0.04% 17029.097op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 79.416µs 80.144µs ± 0.428µs 80.086µs ± 0.168µs 80.254µs 80.668µs 81.802µs 82.817µs 3.41% 2.680 11.158 0.53% 0.030µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 12074792.229op/s 12477830.207op/s ± 65752.627op/s 12486642.414op/s ± 26151.516op/s 12511791.767op/s 12555937.399op/s 12581185.348op/s 12591946.393op/s 0.84% -2.586 10.522 0.53% 4649.413op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 106.760µs 108.337µs ± 0.583µs 108.547µs ± 0.358µs 108.794µs 109.040µs 109.116µs 109.362µs 0.75% -0.747 -0.395 0.54% 0.041µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9143917.894op/s 9230693.099op/s ± 49854.747op/s 9212587.293op/s ± 30310.438op/s 9274286.143op/s 9325698.837op/s 9357320.906op/s 9366788.009op/s 1.67% 0.764 -0.360 0.54% 3525.263op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 23.567µs 24.992µs ± 0.548µs 24.991µs ± 0.376µs 25.378µs 25.912µs 26.098µs 26.230µs 4.96% -0.062 -0.548 2.19% 0.039µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 38123647.252op/s 40032184.585op/s ± 879815.715op/s 40014919.611op/s ± 602229.720op/s 40588734.639op/s 41498776.243op/s 41827851.482op/s 42432052.898op/s 6.04% 0.157 -0.519 2.19% 62212.366op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.614µs; 1.614µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number/ throughput [619428827.162op/s; 619501918.955op/s] or [-0.006%; +0.006%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [111.772µs; 111.972µs] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8931160.458op/s; 8947131.495op/s] or [-0.089%; +0.089%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [107.926µs; 108.122µs] or [-0.091%; +0.091%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9249270.884op/s; 9265991.673op/s] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/37828224631 execution_time [1.614µs; 1.614µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number/37828224631 throughput [619418442.746op/s; 619497014.162op/s] or [-0.006%; +0.006%] None None None
credit_card/is_card_number/378282246310005 execution_time [103.379µs; 103.544µs] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/378282246310005 throughput [9658052.645op/s; 9673416.720op/s] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [108.175µs; 108.341µs] or [-0.077%; +0.077%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9230357.736op/s; 9244627.598op/s] or [-0.077%; +0.077%] None None None
credit_card/is_card_number/x371413321323331 execution_time [24.958µs; 25.087µs] or [-0.258%; +0.258%] None None None
credit_card/is_card_number/x371413321323331 throughput [39873274.364op/s; 40081900.271op/s] or [-0.261%; +0.261%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.614µs; 1.614µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ throughput [619451379.415op/s; 619501309.494op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [90.505µs; 90.568µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11041549.352op/s; 11049195.128op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [84.769µs; 84.969µs] or [-0.118%; +0.118%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11769943.169op/s; 11797367.777op/s] or [-0.116%; +0.116%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.614µs; 1.614µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [619398337.169op/s; 619465090.001op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [80.085µs; 80.204µs] or [-0.074%; +0.074%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12468717.525op/s; 12486942.888op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [108.257µs; 108.418µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9223783.710op/s; 9237602.487op/s] or [-0.075%; +0.075%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [24.916µs; 25.068µs] or [-0.304%; +0.304%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [39910250.589op/s; 40154118.581op/s] or [-0.305%; +0.305%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 187.267µs 191.255µs ± 1.029µs 191.310µs ± 0.653µs 191.900µs 192.798µs 193.323µs 194.823µs 1.84% -0.410 1.357 0.54% 0.073µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5132872.972op/s 5228768.450op/s ± 28193.776op/s 5227124.945op/s ± 17834.336op/s 5247271.621op/s 5272519.598op/s 5308908.436op/s 5339966.941op/s 2.16% 0.462 1.418 0.54% 1993.601op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.186µs 18.223µs ± 0.028µs 18.220µs ± 0.022µs 18.242µs 18.267µs 18.294µs 18.405µs 1.02% 1.616 7.047 0.16% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54332461.251op/s 54877163.478op/s ± 85565.446op/s 54884231.505op/s ± 66414.200op/s 54950281.056op/s 54967283.985op/s 54976394.019op/s 54987993.511op/s 0.19% -1.586 6.806 0.16% 6050.391op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 11.267µs 11.314µs ± 0.023µs 11.310µs ± 0.016µs 11.330µs 11.354µs 11.369µs 11.373µs 0.56% 0.359 -0.523 0.20% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 87925090.549op/s 88385965.196op/s ± 180018.496op/s 88419117.584op/s ± 127910.668op/s 88513153.992op/s 88662907.681op/s 88717154.011op/s 88755381.225op/s 0.38% -0.351 -0.529 0.20% 12729.230op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [191.113µs; 191.398µs] or [-0.075%; +0.075%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5224861.063op/s; 5232675.836op/s] or [-0.075%; +0.075%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.219µs; 18.227µs] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54865304.930op/s; 54889022.026op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/good execution_time [11.311µs; 11.317µs] or [-0.028%; +0.028%] None None None
normalization/normalize_name/normalize_name/good throughput [88361016.364op/s; 88410914.029op/s] or [-0.028%; +0.028%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 66.904µs 67.055µs ± 0.157µs 67.037µs ± 0.058µs 67.087µs 67.209µs 67.355µs 68.865µs 2.73% 8.022 87.471 0.23% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [67.034µs; 67.077µs] or [-0.032%; +0.032%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 140.560µs 141.796µs ± 0.507µs 141.749µs ± 0.177µs 141.937µs 142.615µs 143.062µs 146.863µs 3.61% 5.279 48.972 0.36% 0.036µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [141.725µs; 141.866µs] or [-0.050%; +0.050%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 36.769µs 37.244µs ± 0.825µs 36.874µs ± 0.035µs 36.918µs 38.991µs 39.047µs 40.523µs 9.90% 1.800 1.584 2.21% 0.058µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.130µs; 37.358µs] or [-0.307%; +0.307%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 622.993µs 624.598µs ± 0.486µs 624.660µs ± 0.312µs 624.945µs 625.284µs 625.469µs 625.854µs 0.19% -0.545 0.314 0.08% 0.034µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1597817.108op/s 1601030.173op/s ± 1245.215op/s 1600871.423op/s ± 798.766op/s 1601732.846op/s 1603424.705op/s 1604202.913op/s 1605155.760op/s 0.27% 0.550 0.320 0.08% 88.050op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 463.509µs 464.761µs ± 0.541µs 464.738µs ± 0.399µs 465.147µs 465.646µs 465.913µs 466.579µs 0.40% 0.290 -0.223 0.12% 0.038µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2143260.737op/s 2151648.078op/s ± 2506.083op/s 2151748.801op/s ± 1847.335op/s 2153556.819op/s 2155359.639op/s 2156610.009op/s 2157455.166op/s 0.27% -0.284 -0.230 0.12% 177.207op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 178.285µs 181.598µs ± 1.673µs 181.819µs ± 0.954µs 182.759µs 183.912µs 184.546µs 185.333µs 1.93% -0.504 -0.408 0.92% 0.118µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5395698.838op/s 5507150.119op/s ± 50993.005op/s 5499960.863op/s ± 28719.506op/s 5530416.557op/s 5604868.181op/s 5606904.830op/s 5608989.925op/s 1.98% 0.540 -0.390 0.92% 3605.750op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.786µs 46.966µs ± 0.103µs 46.957µs ± 0.058µs 47.020µs 47.158µs 47.252µs 47.299µs 0.73% 0.731 0.648 0.22% 0.007µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21142289.407op/s 21291925.143op/s ± 46417.296op/s 21296090.650op/s ± 26251.980op/s 21321157.995op/s 21360173.588op/s 21370903.508op/s 21373788.913op/s 0.36% -0.717 0.619 0.22% 3282.198op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.061µs 49.513µs ± 0.205µs 49.488µs ± 0.129µs 49.630µs 49.898µs 50.102µs 50.234µs 1.51% 0.734 0.903 0.41% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19906955.814op/s 20197132.765op/s ± 83567.674op/s 20207118.263op/s ± 52818.061op/s 20249651.124op/s 20319251.839op/s 20364989.385op/s 20382933.701op/s 0.87% -0.705 0.848 0.41% 5909.127op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [624.531µs; 624.666µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1600857.598op/s; 1601202.747op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [464.686µs; 464.836µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2151300.759op/s; 2151995.397op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [181.366µs; 181.829µs] or [-0.128%; +0.128%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5500082.979op/s; 5514217.259op/s] or [-0.128%; +0.128%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.952µs; 46.981µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21285492.152op/s; 21298358.134op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.484µs; 49.541µs] or [-0.058%; +0.058%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20185551.089op/s; 20208714.441op/s] or [-0.057%; +0.057%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.353µs 3.186µs ± 1.381µs 3.043µs ± 0.024µs 3.063µs 3.100µs 13.710µs 14.740µs 384.37% 7.581 57.691 43.23% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.995µs; 3.378µs] or [-6.006%; +6.006%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.688µs 24.483µs ± 12.139µs 19.638µs ± 1.499µs 20.153µs 48.147µs 52.135µs 104.880µs 434.07% 3.066 13.670 49.46% 0.858µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [22.801µs; 26.166µs] or [-6.871%; +6.871%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 80dee15 1728899714 ivoanjo/libdatadog13_1-ruby
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 265.022ns 274.072ns ± 14.299ns 267.771ns ± 1.822ns 272.133ns 302.178ns 319.759ns 323.237ns 20.71% 2.010 2.792 5.20% 1.011ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [272.091ns; 276.054ns] or [-0.723%; +0.723%] None None None

Baseline

Omitted due to size.

Copy link
Contributor

@taegyunkim taegyunkim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@taegyunkim approved this PR from Slack with Graphite

@ivoanjo ivoanjo merged commit e83d9d4 into main Oct 14, 2024
39 of 40 checks passed
@ivoanjo ivoanjo deleted the ivoanjo/libdatadog13_1-ruby branch October 14, 2024 11:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants