Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ruby] Prepare gem release for version 12 #608

Merged
merged 2 commits into from
Sep 4, 2024

Conversation

AlexJF
Copy link
Contributor

@AlexJF AlexJF commented Sep 3, 2024

What does this PR do?

The ruby gem for libdatadog was still only setup for version 11. This PR prepares the release for version 12.

Motivation

Keep things up to date.

Additional Notes

N/A

How to test the change?

We'll trigger the gem release process once this gets merged and will soon push a PR in dd-trace-rb to make it use the new gem.

@AlexJF AlexJF requested a review from a team as a code owner September 3, 2024 14:29
@pr-commenter
Copy link

pr-commenter bot commented Sep 3, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-09-04 09:12:20

Comparing candidate commit c0124b4 in PR branch alexjf/libdatadog-12-ruby-gem with baseline commit cfae8af in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟩 execution_time [-160.159ns; -139.462ns] or [-10.470%; -9.117%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.613µs 1.614µs ± 0.000µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.615µs 1.616µs 0.12% 0.904 1.448 0.03% 0.000µs 1 200
credit_card/is_card_number/ throughput 618818680.633op/s 619552995.146op/s ± 178613.358op/s 619588570.196op/s ± 132115.796op/s 619707447.068op/s 619785243.763op/s 619818302.731op/s 619828757.173op/s 0.04% -0.902 1.439 0.03% 12629.872op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 122.579µs 123.079µs ± 0.380µs 123.051µs ± 0.181µs 123.237µs 123.421µs 123.622µs 127.347µs 3.49% 7.104 77.754 0.31% 0.027µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 7852559.575op/s 8124941.902op/s ± 24553.894op/s 8126714.105op/s ± 11923.550op/s 8138117.956op/s 8150006.029op/s 8156618.787op/s 8157995.298op/s 0.38% -6.837 73.833 0.30% 1736.222op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 111.995µs 113.185µs ± 0.487µs 113.223µs ± 0.343µs 113.558µs 113.911µs 114.086µs 114.294µs 0.95% -0.231 -0.467 0.43% 0.034µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 8749336.427op/s 8835228.008op/s ± 38019.437op/s 8832105.836op/s ± 26813.143op/s 8859165.455op/s 8908801.763op/s 8923993.415op/s 8928992.438op/s 1.10% 0.250 -0.455 0.43% 2688.380op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.613µs 1.614µs ± 0.003µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.618µs 1.658µs 2.74% 13.177 178.650 0.20% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 603098155.222op/s 619520032.782op/s ± 1193850.114op/s 619634814.418op/s ± 145258.065op/s 619768174.500op/s 619862831.767op/s 619961289.505op/s 619983332.383op/s 0.06% -13.135 177.852 0.19% 84417.951op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 108.065µs 109.429µs ± 0.620µs 109.381µs ± 0.459µs 109.853µs 110.476µs 110.696µs 110.988µs 1.47% 0.175 -0.611 0.57% 0.044µs 1 200
credit_card/is_card_number/378282246310005 throughput 9009952.178op/s 9138600.939op/s ± 51751.000op/s 9142353.357op/s ± 38397.184op/s 9176871.340op/s 9223505.043op/s 9234180.030op/s 9253688.047op/s 1.22% -0.152 -0.619 0.56% 3659.348op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 111.469µs 112.016µs ± 0.308µs 111.964µs ± 0.104µs 112.086µs 112.442µs 112.692µs 115.254µs 2.94% 6.104 59.714 0.27% 0.022µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 8676454.993op/s 8927328.245op/s ± 24134.098op/s 8931449.341op/s ± 8286.404op/s 8938860.874op/s 8948496.837op/s 8956378.883op/s 8971138.055op/s 0.44% -5.906 56.883 0.27% 1706.538op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.634µs 22.092µs ± 0.190µs 22.067µs ± 0.108µs 22.194µs 22.416µs 22.629µs 22.909µs 3.82% 0.803 2.357 0.86% 0.013µs 1 200
credit_card/is_card_number/x371413321323331 throughput 43651671.965op/s 45268405.997op/s ± 386002.115op/s 45317493.150op/s ± 222122.482op/s 45479384.299op/s 45883057.152op/s 46165341.655op/s 46224482.991op/s 2.00% -0.709 2.114 0.85% 27294.471op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.613µs 1.614µs ± 0.000µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.615µs 1.615µs 0.09% 0.522 0.177 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 619040721.631op/s 619627441.673op/s ± 167324.212op/s 619622609.156op/s ± 126825.940op/s 619758040.354op/s 619865891.609op/s 619902847.092op/s 619941963.348op/s 0.05% -0.520 0.173 0.03% 11831.608op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 96.598µs 97.189µs ± 0.313µs 97.116µs ± 0.205µs 97.417µs 97.761µs 97.984µs 98.154µs 1.07% 0.574 -0.316 0.32% 0.022µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10188046.612op/s 10289291.940op/s ± 33070.548op/s 10297014.896op/s ± 21755.270op/s 10315303.529op/s 10331310.393op/s 10346870.039op/s 10352213.459op/s 0.54% -0.561 -0.340 0.32% 2338.441op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 87.208µs 88.119µs ± 0.398µs 88.075µs ± 0.245µs 88.325µs 88.750µs 89.075µs 91.067µs 3.40% 2.266 13.705 0.45% 0.028µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 10980910.265op/s 11348517.893op/s ± 50788.709op/s 11353904.382op/s ± 31629.637op/s 11384453.106op/s 11410952.860op/s 11425799.544op/s 11466833.291op/s 0.99% -2.128 12.444 0.45% 3591.304op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.613µs 1.614µs ± 0.000µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.615µs 1.616µs 0.14% 0.646 1.089 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 618741619.751op/s 619594780.602op/s ± 185922.553op/s 619609263.159op/s ± 143132.646op/s 619741703.944op/s 619852999.202op/s 619891583.480op/s 619981040.347op/s 0.06% -0.643 1.079 0.03% 13146.710op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 83.326µs 84.102µs ± 0.325µs 84.088µs ± 0.223µs 84.314µs 84.644µs 84.922µs 85.134µs 1.24% 0.337 -0.117 0.38% 0.023µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11746216.188op/s 11890433.267op/s ± 45829.568op/s 11892315.188op/s ± 31489.715op/s 11923082.503op/s 11960218.887op/s 11980864.915op/s 12001075.458op/s 0.91% -0.317 -0.141 0.38% 3240.640op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 110.378µs 112.043µs ± 0.316µs 112.015µs ± 0.158µs 112.209µs 112.580µs 112.757µs 113.281µs 1.13% -0.383 4.532 0.28% 0.022µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 8827603.957op/s 8925189.190op/s ± 25210.864op/s 8927387.310op/s ± 12558.395op/s 8938601.196op/s 8954434.067op/s 9001255.450op/s 9059741.749op/s 1.48% 0.437 4.700 0.28% 1782.677op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 21.642µs 22.028µs ± 0.185µs 22.024µs ± 0.120µs 22.126µs 22.336µs 22.592µs 22.684µs 3.00% 0.803 1.071 0.84% 0.013µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 44084149.375op/s 45400351.856op/s ± 379777.425op/s 45404580.519op/s ± 249451.621op/s 45662027.277op/s 45960882.865op/s 46080015.872op/s 46206680.349op/s 1.77% -0.743 0.935 0.83% 26854.319op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.614µs; 1.614µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ throughput [619528241.052op/s; 619577749.239op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [123.026µs; 123.132µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8121538.968op/s; 8128344.835op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [113.118µs; 113.253µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/ 378282246310005 throughput [8829958.880op/s; 8840497.137op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/37828224631 execution_time [1.614µs; 1.615µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/37828224631 throughput [619354576.638op/s; 619685488.926op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/378282246310005 execution_time [109.343µs; 109.515µs] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/378282246310005 throughput [9131428.748op/s; 9145773.130op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [111.974µs; 112.059µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [8923983.491op/s; 8930672.999op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.066µs; 22.118µs] or [-0.119%; +0.119%] None None None
credit_card/is_card_number/x371413321323331 throughput [45214909.816op/s; 45321902.177op/s] or [-0.118%; +0.118%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.614µs; 1.614µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ throughput [619604252.147op/s; 619650631.200op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [97.146µs; 97.233µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10284708.680op/s; 10293875.200op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [88.064µs; 88.174µs] or [-0.063%; +0.063%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11341479.066op/s; 11355556.719op/s] or [-0.062%; +0.062%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.614µs; 1.614µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [619569013.524op/s; 619620547.680op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [84.057µs; 84.147µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [11884081.730op/s; 11896784.805op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [112.000µs; 112.087µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [8921695.207op/s; 8928683.174op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.002µs; 22.054µs] or [-0.117%; +0.117%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [45347718.357op/s; 45452985.354op/s] or [-0.116%; +0.116%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 618.677µs 619.203µs ± 0.241µs 619.173µs ± 0.167µs 619.365µs 619.602µs 619.803µs 620.144µs 0.16% 0.466 0.563 0.04% 0.017µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1612528.356op/s 1614978.864op/s ± 627.199op/s 1615057.852op/s ± 436.505op/s 1615428.679op/s 1615875.116op/s 1616304.166op/s 1616351.616op/s 0.08% -0.463 0.557 0.04% 44.350op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 466.078µs 467.700µs ± 1.059µs 467.551µs ± 0.896µs 468.531µs 469.504µs 469.702µs 469.798µs 0.48% 0.328 -1.119 0.23% 0.075µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2128573.932op/s 2138132.166op/s ± 4837.389op/s 2138804.594op/s ± 4107.331op/s 2142758.282op/s 2144530.788op/s 2144869.745op/s 2145563.860op/s 0.32% -0.323 -1.123 0.23% 342.055op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.612µs 190.973µs ± 0.161µs 190.963µs ± 0.105µs 191.070µs 191.208µs 191.508µs 191.680µs 0.38% 0.805 2.033 0.08% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5217032.568op/s 5236334.877op/s ± 4398.461op/s 5236619.330op/s ± 2887.413op/s 5239321.633op/s 5242839.381op/s 5244888.526op/s 5246258.711op/s 0.18% -0.796 2.004 0.08% 311.018op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 47.095µs 47.494µs ± 0.138µs 47.507µs ± 0.091µs 47.597µs 47.690µs 47.772µs 47.807µs 0.63% -0.385 0.047 0.29% 0.010µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 20917561.632op/s 21055558.453op/s ± 61221.970op/s 21049563.027op/s ± 40530.821op/s 21091974.794op/s 21158829.678op/s 21212273.862op/s 21233822.577op/s 0.88% 0.402 0.065 0.29% 4329.047op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 51.352µs 51.608µs ± 0.141µs 51.598µs ± 0.070µs 51.669µs 51.794µs 51.877µs 52.923µs 2.57% 4.147 36.674 0.27% 0.010µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 18895333.797op/s 19377082.197op/s ± 52187.915op/s 19380468.793op/s ± 26356.960op/s 19406061.327op/s 19441569.166op/s 19465116.625op/s 19473365.999op/s 0.48% -3.976 34.613 0.27% 3690.243op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [619.170µs; 619.237µs] or [-0.005%; +0.005%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1614891.940op/s; 1615065.788op/s] or [-0.005%; +0.005%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [467.554µs; 467.847µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2137461.751op/s; 2138802.582op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.951µs; 190.996µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5235725.293op/s; 5236944.461op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [47.475µs; 47.513µs] or [-0.040%; +0.040%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21047073.676op/s; 21064043.229op/s] or [-0.040%; +0.040%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [51.588µs; 51.627µs] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19369849.454op/s; 19384314.941op/s] or [-0.037%; +0.037%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.467µs 2.883µs ± 1.403µs 2.723µs ± 0.022µs 2.744µs 2.943µs 12.466µs 16.235µs 496.21% 8.050 65.308 48.53% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.689µs; 3.077µs] or [-6.743%; +6.743%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 303.082µs 303.620µs ± 0.263µs 303.614µs ± 0.167µs 303.764µs 304.103µs 304.320µs 304.380µs 0.25% 0.494 0.118 0.09% 0.019µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3285366.975op/s 3293593.638op/s ± 2856.929op/s 3293659.979op/s ± 1807.442op/s 3295640.363op/s 3298129.627op/s 3299108.105op/s 3299433.890op/s 0.18% -0.489 0.112 0.09% 202.015op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 28.084µs 28.306µs ± 0.191µs 28.254µs ± 0.093µs 28.347µs 28.826µs 28.886µs 28.918µs 2.35% 1.635 2.291 0.67% 0.013µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 34580294.268op/s 35329906.632op/s ± 235534.875op/s 35393480.143op/s ± 115937.500op/s 35496852.146op/s 35556480.566op/s 35591920.602op/s 35607438.705op/s 0.60% -1.603 2.184 0.67% 16654.831op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.503µs 16.541µs ± 0.030µs 16.544µs ± 0.016µs 16.553µs 16.583µs 16.622µs 16.783µs 1.45% 2.872 19.752 0.18% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 59583307.223op/s 60456053.990op/s ± 109467.263op/s 60444496.321op/s ± 56969.753op/s 60550113.446op/s 60582361.002op/s 60592516.564op/s 60594283.661op/s 0.25% -2.800 19.006 0.18% 7740.504op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [303.583µs; 303.656µs] or [-0.012%; +0.012%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3293197.695op/s; 3293989.581op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [28.279µs; 28.332µs] or [-0.093%; +0.093%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [35297263.764op/s; 35362549.501op/s] or [-0.092%; +0.092%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.537µs; 16.545µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/good throughput [60440882.880op/s; 60471225.099op/s] or [-0.025%; +0.025%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.537µs 38.186µs ± 1.175µs 37.641µs ± 0.048µs 37.763µs 40.713µs 40.796µs 41.275µs 9.66% 1.690 0.902 3.07% 0.083µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.023µs; 38.349µs] or [-0.427%; +0.427%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 296.741ns 307.148ns ± 13.515ns 301.848ns ± 3.377ns 306.899ns 344.705ns 351.406ns 352.874ns 16.90% 2.210 4.013 4.39% 0.956ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [305.275ns; 309.021ns] or [-0.610%; +0.610%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.649µs 2.678µs ± 0.016µs 2.674µs ± 0.005µs 2.682µs 2.721µs 2.732µs 2.733µs 2.22% 1.689 2.823 0.61% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.676µs; 2.681µs] or [-0.085%; +0.085%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 138.075µs 138.781µs ± 0.216µs 138.819µs ± 0.115µs 138.918µs 139.059µs 139.239µs 139.820µs 0.72% -0.023 2.867 0.16% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [138.751µs; 138.811µs] or [-0.022%; +0.022%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 16.968µs 22.841µs ± 14.936µs 17.106µs ± 0.045µs 17.174µs 50.677µs 53.395µs 134.045µs 683.62% 4.060 22.584 65.22% 1.056µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [20.771µs; 24.911µs] or [-9.062%; +9.062%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 74.672µs 74.927µs ± 0.262µs 74.902µs ± 0.073µs 74.971µs 75.144µs 75.319µs 78.215µs 4.42% 9.991 122.372 0.35% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [74.890µs; 74.963µs] or [-0.048%; +0.048%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c0124b4 1725440540 alexjf/libdatadog-12-ruby-gem
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.185µs 1.380µs ± 0.049µs 1.389µs ± 0.028µs 1.416µs 1.443µs 1.462µs 1.463µs 5.36% -1.407 3.700 3.54% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.373µs; 1.387µs] or [-0.492%; +0.492%] None None None

Baseline

Omitted due to size.

Copy link
Member

@ivoanjo ivoanjo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for picking this up! Slight "nitpick" with the format as standardrb won't like it ;)

ruby/lib/libdatadog/version.rb Outdated Show resolved Hide resolved
ruby/lib/libdatadog/version.rb Outdated Show resolved Hide resolved
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 72.68%. Comparing base (cfae8af) to head (c0124b4).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #608      +/-   ##
==========================================
- Coverage   72.79%   72.68%   -0.12%     
==========================================
  Files         243      243              
  Lines       34683    34683              
==========================================
- Hits        25249    25210      -39     
- Misses       9434     9473      +39     
Components Coverage Δ
crashtracker 20.44% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.12% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 82.11% <ø> (ø)
ddcommon-ffi 68.11% <ø> (ø)
ddtelemetry 59.02% <ø> (ø)
ipc 84.00% <ø> (ø)
profiling 83.57% <ø> (-0.70%) ⬇️
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.15% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 91.66% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.00% <ø> (ø)

@AlexJF AlexJF merged commit d4dd94f into main Sep 4, 2024
40 checks passed
@AlexJF AlexJF deleted the alexjf/libdatadog-12-ruby-gem branch September 4, 2024 10:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants