Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Gitlab] Fix build in Gitlab #626

Merged
merged 1 commit into from
Sep 13, 2024
Merged

Conversation

gleocadie
Copy link
Contributor

What does this PR do?

Enable the demangler feature when building artifacts on Gitlab.

Motivation

Since #551, ddog_crasht_demangle is not include in the sofile. A fix was provided for github which uses the new builder. But in GitLab we still rely on the build-profiling.sh shell script.

Additional Notes

🤷‍♂️

How to test the change?

download the artifact from gitlab and check the presence of ddog_crasht_demangle

@gleocadie gleocadie requested a review from a team as a code owner September 13, 2024 06:41
@gleocadie gleocadie force-pushed the gleocadie/fix-demangle-in-gitlab branch from 2752313 to 01dfccc Compare September 13, 2024 06:42
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.21%. Comparing base (0c03f15) to head (01dfccc).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #626      +/-   ##
==========================================
+ Coverage   73.13%   73.21%   +0.07%     
==========================================
  Files         252      252              
  Lines       35959    35942      -17     
==========================================
+ Hits        26300    26314      +14     
+ Misses       9659     9628      -31     
Components Coverage Δ
crashtracker 20.53% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.12% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ipc 83.63% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.12% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 91.66% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.28% <ø> (+0.41%) ⬆️

@pr-commenter
Copy link

pr-commenter bot commented Sep 13, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-09-13 06:57:11

Comparing candidate commit 01dfccc in PR branch gleocadie/fix-demangle-in-gitlab with baseline commit 0c03f15 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟥 execution_time [+226.129ns; +246.260ns] or [+16.869%; +18.371%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 143.180µs 143.994µs ± 0.395µs 143.934µs ± 0.173µs 144.130µs 144.464µs 145.507µs 147.050µs 2.17% 3.239 19.504 0.27% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [143.939µs; 144.049µs] or [-0.038%; +0.038%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.212µs 1.213µs ± 0.001µs 1.212µs ± 0.000µs 1.213µs 1.213µs 1.214µs 1.218µs 0.43% 3.331 24.243 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 821275842.564op/s 824711992.375op/s ± 406265.281op/s 824820395.359op/s ± 205376.278op/s 824970981.646op/s 825125208.633op/s 825306673.259op/s 825408907.573op/s 0.07% -3.309 23.991 0.05% 28727.294op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 107.963µs 109.203µs ± 0.786µs 109.055µs ± 0.424µs 109.563µs 110.682µs 111.890µs 112.178µs 2.86% 1.246 1.924 0.72% 0.056µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8914371.935op/s 9157704.682op/s ± 65348.044op/s 9169690.996op/s ± 35755.447op/s 9203386.179op/s 9243903.132op/s 9254455.725op/s 9262428.770op/s 1.01% -1.195 1.753 0.71% 4620.804op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 102.120µs 103.014µs ± 0.857µs 102.701µs ± 0.290µs 103.206µs 104.722µs 106.466µs 107.088µs 4.27% 2.175 5.420 0.83% 0.061µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9338106.357op/s 9708072.485op/s ± 79372.216op/s 9737017.246op/s ± 27457.581op/s 9756670.159op/s 9779167.891op/s 9784413.632op/s 9792426.800op/s 0.57% -2.110 5.040 0.82% 5612.463op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.211µs 1.212µs ± 0.001µs 1.212µs ± 0.000µs 1.213µs 1.213µs 1.215µs 1.218µs 0.46% 3.608 27.043 0.05% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 821061368.615op/s 824749784.304op/s ± 432510.901op/s 824801305.366op/s ± 206068.094op/s 824967805.631op/s 825359572.025op/s 825423819.638op/s 825442767.500op/s 0.08% -3.583 26.775 0.05% 30583.139op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 98.116µs 99.170µs ± 0.620µs 98.985µs ± 0.238µs 99.431µs 100.547µs 101.307µs 101.703µs 2.74% 1.646 2.654 0.62% 0.044µs 1 200
credit_card/is_card_number/378282246310005 throughput 9832597.592op/s 10084072.034op/s ± 62383.118op/s 10102499.871op/s ± 24341.304op/s 10124754.014op/s 10144466.383op/s 10156757.306op/s 10192002.185op/s 0.89% -1.610 2.509 0.62% 4411.153op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 100.080µs 100.565µs ± 0.408µs 100.473µs ± 0.194µs 100.741µs 101.197µs 101.645µs 104.145µs 3.65% 3.824 28.397 0.40% 0.029µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9602022.109op/s 9944013.921op/s ± 39757.729op/s 9952968.739op/s ± 19240.882op/s 9969482.914op/s 9987761.403op/s 9991188.072op/s 9991967.457op/s 0.39% -3.639 26.202 0.40% 2811.296op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 19.230µs 19.375µs ± 0.116µs 19.371µs ± 0.097µs 19.449µs 19.573µs 19.678µs 19.712µs 1.76% 0.568 -0.514 0.60% 0.008µs 1 200
credit_card/is_card_number/x371413321323331 throughput 50730813.749op/s 51613942.383op/s ± 308223.933op/s 51623166.841op/s ± 260322.124op/s 51895127.592op/s 51988869.471op/s 51995642.593op/s 52001346.391op/s 0.73% -0.547 -0.556 0.60% 21794.723op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.211µs 1.212µs ± 0.000µs 1.212µs ± 0.000µs 1.213µs 1.213µs 1.213µs 1.214µs 0.11% 0.452 -0.580 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 824061517.137op/s 824916156.986op/s ± 332969.279op/s 824975170.468op/s ± 239294.428op/s 825147498.141op/s 825392037.573op/s 825423058.218op/s 825442237.660op/s 0.06% -0.451 -0.582 0.04% 23544.484op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 89.053µs 91.162µs ± 0.551µs 91.177µs ± 0.279µs 91.454µs 92.031µs 92.411µs 92.678µs 1.65% -0.369 1.398 0.60% 0.039µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10790028.209op/s 10969886.423op/s ± 66408.436op/s 10967635.059op/s ± 33520.997op/s 11002387.294op/s 11076471.700op/s 11169133.825op/s 11229226.696op/s 2.39% 0.428 1.490 0.60% 4695.786op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 83.279µs 84.973µs ± 0.489µs 84.994µs ± 0.340µs 85.348µs 85.695µs 85.959µs 86.164µs 1.38% -0.377 0.240 0.57% 0.035µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11605711.111op/s 11768817.995op/s ± 67895.670op/s 11765492.424op/s ± 47116.044op/s 11808801.991op/s 11885987.812op/s 11943581.969op/s 12007882.870op/s 2.06% 0.413 0.298 0.58% 4800.949op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.212µs 1.212µs ± 0.001µs 1.212µs ± 0.000µs 1.213µs 1.213µs 1.213µs 1.223µs 0.88% 8.834 102.618 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 817772864.157op/s 824845615.146op/s ± 589886.811op/s 824947310.739op/s ± 211281.074op/s 825123072.023op/s 825256073.239op/s 825313801.614op/s 825392098.769op/s 0.05% -8.777 101.681 0.07% 41711.296op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 79.762µs 80.852µs ± 0.447µs 80.819µs ± 0.282µs 81.106µs 81.664µs 81.919µs 82.190µs 1.70% 0.447 -0.019 0.55% 0.032µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 12166974.455op/s 12368685.879op/s ± 68187.494op/s 12373307.207op/s ± 43137.816op/s 12416027.861op/s 12462706.114op/s 12489991.384op/s 12537327.618op/s 1.33% -0.418 -0.047 0.55% 4821.584op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 100.079µs 100.491µs ± 0.282µs 100.420µs ± 0.171µs 100.673µs 101.085µs 101.249µs 101.301µs 0.88% 0.872 0.179 0.28% 0.020µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9871604.970op/s 9951201.266op/s ± 27821.877op/s 9958177.653op/s ± 16987.391op/s 9971472.369op/s 9985714.637op/s 9990389.715op/s 9992134.192op/s 0.34% -0.860 0.152 0.28% 1967.304op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 19.238µs 19.430µs ± 0.126µs 19.423µs ± 0.084µs 19.502µs 19.639µs 19.720µs 20.027µs 3.11% 0.695 1.511 0.65% 0.009µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 49932837.909op/s 51469786.449op/s ± 333432.363op/s 51484618.971op/s ± 224549.787op/s 51709163.567op/s 51965947.480op/s 51977363.222op/s 51981546.652op/s 0.97% -0.638 1.280 0.65% 23577.228op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.212µs; 1.213µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ throughput [824655687.914op/s; 824768296.835op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [109.094µs; 109.312µs] or [-0.100%; +0.100%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [9148648.072op/s; 9166761.293op/s] or [-0.099%; +0.099%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [102.895µs; 103.133µs] or [-0.115%; +0.115%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9697072.260op/s; 9719072.711op/s] or [-0.113%; +0.113%] None None None
credit_card/is_card_number/37828224631 execution_time [1.212µs; 1.213µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631 throughput [824689842.453op/s; 824809726.156op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/378282246310005 execution_time [99.084µs; 99.256µs] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/378282246310005 throughput [10075426.334op/s; 10092717.734op/s] or [-0.086%; +0.086%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [100.508µs; 100.621µs] or [-0.056%; +0.056%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9938503.882op/s; 9949523.960op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/x371413321323331 execution_time [19.359µs; 19.391µs] or [-0.083%; +0.083%] None None None
credit_card/is_card_number/x371413321323331 throughput [51571225.511op/s; 51656659.256op/s] or [-0.083%; +0.083%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.212µs; 1.212µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/ throughput [824870010.646op/s; 824962303.326op/s] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [91.086µs; 91.238µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10960682.853op/s; 10979089.994op/s] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [84.905µs; 85.041µs] or [-0.080%; +0.080%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11759408.308op/s; 11778227.681op/s] or [-0.080%; +0.080%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.212µs; 1.212µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [824763862.508op/s; 824927367.785op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [80.790µs; 80.914µs] or [-0.077%; +0.077%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12359235.748op/s; 12378136.010op/s] or [-0.076%; +0.076%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [100.452µs; 100.530µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9947345.422op/s; 9955057.111op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [19.412µs; 19.447µs] or [-0.090%; +0.090%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [51423575.930op/s; 51515996.968op/s] or [-0.090%; +0.090%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.414µs 3.255µs ± 1.608µs 3.095µs ± 0.032µs 3.123µs 3.189µs 14.101µs 18.724µs 504.89% 8.016 65.481 49.28% 0.114µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.032µs; 3.478µs] or [-6.847%; +6.847%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.430µs 1.577µs ± 0.047µs 1.589µs ± 0.030µs 1.610µs 1.638µs 1.654µs 1.655µs 4.17% -0.726 0.384 2.97% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.570µs; 1.583µs] or [-0.412%; +0.412%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.894ms 8.935ms ± 0.022ms 8.933ms ± 0.009ms 8.942ms 8.963ms 8.971ms 9.176ms 2.72% 6.322 65.420 0.25% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.932ms; 8.938ms] or [-0.035%; +0.035%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 295.348ns 304.835ns ± 13.022ns 297.467ns ± 1.634ns 309.217ns 335.946ns 336.520ns 336.779ns 13.22% 1.336 0.269 4.26% 0.921ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [303.030ns; 306.640ns] or [-0.592%; +0.592%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 280.703µs 282.220µs ± 1.109µs 281.964µs ± 0.649µs 282.753µs 284.410µs 285.617µs 287.066µs 1.81% 1.441 3.059 0.39% 0.078µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3483519.469op/s 3543387.623op/s ± 13841.522op/s 3546554.211op/s ± 8157.366op/s 3553158.902op/s 3559700.763op/s 3562227.181op/s 3562489.443op/s 0.45% -1.407 2.897 0.39% 978.743op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 27.573µs 27.821µs ± 0.053µs 27.826µs ± 0.029µs 27.849µs 27.897µs 27.941µs 27.996µs 0.61% -0.640 2.837 0.19% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 35719496.813op/s 35944393.587op/s ± 68148.075op/s 35936984.863op/s ± 37073.139op/s 35981488.882op/s 36067121.342op/s 36128342.905op/s 36267114.828op/s 0.92% 0.666 2.899 0.19% 4818.797op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.823µs 16.868µs ± 0.078µs 16.851µs ± 0.020µs 16.883µs 16.931µs 16.964µs 17.864µs 6.01% 10.401 129.020 0.46% 0.006µs 1 200
normalization/normalize_name/normalize_name/good throughput 55977450.966op/s 59285801.901op/s ± 263032.519op/s 59342209.075op/s ± 71388.704op/s 59399918.563op/s 59426756.525op/s 59435296.957op/s 59441539.246op/s 0.17% -10.084 123.534 0.44% 18599.208op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [282.066µs; 282.374µs] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3541469.322op/s; 3545305.925op/s] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [27.814µs; 27.828µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [35934948.919op/s; 35953838.255op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.857µs; 16.879µs] or [-0.064%; +0.064%] None None None
normalization/normalize_name/normalize_name/good throughput [59249348.123op/s; 59322255.678op/s] or [-0.061%; +0.061%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.700µs 2.723µs ± 0.018µs 2.719µs ± 0.010µs 2.731µs 2.759µs 2.766µs 2.769µs 1.84% 0.903 -0.149 0.64% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.721µs; 2.726µs] or [-0.089%; +0.089%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 578.566µs 579.585µs ± 0.312µs 579.614µs ± 0.206µs 579.794µs 580.063µs 580.155µs 580.251µs 0.11% -0.362 -0.072 0.05% 0.022µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1723392.489op/s 1725371.719op/s ± 929.712op/s 1725284.929op/s ± 612.655op/s 1725966.609op/s 1726945.176op/s 1727547.544op/s 1728411.279op/s 0.18% 0.365 -0.069 0.05% 65.741op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 464.350µs 464.969µs ± 0.298µs 464.944µs ± 0.215µs 465.178µs 465.445µs 465.641µs 466.096µs 0.25% 0.347 0.229 0.06% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2145480.759op/s 2150683.883op/s ± 1379.654op/s 2150795.925op/s ± 992.746op/s 2151605.888op/s 2152975.810op/s 2153345.931op/s 2153548.458op/s 0.13% -0.343 0.221 0.06% 97.556op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 183.959µs 184.275µs ± 0.156µs 184.298µs ± 0.106µs 184.383µs 184.503µs 184.577µs 184.621µs 0.18% -0.263 -0.617 0.08% 0.011µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5416507.049op/s 5426670.336op/s ± 4590.819op/s 5426008.473op/s ± 3106.845op/s 5429390.472op/s 5435301.510op/s 5435913.582op/s 5435988.719op/s 0.18% 0.267 -0.616 0.08% 324.620op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.622µs 46.846µs ± 0.080µs 46.851µs ± 0.055µs 46.893µs 46.974µs 47.050µs 47.106µs 0.55% 0.293 0.472 0.17% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21228634.517op/s 21346765.728op/s ± 36531.124op/s 21344390.139op/s ± 25097.927op/s 21372420.845op/s 21401349.850op/s 21425527.091op/s 21448874.539op/s 0.49% -0.281 0.457 0.17% 2583.141op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.159µs 44.398µs ± 0.122µs 44.384µs ± 0.092µs 44.481µs 44.602µs 44.691µs 44.764µs 0.85% 0.413 -0.358 0.28% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22339490.759op/s 22523760.128op/s ± 62039.171op/s 22530407.604op/s ± 46548.011op/s 22573059.118op/s 22619691.535op/s 22631135.353op/s 22645292.195op/s 0.51% -0.401 -0.374 0.27% 4386.832op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [579.542µs; 579.629µs] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1725242.870op/s; 1725500.569op/s] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [464.927µs; 465.010µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2150492.676op/s; 2150875.090op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [184.254µs; 184.297µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5426034.092op/s; 5427306.579op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.835µs; 46.857µs] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21341702.865op/s; 21351828.590op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [44.381µs; 44.415µs] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22515162.096op/s; 22532358.160op/s] or [-0.038%; +0.038%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.513µs 24.450µs ± 10.923µs 19.892µs ± 0.353µs 22.953µs 36.661µs 45.347µs 121.941µs 513.02% 5.026 36.965 44.56% 0.772µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [22.937µs; 25.964µs] or [-6.191%; +6.191%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 35.708µs 36.203µs ± 0.847µs 35.814µs ± 0.055µs 35.918µs 38.004µs 38.062µs 39.047µs 9.03% 1.728 1.131 2.33% 0.060µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [36.086µs; 36.320µs] or [-0.324%; +0.324%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 01dfccc 1726209734 gleocadie/fix-demangle-in-gitlab
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 72.729µs 72.905µs ± 0.151µs 72.898µs ± 0.039µs 72.928µs 73.012µs 73.291µs 74.718µs 2.50% 8.940 102.317 0.21% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [72.884µs; 72.926µs] or [-0.029%; +0.029%] None None None

Baseline

Omitted due to size.

@gleocadie gleocadie merged commit 1d8c245 into main Sep 13, 2024
30 checks passed
@gleocadie gleocadie deleted the gleocadie/fix-demangle-in-gitlab branch September 13, 2024 07:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants