Skip to content

Conversation

@iunanua
Copy link
Contributor

@iunanua iunanua commented Nov 24, 2025

What does this PR do?

Add a check in build.rs to skip building libtest.so and libtest_cpp.so during cargo publish

Motivation

cargo publish fails with

error: failed to verify package tarball

Caused by:
  Source directory was modified by build.rs during cargo publish. Build scripts should not modify anything outside of OUT_DIR.

@iunanua iunanua changed the title [Versioning] Do not build test.so during cargo publish [Versioning] Do not build .so files during cargo publish Nov 24, 2025
@iunanua iunanua marked this pull request as ready for review November 24, 2025 16:35
@iunanua iunanua requested a review from a team as a code owner November 24, 2025 16:35
@pr-commenter
Copy link

pr-commenter bot commented Nov 24, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-11-24 16:45:44

Comparing candidate commit 380eb0a in PR branch igor/versioning/crashtracker-skip-publish-so with baseline commit 4c350fa in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.214ms 6.461ms ± 0.061ms 6.471ms ± 0.016ms 6.487ms 6.524ms 6.596ms 6.664ms 2.98% -1.603 4.632 0.94% 0.004ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.452ms; 6.469ms] or [-0.131%; +0.131%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.625ms 10.656ms ± 0.017ms 10.654ms ± 0.011ms 10.665ms 10.680ms 10.724ms 10.731ms 0.72% 1.211 3.734 0.16% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.653ms; 10.658ms] or [-0.022%; +0.022%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.113ms 61.663ms ± 1.878ms 61.449ms ± 0.110ms 61.528ms 61.799ms 71.418ms 80.368ms 30.79% 8.548 74.258 3.04% 0.133ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.403ms; 61.924ms] or [-0.422%; +0.422%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.901µs 86.094µs ± 0.204µs 86.063µs ± 0.050µs 86.125µs 86.259µs 86.673µs 88.557µs 2.90% 9.161 105.775 0.24% 0.014µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.066µs; 86.122µs] or [-0.033%; +0.033%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.989µs 534.781µs ± 1.068µs 534.635µs ± 0.247µs 534.929µs 535.411µs 541.805µs 544.160µs 1.78% 6.757 50.577 0.20% 0.075µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1837695.590op/s 1869931.462op/s ± 3683.347op/s 1870435.175op/s ± 864.845op/s 1871263.252op/s 1872186.603op/s 1872665.670op/s 1872698.784op/s 0.12% -6.716 50.099 0.20% 260.452op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.178µs 381.067µs ± 0.335µs 381.029µs ± 0.216µs 381.269µs 381.711µs 381.971µs 382.061µs 0.27% 0.438 0.281 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2617385.173op/s 2624212.983op/s ± 2307.669op/s 2624472.303op/s ± 1489.520op/s 2625775.579op/s 2627727.328op/s 2628400.407op/s 2630345.634op/s 0.22% -0.433 0.275 0.09% 163.177op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 195.841µs 196.458µs ± 0.257µs 196.503µs ± 0.170µs 196.645µs 196.813µs 196.948µs 196.982µs 0.24% -0.360 -0.705 0.13% 0.018µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5076615.479op/s 5090157.823op/s ± 6653.457op/s 5088974.357op/s ± 4405.942op/s 5094925.180op/s 5101808.537op/s 5104115.652op/s 5106194.741op/s 0.34% 0.365 -0.703 0.13% 470.470op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.000µs 37.173µs ± 0.072µs 37.171µs ± 0.047µs 37.218µs 37.289µs 37.349µs 37.488µs 0.85% 0.491 1.322 0.19% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26675012.430op/s 26901176.019op/s ± 51728.004op/s 26902617.218op/s ± 34212.569op/s 26935629.395op/s 26984440.458op/s 27007345.430op/s 27027307.323op/s 0.46% -0.473 1.271 0.19% 3657.722op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.888µs 45.080µs ± 0.089µs 45.093µs ± 0.068µs 45.150µs 45.209µs 45.228µs 45.448µs 0.79% 0.104 0.154 0.20% 0.006µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22003001.698op/s 22182742.915op/s ± 43854.560op/s 22176410.144op/s ± 33283.880op/s 22217638.806op/s 22254704.205op/s 22266483.098op/s 22277497.920op/s 0.46% -0.091 0.118 0.20% 3100.986op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.633µs; 534.929µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869420.986op/s; 1870441.939op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.020µs; 381.113µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2623893.162op/s; 2624532.804op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [196.422µs; 196.493µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5089235.718op/s; 5091079.928op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.163µs; 37.183µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26894007.015op/s; 26908345.023op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.068µs; 45.093µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22176665.095op/s; 22188820.735op/s] or [-0.027%; +0.027%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.899µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.924µs 3.932µs 0.43% 0.422 4.531 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 254346386.529op/s 255413995.352op/s ± 215841.291op/s 255431161.308op/s ± 149031.840op/s 255579939.023op/s 255688546.022op/s 255755602.948op/s 256449298.368op/s 0.40% -0.406 4.525 0.08% 15262.284op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.873µs 78.315µs ± 0.490µs 78.076µs ± 0.152µs 78.497µs 79.304µs 79.855µs 80.629µs 3.27% 1.846 3.875 0.62% 0.035µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12402550.352op/s 12769396.169op/s ± 79054.043op/s 12807962.711op/s ± 25050.216op/s 12823677.960op/s 12835639.823op/s 12839757.283op/s 12841443.190op/s 0.26% -1.801 3.621 0.62% 5589.965op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.433µs 71.694µs ± 0.354µs 71.551µs ± 0.057µs 71.718µs 72.496µs 72.885µs 73.780µs 3.12% 2.584 7.834 0.49% 0.025µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13553766.630op/s 13948574.729op/s ± 67945.912op/s 13976081.334op/s ± 11227.516op/s 13984983.275op/s 13996094.880op/s 13998512.672op/s 13999045.265op/s 0.16% -2.539 7.461 0.49% 4804.502op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.915µs ± 0.004µs 3.914µs ± 0.002µs 3.917µs 3.920µs 3.922µs 3.942µs 0.71% 1.438 18.677 0.09% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 253662821.648op/s 255429523.862op/s ± 238484.148op/s 255461284.869op/s ± 129103.012op/s 255577708.424op/s 255650143.379op/s 255735714.166op/s 256786629.407op/s 0.52% -1.386 18.474 0.09% 16863.376op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.242µs 68.457µs ± 0.390µs 68.319µs ± 0.033µs 68.372µs 69.145µs 70.493µs 71.061µs 4.01% 3.857 18.113 0.57% 0.028µs 1 200
credit_card/is_card_number/378282246310005 throughput 14072470.912op/s 14608151.049op/s ± 81379.647op/s 14637264.279op/s ± 7014.498op/s 14642919.497op/s 14649395.050op/s 14652815.017op/s 14653798.490op/s 0.11% -3.771 17.265 0.56% 5754.410op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.467µs 45.741µs ± 0.104µs 45.743µs ± 0.072µs 45.815µs 45.900µs 45.959µs 45.984µs 0.53% -0.160 -0.330 0.23% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21746875.897op/s 21862461.209op/s ± 49578.237op/s 21861090.538op/s ± 34423.790op/s 21895062.688op/s 21944717.196op/s 21978396.778op/s 21993763.814op/s 0.61% 0.171 -0.325 0.23% 3505.711op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.559µs 6.620µs ± 0.018µs 6.620µs ± 0.013µs 6.634µs 6.643µs 6.647µs 6.648µs 0.42% -0.810 0.585 0.27% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150421029.755op/s 151065808.460op/s ± 412580.937op/s 151051671.559op/s ± 297148.834op/s 151295700.718op/s 151809849.046op/s 152386950.364op/s 152451174.060op/s 0.93% 0.826 0.629 0.27% 29173.878op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.915µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.919µs 3.922µs 3.927µs 0.33% -0.557 9.441 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254617267.396op/s 255448367.753op/s ± 184598.539op/s 255463724.158op/s ± 110817.410op/s 255563597.001op/s 255665854.275op/s 255712755.570op/s 256649172.334op/s 0.46% 0.581 9.553 0.07% 13053.088op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.604µs 65.699µs ± 0.048µs 65.694µs ± 0.034µs 65.731µs 65.782µs 65.816µs 65.901µs 0.32% 0.529 0.615 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15174168.210op/s 15220851.537op/s ± 11210.062op/s 15222108.471op/s ± 7762.954op/s 15228906.515op/s 15237295.785op/s 15241928.071op/s 15243024.623op/s 0.14% -0.524 0.600 0.07% 792.671op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.358µs 53.430µs ± 0.035µs 53.426µs ± 0.024µs 53.454µs 53.490µs 53.506µs 53.523µs 0.18% 0.363 -0.575 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18683617.876op/s 18716066.774op/s ± 12192.473op/s 18717443.907op/s ± 8297.360op/s 18725372.369op/s 18732860.213op/s 18739797.987op/s 18741395.656op/s 0.13% -0.360 -0.576 0.06% 862.138op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.901µs 3.915µs ± 0.004µs 3.914µs ± 0.002µs 3.917µs 3.922µs 3.926µs 3.927µs 0.33% 0.698 1.971 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254635304.716op/s 255430705.652op/s ± 229805.769op/s 255483070.323op/s ± 121285.370op/s 255576654.585op/s 255720929.767op/s 255790412.159op/s 256354304.534op/s 0.34% -0.689 1.974 0.09% 16249.722op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.153µs 50.220µs ± 0.038µs 50.213µs ± 0.022µs 50.239µs 50.298µs 50.330µs 50.345µs 0.26% 1.045 1.133 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19862977.238op/s 19912317.309op/s ± 15158.999op/s 19915011.692op/s ± 8925.688op/s 19922992.157op/s 19932038.923op/s 19933995.809op/s 19939183.496op/s 0.12% -1.040 1.120 0.08% 1071.903op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.517µs 45.723µs ± 0.089µs 45.725µs ± 0.059µs 45.781µs 45.872µs 45.902µs 45.923µs 0.43% -0.080 -0.585 0.19% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21775747.584op/s 21870830.930op/s ± 42593.003op/s 21869986.724op/s ± 28360.642op/s 21901915.946op/s 21943842.701op/s 21960615.438op/s 21969720.909op/s 0.46% 0.089 -0.585 0.19% 3011.780op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.534µs 6.615µs ± 0.020µs 6.617µs ± 0.016µs 6.633µs 6.641µs 6.644µs 6.646µs 0.44% -0.912 1.029 0.31% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150459607.860op/s 151163725.186op/s ± 463786.331op/s 151126038.831op/s ± 362996.776op/s 151493127.283op/s 151923311.282op/s 152428077.909op/s 153037681.660op/s 1.26% 0.932 1.104 0.31% 32794.646op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255384081.825op/s; 255443908.879op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.247µs; 78.383µs] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12758440.039op/s; 12780352.299op/s] or [-0.086%; +0.086%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.645µs; 71.743µs] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13939158.080op/s; 13957991.379op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/37828224631 throughput [255396472.253op/s; 255462575.471op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.403µs; 68.511µs] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/378282246310005 throughput [14596872.612op/s; 14619429.485op/s] or [-0.077%; +0.077%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.726µs; 45.755µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21855590.142op/s; 21869332.276op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.617µs; 6.622µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/x371413321323331 throughput [151008628.710op/s; 151122988.210op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255422784.171op/s; 255473951.335op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.693µs; 65.706µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15219297.931op/s; 15222405.144op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.425µs; 53.435µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18714377.014op/s; 18717756.533op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255398856.783op/s; 255462554.522op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.215µs; 50.226µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19910216.417op/s; 19914418.200op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.711µs; 45.736µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21864927.950op/s; 21876733.911op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.613µs; 6.618µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151099448.861op/s; 151228001.511op/s] or [-0.043%; +0.043%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.707µs 161.419µs ± 0.408µs 161.382µs ± 0.161µs 161.538µs 161.850µs 162.397µs 165.223µs 2.38% 5.459 44.343 0.25% 0.029µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.363µs; 161.476µs] or [-0.035%; +0.035%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.820ms 14.879ms ± 0.035ms 14.872ms ± 0.017ms 14.894ms 14.943ms 15.003ms 15.045ms 1.17% 1.620 3.931 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.874ms; 14.884ms] or [-0.032%; +0.032%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.244ns 254.315ns ± 13.715ns 247.895ns ± 3.287ns 255.056ns 290.014ns 292.464ns 293.500ns 18.40% 1.698 1.633 5.38% 0.970ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.414ns; 256.216ns] or [-0.747%; +0.747%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.907µs 206.411µs ± 0.275µs 206.382µs ± 0.114µs 206.506µs 206.725µs 207.027µs 209.224µs 1.38% 5.522 53.073 0.13% 0.019µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4779576.276op/s 4844700.287op/s ± 6408.744op/s 4845385.072op/s ± 2680.554op/s 4847947.723op/s 4851664.234op/s 4852746.560op/s 4856565.282op/s 0.23% -5.425 51.752 0.13% 453.167op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.185µs 18.284µs ± 0.083µs 18.274µs ± 0.040µs 18.308µs 18.474µs 18.574µs 18.671µs 2.17% 1.836 4.444 0.45% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53559043.444op/s 54692939.822op/s ± 247179.145op/s 54722154.011op/s ± 120633.828op/s 54867844.006op/s 54979966.386op/s 54985219.696op/s 54989207.790op/s 0.49% -1.794 4.265 0.45% 17478.205op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.659µs 10.817µs ± 0.068µs 10.811µs ± 0.043µs 10.856µs 10.934µs 11.002µs 11.034µs 2.07% 0.492 0.527 0.63% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 90627334.865op/s 92454248.816op/s ± 582795.046op/s 92502398.179op/s ± 363920.348op/s 92841347.480op/s 93379370.970op/s 93620660.258op/s 93818976.643op/s 1.42% -0.449 0.468 0.63% 41209.833op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.373µs; 206.450µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4843812.097op/s; 4845588.477op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.273µs; 18.296µs] or [-0.063%; +0.063%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54658683.169op/s; 54727196.474op/s] or [-0.063%; +0.063%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.807µs; 10.826µs] or [-0.088%; +0.088%] None None None
normalization/normalize_name/normalize_name/good throughput [92373479.028op/s; 92535018.604op/s] or [-0.087%; +0.087%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 145.098µs 147.087µs ± 1.753µs 146.697µs ± 0.553µs 147.538µs 148.741µs 154.530µs 163.257µs 11.29% 5.258 39.425 1.19% 0.124µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.844µs; 147.330µs] or [-0.165%; +0.165%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.571µs 34.016µs ± 0.704µs 33.697µs ± 0.057µs 33.816µs 35.449µs 35.524µs 37.354µs 10.85% 1.890 2.551 2.06% 0.050µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.919µs; 34.114µs] or [-0.287%; +0.287%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.240µs 3.210µs ± 1.405µs 2.998µs ± 0.026µs 3.035µs 3.655µs 13.812µs 14.819µs 394.26% 7.341 55.128 43.67% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.015µs; 3.405µs] or [-6.067%; +6.067%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.303µs 2.387µs ± 0.022µs 2.393µs ± 0.004µs 2.396µs 2.407µs 2.416µs 2.420µs 1.13% -2.559 6.278 0.94% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.384µs; 2.390µs] or [-0.131%; +0.131%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.343ns 191.967ns ± 1.822ns 191.850ns ± 1.351ns 192.915ns 195.272ns 197.544ns 199.143ns 3.80% 1.099 1.279 0.95% 0.129ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [191.714ns; 192.220ns] or [-0.132%; +0.132%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.567µs 24.851µs ± 9.256µs 17.838µs ± 0.229µs 33.391µs 41.529µs 48.491µs 53.142µs 197.91% 0.862 -0.513 37.15% 0.655µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.569µs; 26.134µs] or [-5.162%; +5.162%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 380eb0a 1764001836 igor/versioning/crashtracker-skip-publish-so
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.990µs 5.087µs ± 0.047µs 5.083µs ± 0.036µs 5.109µs 5.171µs 5.175µs 5.179µs 1.89% 0.147 -0.766 0.93% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.080µs; 5.093µs] or [-0.129%; +0.129%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.17%. Comparing base (46f8578) to head (380eb0a).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1365      +/-   ##
==========================================
+ Coverage   71.16%   71.17%   +0.01%     
==========================================
  Files         392      392              
  Lines       62677    62677              
==========================================
+ Hits        44604    44613       +9     
+ Misses      18073    18064       -9     
Components Coverage Δ
libdd-crashtracker 59.88% <ø> (-0.02%) ⬇️
libdd-crashtracker-ffi 15.31% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.00% <ø> (ø)
libdd-data-pipeline-ffi 77.63% <ø> (ø)
libdd-common 80.93% <ø> (ø)
libdd-common-ffi 73.90% <ø> (ø)
libdd-telemetry 59.98% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 79.69% <ø> (+0.03%) ⬆️
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 36.98% <ø> (ø)
datdog-sidecar-ffi 16.40% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.25% <ø> (ø)
datadog-tracer-flare 62.06% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Nov 24, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.38 MB 7.38 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 85.96 MB 85.96 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 57.99 MB 57.99 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.43 MB 8.43 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 99.70 MB 99.70 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.53 MB 9.53 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.57 MB 19.57 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 138.54 MB 138.54 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 735.58 MB 735.58 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.34 MB 6.34 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.67 MB 19.67 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.64 MB 38.64 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.70 MB 16.70 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 141.11 MB 141.11 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 724.31 MB 724.31 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.87 MB 4.87 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.90 MB 20.90 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.39 MB 36.39 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.32 MB 74.32 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.85 MB 8.85 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.35 MB 59.35 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.47 MB 9.47 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 93.93 MB 93.93 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.28 MB 10.28 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants