Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Require docs on all public things in data-pipeline #614

Merged
merged 3 commits into from
Sep 10, 2024

Conversation

ajgajg1134
Copy link
Contributor

What does this PR do?

Require docs on all public things in data-pipeline. Add docs for anywhere this wasn't already true.

Motivation

Docs are valuable for us and for others working in this repository.

How to test the change?

N/A

@ajgajg1134 ajgajg1134 requested a review from a team as a code owner September 9, 2024 17:53
@codecov-commenter
Copy link

codecov-commenter commented Sep 9, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.17%. Comparing base (40ca981) to head (66975a4).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #614      +/-   ##
==========================================
+ Coverage   73.06%   73.17%   +0.11%     
==========================================
  Files         252      252              
  Lines       35959    35959              
==========================================
+ Hits        26274    26314      +40     
+ Misses       9685     9645      -40     
Components Coverage Δ
crashtracker 20.53% <ø> (+0.05%) ⬆️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.12% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ipc 83.63% <ø> (ø)
profiling 84.26% <ø> (+0.69%) ⬆️
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.12% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 91.66% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 92.86% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Sep 9, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-09-09 19:04:45

Comparing candidate commit 66975a4 in PR branch andrew.glaude/data-pipelineDOCS with baseline commit 40ca981 in branch main.

Found 0 performance improvements and 2 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+8.838µs; +9.059µs] or [+10.382%; +10.642%]
  • 🟥 throughput [-1131530.912op/s; -1103680.432op/s] or [-9.632%; -9.395%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 280.612µs 281.408µs ± 0.655µs 281.253µs ± 0.150µs 281.408µs 282.454µs 284.782µs 285.366µs 1.46% 3.623 15.415 0.23% 0.046µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3504275.095op/s 3553580.833op/s ± 8199.965op/s 3555518.284op/s ± 1890.619op/s 3557358.496op/s 3559526.100op/s 3560572.929op/s 3563637.284op/s 0.23% -3.593 15.176 0.23% 579.825op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 27.727µs 27.941µs ± 0.108µs 27.929µs ± 0.065µs 27.995µs 28.134µs 28.210µs 28.254µs 1.16% 0.539 0.004 0.39% 0.008µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 35393738.647op/s 35790498.563op/s ± 138360.991op/s 35805536.753op/s ± 83713.216op/s 35885175.617op/s 35996479.263op/s 36046985.440op/s 36065842.619op/s 0.73% -0.519 -0.020 0.39% 9783.600op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.811µs 16.855µs ± 0.032µs 16.847µs ± 0.018µs 16.873µs 16.907µs 16.938µs 17.041µs 1.15% 1.780 6.097 0.19% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 58683246.574op/s 59330414.904op/s ± 110555.769op/s 59359422.049op/s ± 64886.241op/s 59412040.479op/s 59461177.798op/s 59477408.104op/s 59483523.064op/s 0.21% -1.753 5.905 0.19% 7817.473op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [281.317µs; 281.499µs] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3552444.397op/s; 3554717.270op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [27.926µs; 27.956µs] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [35771323.060op/s; 35809674.066op/s] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.850µs; 16.859µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good throughput [59315092.938op/s; 59345736.871op/s] or [-0.026%; +0.026%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.212µs 1.213µs ± 0.003µs 1.213µs ± 0.000µs 1.213µs 1.213µs 1.214µs 1.252µs 3.22% 13.338 181.755 0.23% 0.000µs 1 200
credit_card/is_card_number/ throughput 799026174.137op/s 824560851.853op/s ± 1848376.336op/s 824719881.178op/s ± 207493.981op/s 824902619.096op/s 825115705.878op/s 825199172.830op/s 825330079.504op/s 0.07% -13.297 180.978 0.22% 130699.944op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 108.131µs 109.499µs ± 0.867µs 109.323µs ± 0.413µs 109.873µs 111.095µs 112.149µs 115.057µs 5.24% 2.113 8.727 0.79% 0.061µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8691361.722op/s 9133057.775op/s ± 71165.724op/s 9147209.664op/s ± 34567.718op/s 9177406.152op/s 9217657.720op/s 9234592.922op/s 9248049.246op/s 1.10% -1.972 7.661 0.78% 5032.177op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 101.961µs 103.385µs ± 0.794µs 103.230µs ± 0.554µs 103.869µs 104.882µs 105.500µs 105.611µs 2.31% 0.693 -0.014 0.77% 0.056µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9468746.693op/s 9673144.877op/s ± 73865.702op/s 9687136.961op/s ± 52082.317op/s 9734059.230op/s 9770797.474op/s 9798519.383op/s 9807682.469op/s 1.24% -0.659 -0.075 0.76% 5223.094op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.212µs 1.212µs ± 0.002µs 1.212µs ± 0.000µs 1.213µs 1.213µs 1.213µs 1.246µs 2.76% 13.594 186.794 0.20% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 802725041.810op/s 824753779.348op/s ± 1583081.012op/s 824895793.032op/s ± 174093.429op/s 825042876.807op/s 825183128.586op/s 825231445.134op/s 825247841.965op/s 0.04% -13.571 186.354 0.19% 111940.732op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 98.355µs 99.778µs ± 0.778µs 99.600µs ± 0.447µs 100.211µs 101.254µs 101.834µs 102.849µs 3.26% 0.993 1.036 0.78% 0.055µs 1 200
credit_card/is_card_number/378282246310005 throughput 9723013.487op/s 10022871.004op/s ± 77520.998op/s 10040146.225op/s ± 44879.131op/s 10078026.375op/s 10121725.835op/s 10150876.036op/s 10167267.660op/s 1.27% -0.946 0.895 0.77% 5481.562op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 100.088µs 100.448µs ± 0.587µs 100.299µs ± 0.143µs 100.472µs 101.183µs 103.761µs 104.261µs 3.95% 4.348 21.556 0.58% 0.042µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9591342.624op/s 9955729.287op/s ± 56771.559op/s 9970150.367op/s ± 14236.468op/s 9983671.207op/s 9989861.439op/s 9990794.212op/s 9991171.801op/s 0.21% -4.268 20.867 0.57% 4014.355op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 19.183µs 19.447µs ± 0.156µs 19.418µs ± 0.090µs 19.557µs 19.649µs 19.899µs 20.271µs 4.39% 1.085 3.261 0.80% 0.011µs 1 200
credit_card/is_card_number/x371413321323331 throughput 49332338.970op/s 51426243.595op/s ± 408676.588op/s 51497842.164op/s ± 239930.120op/s 51676963.487op/s 51999830.779op/s 52116059.773op/s 52129087.259op/s 1.23% -0.991 2.773 0.79% 28897.799op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.212µs 1.212µs ± 0.000µs 1.212µs ± 0.000µs 1.213µs 1.213µs 1.213µs 1.215µs 0.21% 1.356 5.813 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 823100695.146op/s 824777375.573op/s ± 277690.797op/s 824792358.531op/s ± 208619.856op/s 825001711.881op/s 825129235.873op/s 825212752.227op/s 825252279.622op/s 0.06% -1.350 5.770 0.03% 19635.705op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 89.289µs 91.189µs ± 0.512µs 91.201µs ± 0.297µs 91.498µs 92.055µs 92.346µs 92.662µs 1.60% -0.210 0.707 0.56% 0.036µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10791860.622op/s 10966610.964op/s ± 61686.521op/s 10964781.124op/s ± 35636.952op/s 11000282.751op/s 11067627.121op/s 11105871.857op/s 11199646.010op/s 2.14% 0.255 0.759 0.56% 4361.896op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 92.539µs 94.079µs ± 0.517µs 94.092µs ± 0.263µs 94.330µs 94.805µs 95.044µs 97.421µs 3.54% 1.307 8.599 0.55% 0.037µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 10264758.829op/s 10629705.211op/s ± 57972.565op/s 10627942.024op/s ± 29704.059op/s 10662881.711op/s 10708630.571op/s 10753198.604op/s 10806297.223op/s 1.68% -1.166 7.724 0.54% 4099.279op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.212µs 1.213µs ± 0.003µs 1.212µs ± 0.000µs 1.213µs 1.213µs 1.214µs 1.254µs 3.46% 13.678 188.340 0.25% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 797254814.912op/s 824680007.320op/s ± 1966921.525op/s 824835733.968op/s ± 191157.889op/s 825026380.227op/s 825189100.334op/s 825289248.220op/s 825331370.545op/s 0.06% -13.654 187.888 0.24% 139082.355op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 80.216µs 81.483µs ± 0.456µs 81.520µs ± 0.313µs 81.819µs 82.176µs 82.346µs 82.433µs 1.12% -0.347 -0.525 0.56% 0.032µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 12131121.445op/s 12272925.732op/s ± 68790.964op/s 12266988.954op/s ± 47346.780op/s 12315626.683op/s 12394899.753op/s 12422901.580op/s 12466404.055op/s 1.63% 0.370 -0.506 0.56% 4864.256op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 99.987µs 100.455µs ± 0.505µs 100.324µs ± 0.156µs 100.566µs 101.117µs 103.445µs 104.295µs 3.96% 4.638 27.938 0.50% 0.036µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9588157.015op/s 9954909.566op/s ± 48932.479op/s 9967676.819op/s ± 15512.111op/s 9979152.556op/s 9990115.330op/s 9991920.953op/s 10001313.172op/s 0.34% -4.513 26.696 0.49% 3460.049op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 19.160µs 19.306µs ± 0.110µs 19.247µs ± 0.011µs 19.333µs 19.511µs 19.706µs 19.828µs 3.02% 2.120 4.727 0.57% 0.008µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 50434228.055op/s 51799599.052op/s ± 292351.087op/s 51955226.775op/s ± 29191.070op/s 51975823.262op/s 51987452.105op/s 52000366.834op/s 52192798.796op/s 0.46% -2.083 4.506 0.56% 20672.344op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.212µs; 1.213µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number/ throughput [824304684.669op/s; 824817019.036op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [109.379µs; 109.619µs] or [-0.110%; +0.110%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [9123194.890op/s; 9142920.660op/s] or [-0.108%; +0.108%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [103.275µs; 103.495µs] or [-0.106%; +0.106%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9662907.801op/s; 9683381.953op/s] or [-0.106%; +0.106%] None None None
credit_card/is_card_number/37828224631 execution_time [1.212µs; 1.213µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/37828224631 throughput [824534379.545op/s; 824973179.151op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/378282246310005 execution_time [99.670µs; 99.886µs] or [-0.108%; +0.108%] None None None
credit_card/is_card_number/378282246310005 throughput [10012127.339op/s; 10033614.669op/s] or [-0.107%; +0.107%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [100.367µs; 100.529µs] or [-0.081%; +0.081%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9947861.295op/s; 9963597.279op/s] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/x371413321323331 execution_time [19.425µs; 19.468µs] or [-0.111%; +0.111%] None None None
credit_card/is_card_number/x371413321323331 throughput [51369604.950op/s; 51482882.239op/s] or [-0.110%; +0.110%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.212µs; 1.213µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ throughput [824738890.299op/s; 824815860.847op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [91.118µs; 91.260µs] or [-0.078%; +0.078%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10958061.806op/s; 10975160.123op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [94.007µs; 94.150µs] or [-0.076%; +0.076%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [10621670.771op/s; 10637739.651op/s] or [-0.076%; +0.076%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.212µs; 1.213µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [824407410.914op/s; 824952603.727op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [81.420µs; 81.546µs] or [-0.078%; +0.078%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12263391.965op/s; 12282459.498op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [100.385µs; 100.525µs] or [-0.070%; +0.070%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9948127.995op/s; 9961691.137op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [19.291µs; 19.321µs] or [-0.079%; +0.079%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [51759082.003op/s; 51840116.101op/s] or [-0.078%; +0.078%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 73.552µs 73.898µs ± 0.216µs 73.836µs ± 0.128µs 74.054µs 74.112µs 74.176µs 75.621µs 2.42% 3.115 21.089 0.29% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [73.868µs; 73.928µs] or [-0.041%; +0.041%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 137.577µs 138.074µs ± 0.254µs 138.035µs ± 0.113µs 138.163µs 138.409µs 139.082µs 139.699µs 1.21% 2.426 11.767 0.18% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [138.039µs; 138.109µs] or [-0.025%; +0.025%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 35.837µs 36.375µs ± 0.961µs 35.946µs ± 0.048µs 35.995µs 38.452µs 38.555µs 39.275µs 9.26% 1.716 1.018 2.63% 0.068µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [36.242µs; 36.508µs] or [-0.366%; +0.366%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.449µs 2.894µs ± 1.382µs 2.736µs ± 0.026µs 2.759µs 3.063µs 12.448µs 15.828µs 478.60% 8.006 64.273 47.62% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.703µs; 3.086µs] or [-6.616%; +6.616%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.223µs 1.384µs ± 0.055µs 1.380µs ± 0.043µs 1.428µs 1.461µs 1.480µs 1.481µs 7.35% -0.577 0.050 3.98% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.377µs; 1.392µs] or [-0.553%; +0.553%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.673µs 2.735µs ± 0.021µs 2.736µs ± 0.004µs 2.740µs 2.785µs 2.793µs 2.796µs 2.21% 0.360 2.233 0.76% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.733µs; 2.738µs] or [-0.105%; +0.105%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 578.554µs 579.377µs ± 0.285µs 579.410µs ± 0.198µs 579.606µs 579.749µs 579.873µs 579.979µs 0.10% -0.593 0.001 0.05% 0.020µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1724199.058op/s 1725992.195op/s ± 848.154op/s 1725893.302op/s ± 589.227op/s 1726495.165op/s 1727507.297op/s 1728168.686op/s 1728447.315op/s 0.15% 0.595 0.005 0.05% 59.974op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 464.106µs 464.966µs ± 0.877µs 464.901µs ± 0.236µs 465.121µs 465.407µs 466.418µs 475.491µs 2.28% 9.374 105.248 0.19% 0.062µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2103088.529op/s 2150703.565op/s ± 3988.331op/s 2150995.467op/s ± 1089.663op/s 2152166.680op/s 2153289.104op/s 2154016.387op/s 2154678.470op/s 0.17% -9.265 103.364 0.18% 282.018op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 183.977µs 184.239µs ± 0.126µs 184.247µs ± 0.082µs 184.329µs 184.421µs 184.522µs 184.582µs 0.18% -0.125 -0.414 0.07% 0.009µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5417656.631op/s 5427724.222op/s ± 3701.477op/s 5427501.571op/s ± 2416.648op/s 5429864.929op/s 5434333.390op/s 5434874.463op/s 5435476.075op/s 0.15% 0.128 -0.415 0.07% 261.734op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.457µs 46.731µs ± 0.100µs 46.729µs ± 0.071µs 46.805µs 46.896µs 46.918µs 46.943µs 0.46% -0.187 -0.255 0.21% 0.007µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21302321.182op/s 21398970.042op/s ± 45679.093op/s 21399860.491op/s ± 32346.360op/s 21430592.368op/s 21475065.035op/s 21514813.468op/s 21525258.440op/s 0.59% 0.198 -0.245 0.21% 3230.000op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.465µs 45.039µs ± 0.206µs 45.061µs ± 0.141µs 45.194µs 45.314µs 45.384µs 45.965µs 2.01% -0.037 1.399 0.46% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21755662.636op/s 22203328.329op/s ± 101655.483op/s 22192005.478op/s ± 69628.885op/s 22266305.455op/s 22379348.748op/s 22451308.032op/s 22489828.975op/s 1.34% 0.083 1.292 0.46% 7188.128op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [579.338µs; 579.416µs] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1725874.649op/s; 1726109.741op/s] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [464.844µs; 465.087µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2150150.821op/s; 2151256.310op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [184.222µs; 184.257µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5427211.233op/s; 5428237.211op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.718µs; 46.745µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21392639.359op/s; 21405300.725op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.011µs; 45.068µs] or [-0.063%; +0.063%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22189239.857op/s; 22217416.801op/s] or [-0.063%; +0.063%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 16.594µs 21.549µs ± 11.733µs 16.736µs ± 0.068µs 16.937µs 49.427µs 51.325µs 103.316µs 517.31% 2.981 11.936 54.31% 0.830µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [19.923µs; 23.175µs] or [-7.546%; +7.546%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.885ms 8.924ms ± 0.016ms 8.924ms ± 0.008ms 8.930ms 8.944ms 8.978ms 9.012ms 0.99% 1.157 5.977 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.921ms; 8.926ms] or [-0.024%; +0.024%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 66975a4 1725908068 andrew.glaude/data-pipelineDOCS
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 292.531ns 303.142ns ± 15.524ns 295.258ns ± 1.612ns 304.400ns 336.959ns 353.723ns 357.714ns 21.15% 1.912 2.812 5.11% 1.098ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [300.991ns; 305.294ns] or [-0.710%; +0.710%] None None None

Baseline

Omitted due to size.

@ajgajg1134 ajgajg1134 merged commit 9705ec2 into main Sep 10, 2024
30 checks passed
@ajgajg1134 ajgajg1134 deleted the andrew.glaude/data-pipelineDOCS branch September 10, 2024 13:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants