Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Serverless Mini Agent] Bump datadog-serverless-trace-mini-agent version to 0.7.1 #633

Merged
merged 1 commit into from
Sep 16, 2024
Merged

[Serverless Mini Agent] Bump datadog-serverless-trace-mini-agent version to 0.7.1 #633

merged 1 commit into from
Sep 16, 2024
+2 −2

Conversation

duncanpharvey
Copy link
Contributor

What does this PR do?

Bumps Serverless Mini Agent Version to 0.7.1.

Motivation

Upcoming release of version 0.7.1.

Additional Notes

How to test the change?

See https://datadoghq.atlassian.net/wiki/spaces/SLS/pages/2977497119/Serverless+Mini+Agent#Testing

@duncanpharvey duncanpharvey requested review from a team as code owners September 16, 2024 20:54
@pr-commenter
Copy link

pr-commenter bot commented Sep 16, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-09-16 21:03:29

Comparing candidate commit 947a8a0 in PR branch duncan-harvey/serverless-mini-agent-bump-version with baseline commit a5d9cf0 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.389µs 3.234µs ± 1.581µs 3.088µs ± 0.036µs 3.118µs 3.165µs 13.858µs 18.346µs 494.07% 8.014 65.244 48.78% 0.112µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.014µs; 3.453µs] or [-6.777%; +6.777%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.627µs 26.479µs ± 12.243µs 20.904µs ± 1.432µs 34.967µs 49.156µs 53.609µs 110.079µs 426.60% 2.847 12.606 46.12% 0.866µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.782µs; 28.176µs] or [-6.408%; +6.408%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.921ms 8.959ms ± 0.014ms 8.959ms ± 0.008ms 8.967ms 8.982ms 8.994ms 8.997ms 0.42% 0.047 0.243 0.15% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.957ms; 8.961ms] or [-0.021%; +0.021%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.195µs 1.373µs ± 0.053µs 1.387µs ± 0.032µs 1.412µs 1.444µs 1.464µs 1.466µs 5.73% -0.824 0.989 3.84% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.365µs; 1.380µs] or [-0.534%; +0.534%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.208µs 1.208µs ± 0.001µs 1.208µs ± 0.000µs 1.209µs 1.209µs 1.210µs 1.227µs 1.55% 12.155 160.294 0.11% 0.000µs 1 200
credit_card/is_card_number/ throughput 814941352.976op/s 827493494.397op/s ± 937417.841op/s 827590275.934op/s ± 207277.952op/s 827794428.219op/s 827875620.493op/s 827927754.271op/s 827980374.184op/s 0.05% -12.104 159.385 0.11% 66285.451op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 109.630µs 111.190µs ± 0.629µs 111.259µs ± 0.338µs 111.565µs 111.889µs 113.044µs 113.564µs 2.07% 0.028 1.763 0.56% 0.044µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8805603.965op/s 8993901.110op/s ± 50871.514op/s 8988068.346op/s ± 27231.232op/s 9019266.749op/s 9099687.558op/s 9111694.070op/s 9121586.183op/s 1.49% 0.035 1.656 0.56% 3597.159op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 101.286µs 103.415µs ± 0.816µs 103.466µs ± 0.437µs 103.777µs 104.674µs 106.182µs 106.438µs 2.87% 0.754 2.282 0.79% 0.058µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9395162.673op/s 9670368.242op/s ± 75881.610op/s 9665038.177op/s ± 40981.015op/s 9721103.301op/s 9794532.963op/s 9824207.771op/s 9873038.828op/s 2.15% -0.668 2.074 0.78% 5365.640op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.208µs 1.209µs ± 0.001µs 1.208µs ± 0.000µs 1.209µs 1.210µs 1.212µs 1.225µs 1.33% 9.176 104.671 0.11% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 816613319.531op/s 827404466.065op/s ± 898542.734op/s 827495035.030op/s ± 262314.730op/s 827783888.486op/s 827900869.601op/s 827965670.249op/s 828006160.166op/s 0.06% -9.102 103.400 0.11% 63536.566op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 98.267µs 99.953µs ± 0.787µs 99.828µs ± 0.425µs 100.361µs 101.080µs 102.296µs 104.699µs 4.88% 2.036 9.780 0.79% 0.056µs 1 200
credit_card/is_card_number/378282246310005 throughput 9551185.039op/s 10005260.912op/s ± 77553.030op/s 10017201.554op/s ± 42862.077op/s 10050396.711op/s 10105798.997op/s 10149429.156op/s 10176306.546op/s 1.59% -1.863 8.654 0.77% 5483.827op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 94.176µs 95.437µs ± 0.666µs 95.329µs ± 0.288µs 95.679µs 96.358µs 98.336µs 99.598µs 4.48% 2.613 11.963 0.70% 0.047µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 10040370.897op/s 10478653.358op/s ± 71897.034op/s 10489992.548op/s ± 31641.146op/s 10518517.588op/s 10565403.662op/s 10606880.594op/s 10618378.998op/s 1.22% -2.468 11.001 0.68% 5083.888op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 20.415µs 21.117µs ± 0.331µs 21.119µs ± 0.248µs 21.364µs 21.640µs 21.772µs 21.990µs 4.12% 0.068 -0.590 1.56% 0.023µs 1 200
credit_card/is_card_number/x371413321323331 throughput 45475846.930op/s 47367448.591op/s ± 742735.104op/s 47351563.473op/s ± 557103.272op/s 47912847.710op/s 48542455.391op/s 48884868.499op/s 48982904.240op/s 3.45% -0.003 -0.605 1.56% 52519.303op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.207µs 1.210µs ± 0.002µs 1.209µs ± 0.001µs 1.211µs 1.213µs 1.214µs 1.214µs 0.45% 0.984 -0.600 0.15% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 823687052.697op/s 826783131.862op/s ± 1244271.151op/s 827384413.472op/s ± 432310.249op/s 827736239.526op/s 827888054.221op/s 827982654.350op/s 828265369.375op/s 0.11% -0.982 -0.604 0.15% 87983.257op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 93.404µs 96.012µs ± 0.534µs 96.098µs ± 0.274µs 96.352µs 96.675µs 97.015µs 97.241µs 1.19% -1.062 2.526 0.55% 0.038µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10283758.273op/s 10415683.628op/s ± 58263.366op/s 10406088.187op/s ± 29695.269op/s 10449454.697op/s 10512046.050op/s 10585436.171op/s 10706212.356op/s 2.88% 1.119 2.778 0.56% 4119.842op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 85.142µs 87.153µs ± 0.649µs 87.161µs ± 0.350µs 87.497µs 88.099µs 88.686µs 89.296µs 2.45% -0.179 0.822 0.74% 0.046µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11198750.258op/s 11474748.990op/s ± 85585.577op/s 11473053.814op/s ± 46199.467op/s 11519454.925op/s 11622416.308op/s 11693301.428op/s 11745115.870op/s 2.37% 0.241 0.836 0.74% 6051.814op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.209µs 1.211µs ± 0.002µs 1.210µs ± 0.001µs 1.212µs 1.213µs 1.213µs 1.231µs 1.70% 6.838 71.086 0.15% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 812406381.322op/s 825860911.162op/s ± 1231431.711op/s 826245161.700op/s ± 382822.302op/s 826577032.136op/s 826715929.492op/s 826758704.148op/s 826838058.804op/s 0.07% -6.720 69.304 0.15% 87075.371op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 81.167µs 83.023µs ± 0.681µs 83.019µs ± 0.439µs 83.452µs 84.186µs 84.877µs 85.044µs 2.44% 0.238 0.235 0.82% 0.048µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11758612.212op/s 12045660.024op/s ± 98633.206op/s 12045457.567op/s ± 63328.170op/s 12113778.823op/s 12214343.361op/s 12257070.259op/s 12320234.040op/s 2.28% -0.185 0.195 0.82% 6974.421op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 93.895µs 95.497µs ± 0.637µs 95.408µs ± 0.357µs 95.879µs 96.509µs 97.292µs 98.451µs 3.19% 1.053 3.260 0.66% 0.045µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 10157288.023op/s 10471947.370op/s ± 69342.041op/s 10481282.003op/s ± 39264.085op/s 10515812.366op/s 10566730.121op/s 10601209.033op/s 10650178.162op/s 1.61% -0.972 2.948 0.66% 4903.223op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 20.455µs 21.101µs ± 0.317µs 21.094µs ± 0.220µs 21.307µs 21.601µs 21.922µs 22.109µs 4.81% 0.273 -0.113 1.50% 0.022µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 45230483.886op/s 47401526.252op/s ± 709441.509op/s 47406349.321op/s ± 500298.345op/s 47916247.091op/s 48524301.440op/s 48849396.273op/s 48888563.657op/s 3.13% -0.193 -0.207 1.49% 50165.090op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.208µs; 1.209µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/ throughput [827363577.300op/s; 827623411.494op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [111.103µs; 111.277µs] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8986850.807op/s; 9000951.412op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [103.302µs; 103.528µs] or [-0.109%; +0.109%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9659851.781op/s; 9680884.704op/s] or [-0.109%; +0.109%] None None None
credit_card/is_card_number/37828224631 execution_time [1.208µs; 1.209µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/37828224631 throughput [827279936.684op/s; 827528995.447op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/378282246310005 execution_time [99.844µs; 100.063µs] or [-0.109%; +0.109%] None None None
credit_card/is_card_number/378282246310005 throughput [9994512.808op/s; 10016009.016op/s] or [-0.107%; +0.107%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [95.344µs; 95.529µs] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [10468689.121op/s; 10488617.596op/s] or [-0.095%; +0.095%] None None None
credit_card/is_card_number/x371413321323331 execution_time [21.071µs; 21.163µs] or [-0.217%; +0.217%] None None None
credit_card/is_card_number/x371413321323331 throughput [47264512.649op/s; 47470384.533op/s] or [-0.217%; +0.217%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.209µs; 1.210µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ throughput [826610687.847op/s; 826955575.877op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [95.938µs; 96.086µs] or [-0.077%; +0.077%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10407608.885op/s; 10423758.370op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [87.063µs; 87.243µs] or [-0.103%; +0.103%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11462887.652op/s; 11486610.328op/s] or [-0.103%; +0.103%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.211µs; 1.211µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [825690246.571op/s; 826031575.754op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [82.929µs; 83.117µs] or [-0.114%; +0.114%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12031990.410op/s; 12059329.638op/s] or [-0.113%; +0.113%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [95.409µs; 95.586µs] or [-0.092%; +0.092%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [10462337.230op/s; 10481557.510op/s] or [-0.092%; +0.092%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [21.057µs; 21.145µs] or [-0.208%; +0.208%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [47303204.482op/s; 47499848.022op/s] or [-0.207%; +0.207%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.637µs 2.699µs ± 0.019µs 2.699µs ± 0.005µs 2.705µs 2.742µs 2.745µs 2.748µs 1.82% -0.444 2.809 0.71% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.696µs; 2.702µs] or [-0.099%; +0.099%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 74.629µs 74.852µs ± 0.123µs 74.843µs ± 0.036µs 74.881µs 74.924µs 75.139µs 76.335µs 1.99% 8.897 104.386 0.16% 0.009µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [74.835µs; 74.869µs] or [-0.023%; +0.023%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 270.722µs 274.107µs ± 1.611µs 274.009µs ± 1.099µs 275.153µs 276.690µs 277.876µs 279.465µs 1.99% 0.347 0.138 0.59% 0.114µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3578268.705op/s 3648337.037op/s ± 21395.612op/s 3649517.260op/s ± 14574.783op/s 3663055.877op/s 3682060.103op/s 3691865.855op/s 3693820.964op/s 1.21% -0.312 0.083 0.58% 1512.898op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 25.776µs 25.818µs ± 0.049µs 25.788µs ± 0.005µs 25.857µs 25.917µs 25.953µs 25.976µs 0.73% 1.178 0.183 0.19% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 38497226.581op/s 38732643.549op/s ± 72841.692op/s 38778189.841op/s ± 8244.259op/s 38783256.869op/s 38789189.998op/s 38792402.938op/s 38795736.820op/s 0.05% -1.174 0.165 0.19% 5150.685op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 15.311µs 15.341µs ± 0.027µs 15.329µs ± 0.014µs 15.360µs 15.383µs 15.422µs 15.484µs 1.01% 1.460 3.329 0.18% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 64583040.494op/s 65186083.486op/s ± 115432.595op/s 65237293.845op/s ± 59995.385op/s 65276219.202op/s 65298906.981op/s 65305369.834op/s 65312950.570op/s 0.12% -1.443 3.224 0.18% 8162.317op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [273.884µs; 274.330µs] or [-0.081%; +0.081%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3645371.811op/s; 3651302.263op/s] or [-0.081%; +0.081%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [25.811µs; 25.825µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [38722548.391op/s; 38742738.707op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good execution_time [15.337µs; 15.345µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/good throughput [65170085.638op/s; 65202081.333op/s] or [-0.025%; +0.025%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 139.824µs 140.979µs ± 0.442µs 140.901µs ± 0.191µs 141.115µs 141.722µs 142.754µs 143.446µs 1.81% 2.051 8.644 0.31% 0.031µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [140.917µs; 141.040µs] or [-0.043%; +0.043%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.753µs 507.540µs ± 0.297µs 507.482µs ± 0.166µs 507.726µs 508.066µs 508.433µs 509.055µs 0.31% 1.153 3.453 0.06% 0.021µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1964423.141op/s 1970289.941op/s ± 1153.209op/s 1970511.641op/s ± 645.461op/s 1970978.273op/s 1971870.159op/s 1972241.292op/s 1973348.650op/s 0.14% -1.146 3.422 0.06% 81.544op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 464.866µs 465.728µs ± 0.444µs 465.731µs ± 0.306µs 465.992µs 466.581µs 466.988µs 467.063µs 0.29% 0.562 0.136 0.10% 0.031µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2141039.272op/s 2147176.879op/s ± 2047.612op/s 2147160.383op/s ± 1410.950op/s 2148764.812op/s 2150011.326op/s 2150808.201op/s 2151158.512op/s 0.19% -0.557 0.126 0.10% 144.788op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 179.783µs 180.454µs ± 0.394µs 180.405µs ± 0.262µs 180.683µs 181.115µs 181.555µs 182.086µs 0.93% 0.884 1.085 0.22% 0.028µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5491916.301op/s 5541595.795op/s ± 12072.550op/s 5543070.128op/s ± 8046.946op/s 5550741.153op/s 5557591.308op/s 5561115.790op/s 5562261.170op/s 0.35% -0.869 1.035 0.22% 853.658op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 43.455µs 43.574µs ± 0.054µs 43.568µs ± 0.033µs 43.604µs 43.655µs 43.717µs 43.854µs 0.66% 1.039 3.615 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22803133.374op/s 22949631.032op/s ± 28634.416op/s 22952710.531op/s ± 17259.950op/s 22967042.344op/s 22989092.667op/s 23001837.131op/s 23012241.225op/s 0.26% -1.022 3.534 0.12% 2024.759op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.893µs 50.187µs ± 0.212µs 50.126µs ± 0.190µs 50.372µs 50.459µs 50.505µs 51.174µs 2.09% 0.528 0.525 0.42% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19541057.807op/s 19925896.962op/s ± 84078.499op/s 19949897.977op/s ± 75432.955op/s 20006702.246op/s 20027704.140op/s 20036066.785op/s 20042985.212op/s 0.47% -0.500 0.380 0.42% 5945.248op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.498µs; 507.581µs] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1970130.117op/s; 1970449.764op/s] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [465.667µs; 465.790µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2146893.099op/s; 2147460.658op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.400µs; 180.509µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5539922.656op/s; 5543268.934op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [43.566µs; 43.581µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22945662.577op/s; 22953599.487op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.157µs; 50.216µs] or [-0.059%; +0.059%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19914244.490op/s; 19937549.433op/s] or [-0.058%; +0.058%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.511µs 38.157µs ± 1.139µs 37.635µs ± 0.053µs 37.733µs 40.614µs 40.651µs 41.184µs 9.43% 1.701 0.930 2.98% 0.081µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.999µs; 38.315µs] or [-0.414%; +0.414%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 947a8a0 1726519988 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 293.486ns 304.645ns ± 13.983ns 297.807ns ± 2.528ns 309.523ns 332.567ns 344.377ns 344.881ns 15.81% 1.497 0.989 4.58% 0.989ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [302.707ns; 306.583ns] or [-0.636%; +0.636%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.01%. Comparing base (a5d9cf0) to head (947a8a0).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #633      +/-   ##
==========================================
- Coverage   73.02%   73.01%   -0.02%     
==========================================
  Files         252      252              
  Lines       36093    36093              
==========================================
- Hits        26358    26352       -6     
- Misses       9735     9741       +6
Components Coverage Δ
crashtracker 20.53% <ø> (+0.05%) ⬆️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.12% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ipc 83.63% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.12% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 91.66% <ø> (ø)
trace-mini-agent 72.49% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 92.88% <ø> (ø)

hghotra
hghotra approved these changes Sep 16, 2024
View reviewed changes
Copy link

@hghotra hghotra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍🏼

@duncanpharvey duncanpharvey merged commit 0df879e into main Sep 16, 2024
30 checks passed
@duncanpharvey duncanpharvey deleted the duncan-harvey/serverless-mini-agent-bump-version branch September 16, 2024 22:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@hghotra hghotra hghotra approved these changes

Assignees
No one assigned
Labels
mini-agent
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@duncanpharvey @codecov-commenter @hghotra