[Serverless Mini Agent] Upload Serverless Binaries Instead of Generating Release

[duncanpharvey]

What does this PR do?

Upload zipped binaries at end of Github Workflow to release Serverless Mini Agent instead of generating a Github release.

Motivation

Github Action returns 403 forbidden error when creating a release.

Additional Notes

Updates upload-artifact and download-artifact actions to use v4 to resolve warnings.

How to test the change?

Pushed a test tag and confirmed that the generated binaries in the zip file worked successfully.

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2024-09-16 22:41:22

Comparing candidate commit e559b8c in PR branch duncan-harvey/serverless-release with baseline commit 0df879e in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:redis/obfuscate_redis_string

• 🟥 execution_time [+0.895µs; +1.351µs] or [+2.362%; +3.569%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.674µs	2.755µs ± 0.034µs	2.767µs ± 0.009µs	2.774µs	2.795µs	2.801µs	2.804µs	1.33%	-1.079	-0.003	1.21%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.751µs; 2.760µs] or [-0.169%; +0.169%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	38.442µs	38.991µs ± 0.932µs	38.564µs ± 0.058µs	38.681µs	40.972µs	41.049µs	42.196µs	9.42%	1.734	1.174	2.39%	0.066µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[38.862µs; 39.120µs] or [-0.331%; +0.331%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	269.765µs	273.142µs ± 1.555µs	272.852µs ± 1.013µs	274.044µs	275.910µs	277.325µs	278.434µs	2.05%	0.682	0.432	0.57%	0.110µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	3591514.514op/s	3661210.456op/s ± 20768.118op/s	3664995.873op/s ± 13606.216op/s	3675450.498op/s	3690556.440op/s	3695614.808op/s	3706935.792op/s	1.14%	-0.649	0.360	0.57%	1468.528op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	25.767µs	25.839µs ± 0.065µs	25.824µs ± 0.049µs	25.872µs	25.970µs	26.002µs	26.092µs	1.04%	0.924	0.435	0.25%	0.005µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	38325826.654op/s	38701659.631op/s ± 97520.915op/s	38723314.248op/s ± 73345.140op/s	38797710.203op/s	38803291.837op/s	38806804.119op/s	38809045.583op/s	0.22%	-0.912	0.395	0.25%	6895.770op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	15.316µs	15.358µs ± 0.045µs	15.336µs ± 0.019µs	15.381µs	15.451µs	15.491µs	15.510µs	1.13%	1.176	0.705	0.29%	0.003µs	1	200
normalization/normalize_name/normalize_name/good	throughput	64475448.514op/s	65114505.096op/s ± 189617.650op/s	65206411.474op/s ± 79170.068op/s	65271948.938op/s	65286365.363op/s	65289249.412op/s	65289681.464op/s	0.13%	-1.165	0.665	0.29%	13407.993op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[272.927µs; 273.358µs] or [-0.079%; +0.079%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[3658332.194op/s; 3664088.717op/s] or [-0.079%; +0.079%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[25.830µs; 25.848µs] or [-0.035%; +0.035%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[38688144.170op/s; 38715175.092op/s] or [-0.035%; +0.035%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[15.351µs; 15.364µs] or [-0.040%; +0.040%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[65088225.913op/s; 65140784.278op/s] or [-0.040%; +0.040%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	1.208µs	1.209µs ± 0.001µs	1.209µs ± 0.000µs	1.209µs	1.212µs	1.212µs	1.221µs	1.00%	3.468	20.352	0.12%	0.000µs	1	200
credit_card/is_card_number/	throughput	819249472.056op/s	827194733.992op/s ± 987419.773op/s	827466777.849op/s ± 221891.148op/s	827751002.479op/s	827938200.338op/s	827983908.841op/s	828064047.092op/s	0.07%	-3.431	19.909	0.12%	69821.122op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	109.340µs	111.344µs ± 0.762µs	111.393µs ± 0.329µs	111.674µs	112.271µs	114.197µs	114.846µs	3.10%	1.048	4.687	0.68%	0.054µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	8707292.183op/s	8981628.380op/s ± 61036.271op/s	8977249.857op/s ± 26406.546op/s	9010394.180op/s	9080368.073op/s	9113437.335op/s	9145810.746op/s	1.88%	-0.935	4.334	0.68%	4315.916op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	101.742µs	103.639µs ± 0.750µs	103.675µs ± 0.331µs	103.930µs	104.850µs	106.245µs	107.079µs	3.28%	0.863	3.297	0.72%	0.053µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	9338857.958op/s	9649387.181op/s ± 69426.187op/s	9645509.623op/s ± 30794.026op/s	9687939.001op/s	9759016.325op/s	9810987.456op/s	9828786.591op/s	1.90%	-0.766	3.017	0.72%	4909.173op/s	1	200
credit_card/is_card_number/37828224631	execution_time	1.208µs	1.209µs ± 0.002µs	1.209µs ± 0.001µs	1.209µs	1.212µs	1.212µs	1.216µs	0.66%	1.462	1.474	0.13%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	822038398.247op/s	827014922.819op/s ± 1095713.602op/s	827439634.780op/s ± 355519.851op/s	827781108.317op/s	827913619.809op/s	827999710.444op/s	828073051.033op/s	0.08%	-1.457	1.442	0.13%	77478.652op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	98.066µs	99.859µs ± 0.858µs	99.667µs ± 0.445µs	100.365µs	101.513µs	103.046µs	103.507µs	3.85%	1.229	2.793	0.86%	0.061µs	1	200
credit_card/is_card_number/378282246310005	throughput	9661212.204op/s	10014837.235op/s ± 85187.834op/s	10033458.074op/s ± 44994.110op/s	10067882.958op/s	10126630.532op/s	10177777.864op/s	10197176.687op/s	1.63%	-1.146	2.508	0.85%	6023.690op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	93.725µs	94.891µs ± 0.815µs	94.704µs ± 0.300µs	95.054µs	96.226µs	97.910µs	99.784µs	5.36%	2.724	9.758	0.86%	0.058µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	10021634.322op/s	10539143.411op/s ± 88446.610op/s	10559236.363op/s ± 33403.817op/s	10588063.039op/s	10622500.052op/s	10646421.988op/s	10669549.816op/s	1.04%	-2.616	9.001	0.84%	6254.120op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	20.323µs	21.186µs ± 0.338µs	21.182µs ± 0.209µs	21.386µs	21.708µs	22.089µs	22.253µs	5.05%	0.182	0.353	1.59%	0.024µs	1	200
credit_card/is_card_number/x371413321323331	throughput	44938762.367op/s	47212690.770op/s ± 750922.445op/s	47208972.087op/s ± 466688.069op/s	47685668.084op/s	48436182.137op/s	48890220.733op/s	49205282.562op/s	4.23%	-0.073	0.260	1.59%	53098.235op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	1.208µs	1.208µs ± 0.000µs	1.208µs ± 0.000µs	1.209µs	1.209µs	1.210µs	1.211µs	0.26%	1.803	6.710	0.04%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	825446618.991op/s	827550419.257op/s ± 339326.647op/s	827580358.136op/s ± 218642.865op/s	827821712.220op/s	827901436.994op/s	827956052.269op/s	828012871.172op/s	0.05%	-1.796	6.658	0.04%	23994.017op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	92.581µs	95.940µs ± 0.689µs	96.039µs ± 0.327µs	96.365µs	96.827µs	97.107µs	97.641µs	1.67%	-1.404	3.697	0.72%	0.049µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	10241643.282op/s	10423690.010op/s ± 75639.430op/s	10412484.651op/s ± 35312.490op/s	10448220.581op/s	10577297.524op/s	10666197.617op/s	10801406.775op/s	3.74%	1.485	4.027	0.72%	5348.515op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	84.458µs	87.010µs ± 0.794µs	87.093µs ± 0.418µs	87.452µs	88.142µs	88.787µs	89.042µs	2.24%	-0.568	0.814	0.91%	0.056µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	11230616.054op/s	11493907.958op/s ± 105502.141op/s	11482030.190op/s ± 55003.942op/s	11548293.130op/s	11694661.723op/s	11824703.959op/s	11840267.443op/s	3.12%	0.636	0.915	0.92%	7460.128op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	1.208µs	1.209µs ± 0.001µs	1.208µs ± 0.000µs	1.209µs	1.210µs	1.211µs	1.221µs	1.04%	7.374	74.567	0.09%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	819037539.138op/s	827447673.876op/s ± 761509.085op/s	827574870.873op/s ± 227125.362op/s	827800191.182op/s	827933561.910op/s	828003387.849op/s	828085299.706op/s	0.06%	-7.312	73.575	0.09%	53846.824op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	80.363µs	83.024µs ± 0.701µs	83.046µs ± 0.434µs	83.503µs	84.023µs	84.539µs	85.039µs	2.40%	-0.505	1.039	0.84%	0.050µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	11759243.008op/s	12045516.654op/s ± 102208.851op/s	12041513.166op/s ± 62657.123op/s	12096253.590op/s	12222413.129op/s	12332468.537op/s	12443589.916op/s	3.34%	0.576	1.153	0.85%	7227.257op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	93.496µs	94.625µs ± 0.917µs	94.375µs ± 0.192µs	94.614µs	96.773µs	98.226µs	100.708µs	6.71%	3.206	12.772	0.97%	0.065µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	9929686.472op/s	10568934.314op/s ± 99394.918op/s	10596041.460op/s ± 21630.490op/s	10612466.452op/s	10647810.804op/s	10672364.413op/s	10695678.508op/s	0.94%	-3.082	11.657	0.94%	7028.282op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	20.367µs	21.207µs ± 0.353µs	21.208µs ± 0.211µs	21.422µs	21.840µs	21.979µs	22.255µs	4.94%	0.106	-0.134	1.66%	0.025µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	44934023.469op/s	47166147.421op/s ± 783703.170op/s	47151968.492op/s ± 469793.447op/s	47616615.150op/s	48392659.300op/s	48897825.071op/s	49098807.066op/s	4.13%	-0.014	-0.162	1.66%	55416.183op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[1.209µs; 1.209µs] or [-0.017%; +0.017%]	None	None	None
credit_card/is_card_number/	throughput	[827057887.109op/s; 827331580.876op/s] or [-0.017%; +0.017%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[111.238µs; 111.449µs] or [-0.095%; +0.095%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[8973169.340op/s; 8990087.420op/s] or [-0.094%; +0.094%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[103.535µs; 103.743µs] or [-0.100%; +0.100%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[9639765.379op/s; 9659008.983op/s] or [-0.100%; +0.100%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[1.209µs; 1.209µs] or [-0.018%; +0.018%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[826863067.452op/s; 827166778.186op/s] or [-0.018%; +0.018%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[99.740µs; 99.978µs] or [-0.119%; +0.119%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[10003031.021op/s; 10026643.450op/s] or [-0.118%; +0.118%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[94.778µs; 95.004µs] or [-0.119%; +0.119%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[10526885.562op/s; 10551401.261op/s] or [-0.116%; +0.116%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[21.139µs; 21.233µs] or [-0.221%; +0.221%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[47108620.141op/s; 47316761.399op/s] or [-0.220%; +0.220%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[1.208µs; 1.208µs] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[827503391.847op/s; 827597446.666op/s] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[95.845µs; 96.036µs] or [-0.100%; +0.100%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[10413207.113op/s; 10434172.908op/s] or [-0.101%; +0.101%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[86.900µs; 87.120µs] or [-0.127%; +0.127%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[11479286.376op/s; 11508529.540op/s] or [-0.127%; +0.127%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[1.208µs; 1.209µs] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[827342136.040op/s; 827553211.711op/s] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[82.927µs; 83.122µs] or [-0.117%; +0.117%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[12031351.490op/s; 12059681.818op/s] or [-0.118%; +0.118%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[94.498µs; 94.753µs] or [-0.134%; +0.134%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[10555159.134op/s; 10582709.493op/s] or [-0.130%; +0.130%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[21.159µs; 21.256µs] or [-0.231%; +0.231%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[47057533.699op/s; 47274761.143op/s] or [-0.230%; +0.230%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	292.601ns	304.921ns ± 13.189ns	301.015ns ± 3.321ns	305.324ns	335.015ns	351.232ns	352.488ns	17.10%	2.251	4.409	4.31%	0.933ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[303.093ns; 306.749ns] or [-0.599%; +0.599%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	506.686µs	508.090µs ± 0.791µs	507.886µs ± 0.442µs	508.603µs	509.241µs	509.979µs	514.194µs	1.24%	2.536	16.240	0.16%	0.056µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1944791.488op/s	1968158.244op/s ± 3053.865op/s	1968945.559op/s ± 1716.156op/s	1970151.338op/s	1972037.106op/s	1972852.720op/s	1973608.214op/s	0.24%	-2.481	15.702	0.15%	215.941op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	466.385µs	467.224µs ± 0.379µs	467.199µs ± 0.273µs	467.491µs	467.817µs	468.150µs	468.813µs	0.35%	0.587	0.715	0.08%	0.027µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2133045.694op/s	2140304.007op/s ± 1735.160op/s	2140414.696op/s ± 1252.522op/s	2141582.982op/s	2142870.379op/s	2143344.585op/s	2144151.775op/s	0.17%	-0.581	0.697	0.08%	122.694op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	179.723µs	180.457µs ± 0.399µs	180.407µs ± 0.316µs	180.785µs	181.103µs	181.477µs	181.759µs	0.75%	0.562	-0.181	0.22%	0.028µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5501784.188op/s	5541504.875op/s ± 12226.337op/s	5543022.916op/s ± 9725.040op/s	5552196.965op/s	5557698.018op/s	5562709.887op/s	5564121.891op/s	0.38%	-0.552	-0.202	0.22%	864.533op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	43.497µs	43.790µs ± 0.215µs	43.779µs ± 0.075µs	43.851µs	43.958µs	44.039µs	46.413µs	6.02%	9.072	108.597	0.49%	0.015µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	21545518.826op/s	22836690.650op/s ± 107570.862op/s	22841751.959op/s ± 39150.583op/s	22882294.638op/s	22930428.783op/s	22961346.546op/s	22990350.002op/s	0.65%	-8.658	102.036	0.47%	7606.409op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	49.971µs	50.302µs ± 0.132µs	50.310µs ± 0.055µs	50.360µs	50.452µs	50.639µs	51.126µs	1.62%	1.184	8.662	0.26%	0.009µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	19559506.866op/s	19879908.112op/s ± 52025.498op/s	19876794.792op/s ± 21738.172op/s	19898969.617op/s	19979283.084op/s	19997220.478op/s	20011455.446op/s	0.68%	-1.113	8.263	0.26%	3678.758op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[507.981µs; 508.200µs] or [-0.022%; +0.022%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1967735.007op/s; 1968581.480op/s] or [-0.022%; +0.022%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[467.171µs; 467.276µs] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2140063.531op/s; 2140544.484op/s] or [-0.011%; +0.011%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[180.402µs; 180.513µs] or [-0.031%; +0.031%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5539810.422op/s; 5543199.327op/s] or [-0.031%; +0.031%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[43.760µs; 43.820µs] or [-0.068%; +0.068%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[22821782.363op/s; 22851598.937op/s] or [-0.065%; +0.065%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[50.284µs; 50.321µs] or [-0.036%; +0.036%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[19872697.879op/s; 19887118.346op/s] or [-0.036%; +0.036%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	75.450µs	75.564µs ± 0.175µs	75.531µs ± 0.034µs	75.577µs	75.697µs	76.105µs	77.595µs	2.73%	8.657	91.825	0.23%	0.012µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[75.540µs; 75.589µs] or [-0.032%; +0.032%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	9.022ms	9.054ms ± 0.015ms	9.053ms ± 0.010ms	9.064ms	9.078ms	9.094ms	9.118ms	0.72%	0.520	0.784	0.17%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[9.052ms; 9.056ms] or [-0.024%; +0.024%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.195µs	1.370µs ± 0.053µs	1.385µs ± 0.033µs	1.411µs	1.439µs	1.461µs	1.462µs	5.53%	-0.802	0.746	3.86%	0.004µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.363µs; 1.378µs] or [-0.536%; +0.536%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.369µs	3.190µs ± 1.393µs	3.058µs ± 0.028µs	3.079µs	3.182µs	13.755µs	14.873µs	386.38%	7.607	58.195	43.56%	0.098µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[2.997µs; 3.383µs] or [-6.052%; +6.052%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	18.267µs	25.642µs ± 10.355µs	20.476µs ± 0.788µs	34.668µs	44.190µs	47.765µs	99.014µs	383.55%	2.853	13.349	40.28%	0.732µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[24.207µs; 27.077µs] or [-5.597%; +5.597%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	e559b8c	1726525880	duncan-harvey/serverless-release

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	140.394µs	141.629µs ± 0.667µs	141.605µs ± 0.197µs	141.796µs	142.135µs	142.408µs	149.498µs	5.57%	8.209	95.299	0.47%	0.047µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[141.537µs; 141.722µs] or [-0.065%; +0.065%]	None	None	None

Baseline

Omitted due to size.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.01%. Comparing base (0df879e) to head (e559b8c).

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #634   +/-   ##
=======================================
  Coverage   73.00%   73.01%           
=======================================
  Files         252      252           
  Lines       36093    36093           
=======================================
+ Hits        26351    26352    +1     
+ Misses       9742     9741    -1     

Components	Coverage Δ
crashtracker	20.53% <ø> (+0.05%)	⬆️
datadog-alloc	98.73% <ø> (ø)
data-pipeline	90.12% <ø> (ø)
data-pipeline-ffi	0.00% <ø> (ø)
ddcommon	83.08% <ø> (ø)
ddcommon-ffi	69.52% <ø> (ø)
ddtelemetry	59.10% <ø> (ø)
ipc	83.63% <ø> (ø)
profiling	84.26% <ø> (ø)
profiling-ffi	77.42% <ø> (ø)
serverless	0.00% <ø> (ø)
sidecar	40.12% <ø> (ø)
sidecar-ffi	0.00% <ø> (ø)
spawn-worker	50.36% <ø> (ø)
tinybytes	91.66% <ø> (ø)
trace-mini-agent	72.49% <ø> (ø)
trace-normalization	98.25% <ø> (ø)
trace-obfuscation	95.73% <ø> (ø)
trace-protobuf	77.67% <ø> (ø)
trace-utils	92.88% <ø> (ø)

[hghotra]

👍🏼