ci(ubuntu): update before install

[P403n1x87]

APT repository changes might require apt-get update to be called before apt-get install.

[github-actions]

Austin Benchmarks

Running Austin benchmarks with Python 3.10.11

Wall time [sampling interval: 1]

Wall time [sampling interval: 1]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	123000 ± 2000	1 ± 0	1.3e-05 ± 6e-06	12.7 ± 0.5
3.5.0	126000 ± 2000	1 ± 0	1.7e-05 ± 7e-06	12.1 ± 0.3
dev	124000 ± 3000	1 ± 0	2e-05 ± 6e-06	12.5 ± 0.5

Wall time [sampling interval: 10]

Wall time [sampling interval: 10]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	121000 ± 4000	0.544 ± 0.001	1.7e-05 ± 7e-06	12.8 ± 0.4
3.5.0	122000 ± 3000	0.544 ± 0.002	1.6e-05 ± 7e-06	12.6 ± 0.5
dev	120000 ± 4000	0.543 ± 0.001	1.2e-05 ± 6e-06	12.6 ± 0.5

Wall time [sampling interval: 100]

Wall time [sampling interval: 100]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	10900 ± 300	0.0006 ± 0.0002	6e-05 ± 7e-05	14.6 ± 0.5
3.5.0	11200 ± 500	0.0004 ± 0.0002	5e-05 ± 5e-05	14.4 ± 0.5
dev	11100 ± 600	0.0006 ± 0.0001	4e-05 ± 5e-05	14.3 ± 0.7

Wall time [sampling interval: 1000]

Wall time [sampling interval: 1000]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	1810 ± 50	0.0001 ± 0.0002	0.0001 ± 0.0001	16.1 ± 0.9
3.5.0	1860 ± 20	0 ± 0	0.0001 ± 0.0001	17.3 ± 0.5
dev	1860 ± 10	0 ± 0	0.0001 ± 0.0001	17.8 ± 0.4

CPU time [sampling interval: 1]

CPU time [sampling interval: 1]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	52000 ± 3000	1 ± 0	2e-05 ± 1e-05	22.8 ± 0.8
3.5.0	52000 ± 3000	1 ± 0	3e-05 ± 1e-05	23 ± 1
dev	53000 ± 3000	1 ± 0	2e-05 ± 1e-05	22.5 ± 0.5

CPU time [sampling interval: 10]

CPU time [sampling interval: 10]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	53000 ± 2000	0.9974 ± 0.0004	2.2e-05 ± 1e-05	22.5 ± 0.5
3.5.0	52000 ± 1000	0.9971 ± 0.0003	2.6e-05 ± 9e-06	22.5 ± 0.5
dev	52000 ± 3000	0.9968 ± 0.0003	2e-05 ± 1e-05	22.7 ± 0.9

CPU time [sampling interval: 100]

CPU time [sampling interval: 100]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	5550 ± 100	0.001 ± 0.0004	0.0001 ± 0.0001	23.5 ± 1.0
3.5.0	5400 ± 100	0.001 ± 0.0003	0.00012 ± 0.0001	23.5 ± 0.5
dev	5530 ± 70	0.0008 ± 0.0002	0.0001 ± 0.0001	23.3 ± 0.7

CPU time [sampling interval: 1000]

CPU time [sampling interval: 1000]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	949 ± 4	0.0002 ± 0.0005	0.0002 ± 0.0003	28 ± 1
3.5.0	950 ± 3	0 ± 0	0.0003 ± 0.0005	27.5 ± 0.5
dev	950 ± 3	0 ± 0	0 ± 0	27.7 ± 0.5

RSA keygen [sampling interval: 1]

RSA keygen [sampling interval: 1]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	39000 ± 2000	1 ± 0	0.0005 ± 0.0005	24.5 ± 0.8
3.5.0	39000 ± 1000	1 ± 0	0.0005 ± 0.0006	24.9 ± 0.9
dev	40600 ± 900	1 ± 0	0.00019 ± 8e-05	23.9 ± 0.3

RSA keygen [sampling interval: 10]

RSA keygen [sampling interval: 10]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	39400 ± 900	0.986 ± 0.009	0.0002 ± 0.0002	24.5 ± 0.7
3.5.0	40000 ± 1000	0.987 ± 0.008	0.0002 ± 0.0001	24.2 ± 0.6
dev	40000 ± 1000	0.983 ± 0.01	0.0002 ± 0.0002	23.9 ± 0.7

RSA keygen [sampling interval: 100]

RSA keygen [sampling interval: 100]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	6300 ± 40	0.003 ± 0.002	0.001 ± 0.0007	28 ± 2
3.5.0	6310 ± 10	0.002 ± 0.002	0.0011 ± 0.0008	28 ± 2
dev	6310 ± 20	0.002 ± 0.001	0.0004 ± 0.0002	27 ± 2

RSA keygen [sampling interval: 1000]

RSA keygen [sampling interval: 1000]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	942 ± 2	0 ± 0	0.002 ± 0.005	35 ± 3
3.5.0	941 ± 6	0 ± 0	0.0 ± 0.001	34 ± 2
dev	942 ± 2	0 ± 0	0.001 ± 0.002	34 ± 3

Full metrics [sampling interval: 1]

Full metrics [sampling interval: 1]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	51000 ± 2000	1 ± 0	4e-05 ± 2e-05	30 ± 1
3.5.0	51000 ± 1000	1 ± 0	5e-05 ± 2e-05	30.1 ± 1.0
dev	52000 ± 1000	1 ± 0	5e-05 ± 2e-05	29.8 ± 0.9

Full metrics [sampling interval: 10]

Full metrics [sampling interval: 10]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	51000 ± 3000	1 ± 0	4e-05 ± 1e-05	30 ± 2
3.5.0	51000 ± 2000	1 ± 0	4e-05 ± 1e-05	30 ± 2
dev	51000 ± 1000	1 ± 0	4e-05 ± 2e-05	29.7 ± 0.9

Full metrics [sampling interval: 100]

Full metrics [sampling interval: 100]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	9800 ± 300	0.0018 ± 0.0004	0.00011 ± 7e-05	34 ± 1
3.5.0	9800 ± 200	0.0017 ± 0.0007	9e-05 ± 8e-05	34 ± 1
dev	9900 ± 300	0.0021 ± 0.0005	0.0001 ± 9e-05	35 ± 2

Full metrics [sampling interval: 1000]

Full metrics [sampling interval: 1000]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	1840 ± 20	0 ± 0	0.0001 ± 0.0001	37.5 ± 0.5
3.5.0	1860 ± 20	0.0001 ± 0.0002	0.0 ± 0.0001	38.1 ± 0.7
dev	1860 ± 20	0.0 ± 0.0001	0.0 ± 0.0001	37.6 ± 0.5

Multiprocess wall time [sampling interval: 1]

Multiprocess wall time [sampling interval: 1]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	2600 ± 200	1 ± 0	0.00018 ± 7e-05	260 ± 10
3.5.0	3300 ± 200	1 ± 0	0.0003 ± 0.0003	290 ± 20
dev	3400 ± 200	1 ± 0	0.0003 ± 0.0003	290 ± 20

Multiprocess wall time [sampling interval: 10]

Multiprocess wall time [sampling interval: 10]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	2600 ± 200	1 ± 0	0.0003 ± 0.0004	244 ± 9
3.5.0	3300 ± 200	1 ± 0	0.00016 ± 5e-05	290 ± 20
dev	3500 ± 200	1 ± 0	0.00015 ± 4e-05	280 ± 20

Multiprocess wall time [sampling interval: 100]

Multiprocess wall time [sampling interval: 100]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	2600 ± 200	0.03 ± 0.02	0.00011 ± 4e-05	260 ± 10
3.5.0	3200 ± 200	0.03 ± 0.02	0.00014 ± 4e-05	300 ± 20
dev	3200 ± 100	0.05 ± 0.01	0.00012 ± 3e-05	300 ± 10

Multiprocess wall time [sampling interval: 1000]

Multiprocess wall time [sampling interval: 1000]

	Sample Rate	Saturation	Error Rate	Sampling Speed
3.4.1	2200 ± 100	0.006 ± 0.003	3e-05 ± 3e-05	110 ± 10
3.5.0	3000 ± 100	0.007 ± 0.002	3e-05 ± 3e-05	68 ± 8
dev	3000 ± 100	0.006 ± 0.003	3e-05 ± 2e-05	60 ± 10

Benchmark Summary

Comparison of dev against 3.5.0.

The following scenarios show a statistically significant difference in performance between the two versions.

	Sample Rate	Saturation	Error Rate	Sampling Speed
Wall time [sampling interval: 1000]	🟡	🟡	🟡	🔴
RSA keygen [sampling interval: 1]	🟢	🟡	🟡	🟢
RSA keygen [sampling interval: 100]	🟡	🟡	🟢	🟡