Skip to content

Latest commit

 

History

History
211 lines (187 loc) · 40.2 KB

bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-base.md

File metadata and controls

211 lines (187 loc) · 40.2 KB

Results vs. base

  • fork: python
  • ref: 553cdc6d6856c1b4539a
  • machine: linux-x86_64
  • commit hash: 553cdc6
  • commit date: 2025-01-11
  • overall geometric mean: 1.188x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.19x slower
  • Memory change: 1.18x

Benchmarks with tag 'apps':

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
2to3 495 ms 638 ms: 1.29x slower
docutils 3.87 sec 4.18 sec: 1.08x slower
html5lib 98.0 ms 120 ms: 1.23x slower
sphinx 1.39 sec 1.68 sec: 1.21x slower
Geometric mean (ref) 1.20x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
asyncio_websockets 766 ms 734 ms: 1.04x faster
async_tree_io_tg 860 ms 958 ms: 1.11x slower
coroutines 31.8 ms 36.4 ms: 1.14x slower
async_tree_cpu_io_mixed_tg 636 ms 756 ms: 1.19x slower
async_tree_memoization_tg 517 ms 620 ms: 1.20x slower
async_tree_cpu_io_mixed 698 ms 841 ms: 1.20x slower
async_tree_none_tg 385 ms 467 ms: 1.21x slower
async_generators 571 ms 700 ms: 1.23x slower
async_tree_memoization 488 ms 601 ms: 1.23x slower
async_tree_io 871 ms 1.12 sec: 1.28x slower
async_tree_none 385 ms 513 ms: 1.33x slower
Geometric mean (ref) 1.19x slower

Benchmarks with tag 'math':

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
nbody 143 ms 171 ms: 1.19x slower
float 106 ms 133 ms: 1.26x slower
Geometric mean (ref) 1.13x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
regex_v8 38.5 ms 34.9 ms: 1.10x faster
regex_dna 301 ms 279 ms: 1.08x faster
regex_effbot 4.44 ms 4.15 ms: 1.07x faster
regex_compile 166 ms 240 ms: 1.45x slower
Geometric mean (ref) 1.03x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
xml_etree_iterparse 180 ms 144 ms: 1.25x faster
json_loads 39.6 us 42.1 us: 1.06x slower
xml_etree_process 89.0 ms 100 ms: 1.13x slower
xml_etree_parse 202 ms 244 ms: 1.21x slower
json_dumps 16.3 ms 19.7 ms: 1.21x slower
tomli_loads 2.55 sec 3.11 sec: 1.22x slower
xml_etree_generate 129 ms 162 ms: 1.26x slower
unpickle_pure_python 327 us 444 us: 1.36x slower
pickle_pure_python 457 us 680 us: 1.49x slower
Geometric mean (ref) 1.18x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
python_startup 29.8 ms 32.7 ms: 1.10x slower
python_startup_no_site 16.6 ms 21.6 ms: 1.30x slower
Geometric mean (ref) 1.19x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
django_template 43.9 ms 58.6 ms: 1.33x slower
genshi_text 28.9 ms 40.3 ms: 1.39x slower
mako 16.3 ms 25.4 ms: 1.56x slower
Geometric mean (ref) 1.31x slower

Benchmark hidden because not significant (1): genshi_xml

All benchmarks:

Benchmark results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json results/bm-20250111-3.14.0a3+-553cdc6-NOGIL/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json
xml_etree_iterparse 180 ms 144 ms: 1.25x faster
regex_v8 38.5 ms 34.9 ms: 1.10x faster
regex_dna 301 ms 279 ms: 1.08x faster
sqlite_synth 3.91 us 3.62 us: 1.08x faster
gc_traversal 8.53 ms 7.96 ms: 1.07x faster
regex_effbot 4.44 ms 4.15 ms: 1.07x faster
create_gc_cycles 3.75 ms 3.57 ms: 1.05x faster
asyncio_websockets 766 ms 734 ms: 1.04x faster
pathlib 30.3 ms 31.8 ms: 1.05x slower
json_loads 39.6 us 42.1 us: 1.06x slower
shortest_path 979 ms 1.04 sec: 1.06x slower
docutils 3.87 sec 4.18 sec: 1.08x slower
sympy_integrate 32.0 ms 34.7 ms: 1.09x slower
python_startup 29.8 ms 32.7 ms: 1.10x slower
async_tree_io_tg 860 ms 958 ms: 1.11x slower
xml_etree_process 89.0 ms 100 ms: 1.13x slower
meteor_contest 163 ms 185 ms: 1.13x slower
connected_components 816 ms 927 ms: 1.14x slower
many_optionals 1.21 ms 1.37 ms: 1.14x slower
json 6.34 ms 7.21 ms: 1.14x slower
bench_thread_pool 3.79 ms 4.34 ms: 1.14x slower
pylint 414 ms 474 ms: 1.14x slower
coroutines 31.8 ms 36.4 ms: 1.14x slower
sympy_expand 582 ms 684 ms: 1.18x slower
sympy_sum 219 ms 258 ms: 1.18x slower
pycparser 1.51 sec 1.79 sec: 1.19x slower
async_tree_cpu_io_mixed_tg 636 ms 756 ms: 1.19x slower
mdp 3.73 sec 4.44 sec: 1.19x slower
coverage 108 ms 129 ms: 1.19x slower
logging_format 9.99 us 11.9 us: 1.19x slower
nbody 143 ms 171 ms: 1.19x slower
telco 10.3 ms 12.4 ms: 1.20x slower
async_tree_memoization_tg 517 ms 620 ms: 1.20x slower
async_tree_cpu_io_mixed 698 ms 841 ms: 1.20x slower
xml_etree_parse 202 ms 244 ms: 1.21x slower
json_dumps 16.3 ms 19.7 ms: 1.21x slower
async_tree_none_tg 385 ms 467 ms: 1.21x slower
sphinx 1.39 sec 1.68 sec: 1.21x slower
typing_runtime_protocols 229 us 278 us: 1.22x slower
tomli_loads 2.55 sec 3.11 sec: 1.22x slower
nqueens 108 ms 132 ms: 1.22x slower
html5lib 98.0 ms 120 ms: 1.23x slower
async_generators 571 ms 700 ms: 1.23x slower
async_tree_memoization 488 ms 601 ms: 1.23x slower
bpe_tokeniser 6.37 sec 7.85 sec: 1.23x slower
dulwich_log 98.1 ms 121 ms: 1.23x slower
float 106 ms 133 ms: 1.26x slower
xml_etree_generate 129 ms 162 ms: 1.26x slower
scimark_fft 441 ms 558 ms: 1.26x slower
sqlglot_optimize 72.7 ms 92.7 ms: 1.27x slower
pyflate 709 ms 905 ms: 1.28x slower
fannkuch 515 ms 659 ms: 1.28x slower
thrift 1.13 ms 1.45 ms: 1.28x slower
async_tree_io 871 ms 1.12 sec: 1.28x slower
2to3 495 ms 638 ms: 1.29x slower
scimark_sparse_mat_mult 5.86 ms 7.58 ms: 1.29x slower
subparsers 30.7 ms 39.7 ms: 1.29x slower
python_startup_no_site 16.6 ms 21.6 ms: 1.30x slower
deepcopy_reduce 3.82 us 5.01 us: 1.31x slower
pprint_safe_repr 960 ms 1.26 sec: 1.32x slower
deepcopy 372 us 490 us: 1.32x slower
richards_super 75.8 ms 100 ms: 1.32x slower
sqlglot_normalize 138 ms 183 ms: 1.33x slower
async_tree_none 385 ms 513 ms: 1.33x slower
django_template 43.9 ms 58.6 ms: 1.33x slower
scimark_lu 149 ms 199 ms: 1.33x slower
sympy_str 372 ms 505 ms: 1.36x slower
unpickle_pure_python 327 us 444 us: 1.36x slower
deepcopy_memo 42.4 us 57.9 us: 1.37x slower
sqlalchemy_declarative 175 ms 240 ms: 1.38x slower
logging_simple 9.00 us 12.5 us: 1.39x slower
genshi_text 28.9 ms 40.3 ms: 1.39x slower
pprint_pformat 1.84 sec 2.58 sec: 1.40x slower
chaos 85.7 ms 121 ms: 1.41x slower
sqlglot_transpile 2.30 ms 3.31 ms: 1.43x slower
richards 58.3 ms 84.5 ms: 1.45x slower
regex_compile 166 ms 240 ms: 1.45x slower
scimark_sor 153 ms 225 ms: 1.47x slower
crypto_pyaes 92.5 ms 136 ms: 1.47x slower
generators 39.1 ms 58.1 ms: 1.49x slower
pickle_pure_python 457 us 680 us: 1.49x slower
hexiom 8.86 ms 13.5 ms: 1.53x slower
scimark_monte_carlo 87.8 ms 135 ms: 1.53x slower
mako 16.3 ms 25.4 ms: 1.56x slower
logging_silent 141 ns 222 ns: 1.58x slower
go 166 ms 262 ms: 1.58x slower
raytrace 363 ms 582 ms: 1.60x slower
sqlalchemy_imperative 24.0 ms 41.3 ms: 1.72x slower
comprehensions 20.8 us 36.0 us: 1.73x slower
sqlglot_parse 1.74 ms 3.07 ms: 1.77x slower
deltablue 4.75 ms 10.3 ms: 2.17x slower
Geometric mean (ref) 1.24x slower

Benchmark hidden because not significant (5): pidigits, k_core, spectral_norm, bench_mp_pool, genshi_xml

  • Geometric mean (including insignificant results): 1.188x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.20x
  • 95% likely to have a slowdown of 1.20x
  • 99% likely to have a slowdown of 1.19x

Memory

  • memory change: 1.18x