Skip to content

Latest commit

 

History

History
219 lines (195 loc) · 43.2 KB

bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-base.md

File metadata and controls

219 lines (195 loc) · 43.2 KB
Raw

Results vs. base

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: linux-x86_64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.18x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.12x slower
  • Memory change: 1.02x

Benchmarks with tag 'apps':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
2to3 274 ms 340 ms: 1.24x slower
chameleon 7.08 ms 8.17 ms: 1.15x slower
docutils 2.83 sec 3.39 sec: 1.20x slower
html5lib 68.9 ms 80.9 ms: 1.17x slower
tornado_http 94.1 ms 106 ms: 1.12x slower
Geometric mean (ref) 1.18x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
async_tree_io 954 ms 985 ms: 1.03x slower
async_tree_cpu_io_mixed_tg 588 ms 613 ms: 1.04x slower
async_tree_cpu_io_mixed 614 ms 642 ms: 1.05x slower
async_tree_memoization_tg 447 ms 472 ms: 1.06x slower
async_tree_none_tg 338 ms 361 ms: 1.07x slower
async_tree_none 379 ms 406 ms: 1.07x slower
async_tree_memoization 462 ms 510 ms: 1.10x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): async_tree_io_tg

Benchmarks with tag 'math':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
pidigits 189 ms 191 ms: 1.01x slower
float 79.6 ms 97.0 ms: 1.22x slower
nbody 89.3 ms 137 ms: 1.54x slower
Geometric mean (ref) 1.24x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
regex_dna 235 ms 230 ms: 1.02x faster
regex_effbot 3.78 ms 3.80 ms: 1.01x slower
regex_v8 24.8 ms 25.0 ms: 1.01x slower
regex_compile 136 ms 203 ms: 1.49x slower
Geometric mean (ref) 1.10x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
xml_etree_parse 159 ms 153 ms: 1.04x faster
unpickle_list 5.54 us 5.43 us: 1.02x faster
pickle 11.9 us 11.9 us: 1.01x faster
json_loads 28.6 us 28.8 us: 1.00x slower
pickle_list 5.02 us 5.12 us: 1.02x slower
json_dumps 10.8 ms 11.1 ms: 1.03x slower
pickle_dict 34.4 us 35.5 us: 1.03x slower
xml_etree_iterparse 108 ms 115 ms: 1.06x slower
xml_etree_process 62.1 ms 70.0 ms: 1.13x slower
xml_etree_generate 88.5 ms 100 ms: 1.13x slower
tomli_loads 2.18 sec 2.85 sec: 1.31x slower
unpickle_pure_python 220 us 307 us: 1.39x slower
pickle_pure_python 304 us 439 us: 1.44x slower
Geometric mean (ref) 1.10x slower

Benchmark hidden because not significant (1): unpickle

Benchmarks with tag 'startup':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
python_startup 10.9 ms 10.9 ms: 1.01x faster
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (1): python_startup_no_site

Benchmarks with tag 'template':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
django_template 35.0 ms 44.1 ms: 1.26x slower
mako 11.4 ms 14.8 ms: 1.29x slower
genshi_xml 52.4 ms 75.0 ms: 1.43x slower
genshi_text 23.8 ms 34.3 ms: 1.44x slower
Geometric mean (ref) 1.35x slower

All benchmarks:

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
xml_etree_parse 159 ms 153 ms: 1.04x faster
regex_dna 235 ms 230 ms: 1.02x faster
unpickle_list 5.54 us 5.43 us: 1.02x faster
pickle 11.9 us 11.9 us: 1.01x faster
python_startup 10.9 ms 10.9 ms: 1.01x faster
json_loads 28.6 us 28.8 us: 1.00x slower
regex_effbot 3.78 ms 3.80 ms: 1.01x slower
create_gc_cycles 1.83 ms 1.84 ms: 1.01x slower
regex_v8 24.8 ms 25.0 ms: 1.01x slower
pidigits 189 ms 191 ms: 1.01x slower
asyncio_tcp_ssl 1.85 sec 1.88 sec: 1.01x slower
gc_traversal 3.81 ms 3.87 ms: 1.02x slower
pickle_list 5.02 us 5.12 us: 1.02x slower
sqlite_synth 3.00 us 3.07 us: 1.02x slower
json_dumps 10.8 ms 11.1 ms: 1.03x slower
thrift 816 us 840 us: 1.03x slower
async_tree_io 954 ms 985 ms: 1.03x slower
pickle_dict 34.4 us 35.5 us: 1.03x slower
async_tree_cpu_io_mixed_tg 588 ms 613 ms: 1.04x slower
async_tree_cpu_io_mixed 614 ms 642 ms: 1.05x slower
asyncio_tcp 505 ms 528 ms: 1.05x slower
pathlib 17.5 ms 18.4 ms: 1.05x slower
async_tree_memoization_tg 447 ms 472 ms: 1.06x slower
flaskblogging 8.90 ms 9.44 ms: 1.06x slower
generators 29.3 ms 31.1 ms: 1.06x slower
djangocms 31.1 us 33.1 us: 1.06x slower
xml_etree_iterparse 108 ms 115 ms: 1.06x slower
json 5.28 ms 5.62 ms: 1.06x slower
async_tree_none_tg 338 ms 361 ms: 1.07x slower
dask 369 ms 394 ms: 1.07x slower
async_tree_none 379 ms 406 ms: 1.07x slower
gunicorn 1.28 ms 1.38 ms: 1.08x slower
coroutines 22.7 ms 24.6 ms: 1.08x slower
aiohttp 1.18 ms 1.28 ms: 1.09x slower
async_tree_memoization 462 ms 510 ms: 1.10x slower
async_generators 441 ms 488 ms: 1.11x slower
tornado_http 94.1 ms 106 ms: 1.12x slower
bench_thread_pool 830 us 934 us: 1.13x slower
xml_etree_process 62.1 ms 70.0 ms: 1.13x slower
xml_etree_generate 88.5 ms 100 ms: 1.13x slower
meteor_contest 112 ms 127 ms: 1.14x slower
logging_format 6.35 us 7.26 us: 1.14x slower
logging_simple 5.68 us 6.49 us: 1.14x slower
telco 8.47 ms 9.73 ms: 1.15x slower
dulwich_log 65.8 ms 75.8 ms: 1.15x slower
chameleon 7.08 ms 8.17 ms: 1.15x slower
mypy2 741 ms 862 ms: 1.16x slower
pylint 317 ms 370 ms: 1.17x slower
html5lib 68.9 ms 80.9 ms: 1.17x slower
docutils 2.83 sec 3.39 sec: 1.20x slower
typing_runtime_protocols 165 us 199 us: 1.20x slower
mdp 2.60 sec 3.13 sec: 1.20x slower
float 79.6 ms 97.0 ms: 1.22x slower
sympy_sum 155 ms 191 ms: 1.23x slower
pycparser 1.18 sec 1.44 sec: 1.23x slower
2to3 274 ms 340 ms: 1.24x slower
deepcopy_reduce 3.27 us 4.07 us: 1.24x slower
sympy_expand 470 ms 586 ms: 1.25x slower
sympy_integrate 20.5 ms 25.6 ms: 1.25x slower
bpe_tokeniser 4.95 sec 6.19 sec: 1.25x slower
scimark_sor 129 ms 162 ms: 1.26x slower
richards_super 56.8 ms 71.5 ms: 1.26x slower
django_template 35.0 ms 44.1 ms: 1.26x slower
sympy_str 281 ms 354 ms: 1.26x slower
sqlglot_optimize 55.3 ms 69.9 ms: 1.26x slower
raytrace 272 ms 343 ms: 1.26x slower
scimark_fft 377 ms 482 ms: 1.28x slower
richards 50.2 ms 64.5 ms: 1.29x slower
mako 11.4 ms 14.8 ms: 1.29x slower
sqlglot_normalize 110 ms 142 ms: 1.29x slower
crypto_pyaes 76.7 ms 99.9 ms: 1.30x slower
tomli_loads 2.18 sec 2.85 sec: 1.31x slower
scimark_sparse_mat_mult 5.22 ms 6.81 ms: 1.31x slower
pyflate 485 ms 638 ms: 1.32x slower
fannkuch 406 ms 536 ms: 1.32x slower
sqlglot_transpile 1.62 ms 2.15 ms: 1.33x slower
deepcopy 366 us 491 us: 1.34x slower
go 143 ms 192 ms: 1.34x slower
spectral_norm 116 ms 157 ms: 1.34x slower
sqlglot_parse 1.31 ms 1.76 ms: 1.35x slower
pprint_safe_repr 764 ms 1.04 sec: 1.36x slower
pprint_pformat 1.56 sec 2.13 sec: 1.36x slower
unpickle_pure_python 220 us 307 us: 1.39x slower
deltablue 3.32 ms 4.63 ms: 1.40x slower
genshi_xml 52.4 ms 75.0 ms: 1.43x slower
scimark_lu 119 ms 170 ms: 1.44x slower
pickle_pure_python 304 us 439 us: 1.44x slower
genshi_text 23.8 ms 34.3 ms: 1.44x slower
deepcopy_memo 39.8 us 57.6 us: 1.45x slower
scimark_monte_carlo 69.3 ms 100 ms: 1.45x slower
chaos 61.2 ms 89.7 ms: 1.47x slower
nqueens 80.4 ms 119 ms: 1.47x slower
regex_compile 136 ms 203 ms: 1.49x slower
nbody 89.3 ms 137 ms: 1.54x slower
logging_silent 104 ns 166 ns: 1.60x slower
comprehensions 17.0 us 27.4 us: 1.61x slower
hexiom 6.25 ms 11.0 ms: 1.76x slower
Geometric mean (ref) 1.18x slower

Benchmark hidden because not significant (6): python_startup_no_site, asyncio_websockets, coverage, unpickle, bench_mp_pool, async_tree_io_tg

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.15x
  • 95% likely to have a slowdown of 1.14x
  • 99% likely to have a slowdown of 1.12x

Memory

  • memory change: 1.02x