Skip to content

Latest commit

 

History

History
211 lines (186 loc) · 39.8 KB

bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca-vs-base.md

File metadata and controls

211 lines (186 loc) · 39.8 KB
Raw

Results vs. base

  • fork: python
  • ref: ef63cca494571f50906b
  • machine: linux-x86_64
  • commit hash: ef63cca
  • commit date: 2024-12-29
  • overall geometric mean: 1.212x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.20x slower
  • Memory change: 1.18x

Benchmarks with tag 'apps':

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
2to3 432 ms 600 ms: 1.39x slower
docutils 3.65 sec 4.46 sec: 1.22x slower
html5lib 83.4 ms 121 ms: 1.45x slower
sphinx 1.40 sec 1.71 sec: 1.23x slower
Geometric mean (ref) 1.32x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
async_tree_io_tg 877 ms 961 ms: 1.10x slower
async_tree_none_tg 367 ms 407 ms: 1.11x slower
async_tree_cpu_io_mixed_tg 669 ms 744 ms: 1.11x slower
coroutines 29.7 ms 33.8 ms: 1.14x slower
async_generators 542 ms 630 ms: 1.16x slower
async_tree_io 895 ms 1.04 sec: 1.17x slower
async_tree_memoization 502 ms 606 ms: 1.21x slower
async_tree_memoization_tg 467 ms 566 ms: 1.21x slower
async_tree_none 391 ms 477 ms: 1.22x slower
async_tree_cpu_io_mixed 666 ms 830 ms: 1.25x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (1): asyncio_websockets

Benchmarks with tag 'math':

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
float 108 ms 146 ms: 1.35x slower
nbody 124 ms 175 ms: 1.41x slower
Geometric mean (ref) 1.24x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
regex_v8 32.9 ms 34.0 ms: 1.04x slower
regex_dna 276 ms 291 ms: 1.06x slower
regex_effbot 4.00 ms 4.38 ms: 1.09x slower
regex_compile 171 ms 223 ms: 1.30x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
xml_etree_iterparse 145 ms 137 ms: 1.05x faster
json_loads 33.5 us 37.3 us: 1.11x slower
json_dumps 15.5 ms 17.7 ms: 1.15x slower
xml_etree_generate 118 ms 139 ms: 1.19x slower
xml_etree_process 81.4 ms 101 ms: 1.24x slower
tomli_loads 2.53 sec 3.33 sec: 1.32x slower
unpickle_pure_python 275 us 418 us: 1.52x slower
pickle_pure_python 405 us 634 us: 1.57x slower
Geometric mean (ref) 1.21x slower

Benchmark hidden because not significant (1): xml_etree_parse

Benchmarks with tag 'startup':

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
python_startup 26.2 ms 31.1 ms: 1.19x slower
python_startup_no_site 14.9 ms 19.8 ms: 1.33x slower
Geometric mean (ref) 1.26x slower

Benchmarks with tag 'template':

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
genshi_xml 65.0 ms 87.6 ms: 1.35x slower
genshi_text 30.1 ms 41.5 ms: 1.38x slower
django_template 44.0 ms 63.1 ms: 1.43x slower
mako 17.5 ms 26.3 ms: 1.51x slower
Geometric mean (ref) 1.42x slower

All benchmarks:

Benchmark results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json
sqlite_synth 3.72 us 3.48 us: 1.07x faster
xml_etree_iterparse 145 ms 137 ms: 1.05x faster
regex_v8 32.9 ms 34.0 ms: 1.04x slower
regex_dna 276 ms 291 ms: 1.06x slower
k_core 4.13 sec 4.50 sec: 1.09x slower
regex_effbot 4.00 ms 4.38 ms: 1.09x slower
async_tree_io_tg 877 ms 961 ms: 1.10x slower
telco 10.1 ms 11.0 ms: 1.10x slower
async_tree_none_tg 367 ms 407 ms: 1.11x slower
pycparser 1.60 sec 1.77 sec: 1.11x slower
async_tree_cpu_io_mixed_tg 669 ms 744 ms: 1.11x slower
json_loads 33.5 us 37.3 us: 1.11x slower
json 6.28 ms 7.07 ms: 1.13x slower
meteor_contest 150 ms 169 ms: 1.13x slower
coroutines 29.7 ms 33.8 ms: 1.14x slower
shortest_path 902 ms 1.03 sec: 1.14x slower
json_dumps 15.5 ms 17.7 ms: 1.15x slower
pathlib 27.0 ms 31.1 ms: 1.15x slower
spectral_norm 132 ms 153 ms: 1.16x slower
async_generators 542 ms 630 ms: 1.16x slower
async_tree_io 895 ms 1.04 sec: 1.17x slower
connected_components 810 ms 949 ms: 1.17x slower
dulwich_log 92.2 ms 108 ms: 1.17x slower
scimark_sparse_mat_mult 6.36 ms 7.49 ms: 1.18x slower
sympy_expand 593 ms 701 ms: 1.18x slower
xml_etree_generate 118 ms 139 ms: 1.19x slower
python_startup 26.2 ms 31.1 ms: 1.19x slower
async_tree_memoization 502 ms 606 ms: 1.21x slower
sqlglot_optimize 69.2 ms 83.5 ms: 1.21x slower
async_tree_memoization_tg 467 ms 566 ms: 1.21x slower
typing_runtime_protocols 219 us 266 us: 1.21x slower
scimark_fft 444 ms 541 ms: 1.22x slower
docutils 3.65 sec 4.46 sec: 1.22x slower
async_tree_none 391 ms 477 ms: 1.22x slower
sphinx 1.40 sec 1.71 sec: 1.23x slower
deepcopy_reduce 3.36 us 4.12 us: 1.23x slower
subparsers 31.6 ms 39.0 ms: 1.23x slower
xml_etree_process 81.4 ms 101 ms: 1.24x slower
async_tree_cpu_io_mixed 666 ms 830 ms: 1.25x slower
mdp 3.60 sec 4.50 sec: 1.25x slower
sqlglot_normalize 130 ms 163 ms: 1.25x slower
nqueens 105 ms 132 ms: 1.26x slower
sympy_sum 197 ms 248 ms: 1.26x slower
crypto_pyaes 94.9 ms 120 ms: 1.26x slower
pylint 389 ms 492 ms: 1.27x slower
sympy_integrate 27.0 ms 34.4 ms: 1.27x slower
coverage 105 ms 134 ms: 1.28x slower
sympy_str 358 ms 458 ms: 1.28x slower
deepcopy 340 us 439 us: 1.29x slower
bench_thread_pool 3.12 ms 4.04 ms: 1.30x slower
deepcopy_memo 39.7 us 51.5 us: 1.30x slower
regex_compile 171 ms 223 ms: 1.30x slower
tomli_loads 2.53 sec 3.33 sec: 1.32x slower
many_optionals 1.08 ms 1.42 ms: 1.32x slower
fannkuch 515 ms 681 ms: 1.32x slower
python_startup_no_site 14.9 ms 19.8 ms: 1.33x slower
thrift 974 us 1.30 ms: 1.33x slower
scimark_lu 150 ms 201 ms: 1.34x slower
pprint_safe_repr 954 ms 1.28 sec: 1.34x slower
genshi_xml 65.0 ms 87.6 ms: 1.35x slower
bpe_tokeniser 5.89 sec 7.97 sec: 1.35x slower
float 108 ms 146 ms: 1.35x slower
logging_simple 7.97 us 11.0 us: 1.38x slower
genshi_text 30.1 ms 41.5 ms: 1.38x slower
pyflate 678 ms 937 ms: 1.38x slower
generators 38.8 ms 53.8 ms: 1.39x slower
pprint_pformat 1.87 sec 2.60 sec: 1.39x slower
2to3 432 ms 600 ms: 1.39x slower
richards 56.7 ms 79.0 ms: 1.39x slower
logging_format 8.91 us 12.5 us: 1.41x slower
nbody 124 ms 175 ms: 1.41x slower
django_template 44.0 ms 63.1 ms: 1.43x slower
sqlalchemy_declarative 180 ms 260 ms: 1.44x slower
html5lib 83.4 ms 121 ms: 1.45x slower
richards_super 62.8 ms 91.1 ms: 1.45x slower
hexiom 8.33 ms 12.1 ms: 1.45x slower
mako 17.5 ms 26.3 ms: 1.51x slower
unpickle_pure_python 275 us 418 us: 1.52x slower
sqlalchemy_imperative 23.3 ms 35.5 ms: 1.52x slower
comprehensions 21.9 us 33.5 us: 1.53x slower
sqlglot_transpile 2.27 ms 3.49 ms: 1.54x slower
chaos 79.0 ms 122 ms: 1.55x slower
logging_silent 140 ns 218 ns: 1.56x slower
pickle_pure_python 405 us 634 us: 1.57x slower
scimark_monte_carlo 83.4 ms 137 ms: 1.64x slower
scimark_sor 161 ms 274 ms: 1.71x slower
raytrace 343 ms 592 ms: 1.72x slower
sqlglot_parse 1.65 ms 2.91 ms: 1.76x slower
go 161 ms 286 ms: 1.78x slower
deltablue 4.21 ms 10.4 ms: 2.47x slower
Geometric mean (ref) 1.28x slower

Benchmark hidden because not significant (6): pidigits, bench_mp_pool, gc_traversal, xml_etree_parse, create_gc_cycles, asyncio_websockets

  • Geometric mean (including insignificant results): 1.212x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.22x
  • 95% likely to have a slowdown of 1.21x
  • 99% likely to have a slowdown of 1.20x

Memory

  • memory change: 1.18x