Skip to content

Latest commit

 

History

History
212 lines (188 loc) · 40.5 KB

bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b-vs-base.md

File metadata and controls

212 lines (188 loc) · 40.5 KB
Raw

Results vs. base

  • fork: python
  • ref: f802c8bf872ab882d305
  • machine: linux-x86_64
  • commit hash: f802c8b
  • commit date: 2024-12-18
  • overall geometric mean: 1.251x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.26x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
2to3 473 ms 627 ms: 1.33x slower
docutils 3.75 sec 4.57 sec: 1.22x slower
html5lib 88.9 ms 132 ms: 1.49x slower
sphinx 1.42 sec 1.74 sec: 1.23x slower
Geometric mean (ref) 1.31x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
asyncio_websockets 734 ms 753 ms: 1.03x slower
coroutines 30.6 ms 34.6 ms: 1.13x slower
async_tree_io_tg 918 ms 1.10 sec: 1.19x slower
async_generators 557 ms 678 ms: 1.22x slower
async_tree_cpu_io_mixed_tg 644 ms 798 ms: 1.24x slower
async_tree_io 899 ms 1.12 sec: 1.25x slower
async_tree_none_tg 379 ms 482 ms: 1.27x slower
async_tree_memoization 514 ms 675 ms: 1.31x slower
async_tree_cpu_io_mixed 670 ms 905 ms: 1.35x slower
async_tree_memoization_tg 464 ms 638 ms: 1.37x slower
async_tree_none 377 ms 543 ms: 1.44x slower
Geometric mean (ref) 1.25x slower

Benchmarks with tag 'math':

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
nbody 123 ms 183 ms: 1.49x slower
float 114 ms 174 ms: 1.53x slower
Geometric mean (ref) 1.32x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
regex_effbot 4.21 ms 4.54 ms: 1.08x slower
regex_dna 262 ms 293 ms: 1.12x slower
regex_compile 164 ms 234 ms: 1.43x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (1): regex_v8

Benchmarks with tag 'serialize':

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
xml_etree_iterparse 160 ms 146 ms: 1.10x faster
xml_etree_parse 197 ms 204 ms: 1.04x slower
json_loads 35.0 us 38.5 us: 1.10x slower
json_dumps 15.1 ms 17.5 ms: 1.16x slower
xml_etree_generate 121 ms 143 ms: 1.19x slower
tomli_loads 2.63 sec 3.36 sec: 1.28x slower
xml_etree_process 81.3 ms 106 ms: 1.31x slower
unpickle_pure_python 288 us 451 us: 1.57x slower
pickle_pure_python 435 us 725 us: 1.67x slower
Geometric mean (ref) 1.23x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
python_startup 24.9 ms 33.2 ms: 1.33x slower
python_startup_no_site 14.4 ms 20.6 ms: 1.44x slower
Geometric mean (ref) 1.38x slower

Benchmarks with tag 'template':

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
genshi_xml 66.3 ms 84.9 ms: 1.28x slower
genshi_text 31.2 ms 42.3 ms: 1.36x slower
django_template 45.2 ms 67.1 ms: 1.48x slower
mako 16.9 ms 25.8 ms: 1.53x slower
Geometric mean (ref) 1.41x slower

All benchmarks:

Benchmark results/bm-20241218-3.14.0a3+-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json results/bm-20241218-3.14.0a3+-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3+-f802c8b.json
gc_traversal 8.59 ms 7.11 ms: 1.21x faster
create_gc_cycles 4.20 ms 3.61 ms: 1.16x faster
xml_etree_iterparse 160 ms 146 ms: 1.10x faster
asyncio_websockets 734 ms 753 ms: 1.03x slower
xml_etree_parse 197 ms 204 ms: 1.04x slower
json 6.22 ms 6.60 ms: 1.06x slower
regex_effbot 4.21 ms 4.54 ms: 1.08x slower
k_core 4.19 sec 4.56 sec: 1.09x slower
json_loads 35.0 us 38.5 us: 1.10x slower
connected_components 856 ms 953 ms: 1.11x slower
meteor_contest 149 ms 166 ms: 1.12x slower
regex_dna 262 ms 293 ms: 1.12x slower
coroutines 30.6 ms 34.6 ms: 1.13x slower
pathlib 26.7 ms 30.4 ms: 1.14x slower
shortest_path 943 ms 1.07 sec: 1.14x slower
scimark_fft 460 ms 534 ms: 1.16x slower
json_dumps 15.1 ms 17.5 ms: 1.16x slower
xml_etree_generate 121 ms 143 ms: 1.19x slower
async_tree_io_tg 918 ms 1.10 sec: 1.19x slower
async_generators 557 ms 678 ms: 1.22x slower
docutils 3.75 sec 4.57 sec: 1.22x slower
sqlglot_optimize 70.0 ms 85.4 ms: 1.22x slower
deepcopy_reduce 3.71 us 4.55 us: 1.23x slower
sphinx 1.42 sec 1.74 sec: 1.23x slower
spectral_norm 132 ms 163 ms: 1.23x slower
async_tree_cpu_io_mixed_tg 644 ms 798 ms: 1.24x slower
pylint 412 ms 513 ms: 1.24x slower
mdp 3.59 sec 4.46 sec: 1.24x slower
async_tree_io 899 ms 1.12 sec: 1.25x slower
async_tree_none_tg 379 ms 482 ms: 1.27x slower
many_optionals 1.16 ms 1.48 ms: 1.27x slower
coverage 108 ms 137 ms: 1.28x slower
bench_thread_pool 3.15 ms 4.02 ms: 1.28x slower
genshi_xml 66.3 ms 84.9 ms: 1.28x slower
tomli_loads 2.63 sec 3.36 sec: 1.28x slower
deepcopy_memo 41.1 us 52.8 us: 1.29x slower
dulwich_log 98.3 ms 127 ms: 1.29x slower
thrift 1.07 ms 1.38 ms: 1.29x slower
telco 10.0 ms 12.9 ms: 1.29x slower
deepcopy 323 us 421 us: 1.30x slower
scimark_sparse_mat_mult 6.03 ms 7.87 ms: 1.31x slower
xml_etree_process 81.3 ms 106 ms: 1.31x slower
sqlglot_normalize 137 ms 180 ms: 1.31x slower
async_tree_memoization 514 ms 675 ms: 1.31x slower
fannkuch 516 ms 679 ms: 1.32x slower
pycparser 1.49 sec 1.96 sec: 1.32x slower
crypto_pyaes 95.5 ms 126 ms: 1.32x slower
2to3 473 ms 627 ms: 1.33x slower
python_startup 24.9 ms 33.2 ms: 1.33x slower
nqueens 100 ms 134 ms: 1.33x slower
subparsers 32.2 ms 43.3 ms: 1.35x slower
async_tree_cpu_io_mixed 670 ms 905 ms: 1.35x slower
typing_runtime_protocols 214 us 289 us: 1.35x slower
genshi_text 31.2 ms 42.3 ms: 1.36x slower
generators 39.9 ms 54.2 ms: 1.36x slower
async_tree_memoization_tg 464 ms 638 ms: 1.37x slower
pyflate 681 ms 940 ms: 1.38x slower
pprint_pformat 1.96 sec 2.71 sec: 1.38x slower
bpe_tokeniser 5.87 sec 8.15 sec: 1.39x slower
sympy_integrate 28.5 ms 39.7 ms: 1.39x slower
pprint_safe_repr 980 ms 1.38 sec: 1.41x slower
regex_compile 164 ms 234 ms: 1.43x slower
python_startup_no_site 14.4 ms 20.6 ms: 1.44x slower
async_tree_none 377 ms 543 ms: 1.44x slower
django_template 45.2 ms 67.1 ms: 1.48x slower
html5lib 88.9 ms 132 ms: 1.49x slower
nbody 123 ms 183 ms: 1.49x slower
logging_format 9.21 us 14.0 us: 1.52x slower
mako 16.9 ms 25.8 ms: 1.53x slower
float 114 ms 174 ms: 1.53x slower
scimark_lu 150 ms 234 ms: 1.56x slower
richards_super 69.2 ms 108 ms: 1.56x slower
comprehensions 22.3 us 34.8 us: 1.56x slower
unpickle_pure_python 288 us 451 us: 1.57x slower
sympy_str 376 ms 591 ms: 1.57x slower
sqlalchemy_declarative 177 ms 280 ms: 1.58x slower
chaos 83.9 ms 135 ms: 1.61x slower
logging_silent 139 ns 226 ns: 1.63x slower
logging_simple 7.76 us 12.7 us: 1.64x slower
pickle_pure_python 435 us 725 us: 1.67x slower
scimark_monte_carlo 86.4 ms 148 ms: 1.71x slower
richards 58.2 ms 100 ms: 1.72x slower
raytrace 374 ms 654 ms: 1.75x slower
sqlalchemy_imperative 22.5 ms 39.7 ms: 1.76x slower
sqlglot_transpile 2.20 ms 3.89 ms: 1.77x slower
hexiom 7.55 ms 13.4 ms: 1.77x slower
sympy_expand 619 ms 1.11 sec: 1.79x slower
scimark_sor 158 ms 286 ms: 1.81x slower
sqlglot_parse 1.75 ms 3.40 ms: 1.95x slower
go 162 ms 322 ms: 1.99x slower
sympy_sum 211 ms 426 ms: 2.01x slower
deltablue 4.36 ms 11.4 ms: 2.62x slower
Geometric mean (ref) 1.34x slower

Benchmark hidden because not significant (4): regex_v8, pidigits, sqlite_synth, bench_mp_pool

  • Geometric mean (including insignificant results): 1.251x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.28x
  • 95% likely to have a slowdown of 1.27x
  • 99% likely to have a slowdown of 1.26x

Memory

  • memory change: 1.19x