fork: python
ref: ef63cca494571f50906b
machine: linux-x86_64
commit hash: ef63cca
commit date: 2024-12-29
overall geometric mean: 1.082x faster
HPT reliability: 100.00%
HPT 99th percentile: 1.04x faster
Memory change: 1.13x
Benchmarks with tag 'apps':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
docutils
4.01 sec
3.65 sec: 1.10x faster
html5lib
92.6 ms
83.4 ms: 1.11x faster
Geometric mean
(ref)
1.08x faster
Benchmark hidden because not significant (1): 2to3
Benchmarks with tag 'asyncio':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
async_tree_io_tg
1.40 sec
877 ms: 1.60x faster
async_tree_io
1.39 sec
895 ms: 1.55x faster
async_tree_none
572 ms
391 ms: 1.46x faster
async_tree_memoization_tg
670 ms
467 ms: 1.43x faster
async_tree_memoization
709 ms
502 ms: 1.41x faster
async_tree_none_tg
504 ms
367 ms: 1.37x faster
async_tree_cpu_io_mixed
889 ms
666 ms: 1.33x faster
async_tree_cpu_io_mixed_tg
852 ms
669 ms: 1.27x faster
asyncio_websockets
766 ms
731 ms: 1.05x faster
async_generators
567 ms
542 ms: 1.05x faster
Geometric mean
(ref)
1.31x faster
Benchmark hidden because not significant (1): coroutines
Benchmarks with tag 'math':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
pidigits
251 ms
234 ms: 1.07x faster
float
116 ms
108 ms: 1.07x faster
nbody
119 ms
124 ms: 1.04x slower
Geometric mean
(ref)
1.03x faster
Benchmarks with tag 'regex':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
regex_effbot
4.74 ms
4.00 ms: 1.18x faster
regex_compile
182 ms
171 ms: 1.07x faster
Geometric mean
(ref)
1.07x faster
Benchmark hidden because not significant (2): regex_dna, regex_v8
Benchmarks with tag 'serialize':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
xml_etree_iterparse
177 ms
145 ms: 1.22x faster
xml_etree_parse
231 ms
200 ms: 1.16x faster
tomli_loads
2.78 sec
2.53 sec: 1.10x faster
unpickle_pure_python
290 us
275 us: 1.06x faster
xml_etree_process
85.9 ms
81.4 ms: 1.06x faster
xml_etree_generate
122 ms
118 ms: 1.04x faster
json_dumps
14.1 ms
15.5 ms: 1.10x slower
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (2): pickle_pure_python, json_loads
Benchmarks with tag 'startup':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
python_startup_no_site
15.3 ms
14.9 ms: 1.03x faster
python_startup
22.4 ms
26.2 ms: 1.17x slower
Geometric mean
(ref)
1.07x slower
Benchmarks with tag 'template':
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
genshi_xml
72.1 ms
65.0 ms: 1.11x faster
genshi_text
31.7 ms
30.1 ms: 1.05x faster
mako
15.9 ms
17.5 ms: 1.09x slower
Geometric mean
(ref)
1.02x faster
Benchmark hidden because not significant (1): django_template
Benchmark
bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006
bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca
async_tree_io_tg
1.40 sec
877 ms: 1.60x faster
async_tree_io
1.39 sec
895 ms: 1.55x faster
deepcopy
498 us
340 us: 1.46x faster
async_tree_none
572 ms
391 ms: 1.46x faster
async_tree_memoization_tg
670 ms
467 ms: 1.43x faster
async_tree_memoization
709 ms
502 ms: 1.41x faster
async_tree_none_tg
504 ms
367 ms: 1.37x faster
async_tree_cpu_io_mixed
889 ms
666 ms: 1.33x faster
async_tree_cpu_io_mixed_tg
852 ms
669 ms: 1.27x faster
deepcopy_memo
50.1 us
39.7 us: 1.26x faster
xml_etree_iterparse
177 ms
145 ms: 1.22x faster
deepcopy_reduce
4.10 us
3.36 us: 1.22x faster
telco
12.2 ms
10.1 ms: 1.21x faster
pylint
470 ms
389 ms: 1.21x faster
go
191 ms
161 ms: 1.19x faster
regex_effbot
4.74 ms
4.00 ms: 1.18x faster
spectral_norm
157 ms
132 ms: 1.18x faster
richards_super
73.2 ms
62.8 ms: 1.17x faster
xml_etree_parse
231 ms
200 ms: 1.16x faster
richards
65.5 ms
56.7 ms: 1.16x faster
thrift
1.10 ms
974 us: 1.13x faster
sympy_integrate
30.2 ms
27.0 ms: 1.12x faster
scimark_sor
179 ms
161 ms: 1.11x faster
html5lib
92.6 ms
83.4 ms: 1.11x faster
genshi_xml
72.1 ms
65.0 ms: 1.11x faster
pathlib
29.9 ms
27.0 ms: 1.11x faster
docutils
4.01 sec
3.65 sec: 1.10x faster
tomli_loads
2.78 sec
2.53 sec: 1.10x faster
scimark_monte_carlo
90.6 ms
83.4 ms: 1.09x faster
sqlglot_optimize
74.7 ms
69.2 ms: 1.08x faster
logging_simple
8.56 us
7.97 us: 1.07x faster
sqlglot_normalize
140 ms
130 ms: 1.07x faster
pidigits
251 ms
234 ms: 1.07x faster
float
116 ms
108 ms: 1.07x faster
sqlite_synth
3.99 us
3.72 us: 1.07x faster
sympy_sum
210 ms
197 ms: 1.07x faster
regex_compile
182 ms
171 ms: 1.07x faster
bpe_tokeniser
6.28 sec
5.89 sec: 1.07x faster
scimark_fft
473 ms
444 ms: 1.07x faster
nqueens
112 ms
105 ms: 1.06x faster
scimark_sparse_mat_mult
6.76 ms
6.36 ms: 1.06x faster
fannkuch
547 ms
515 ms: 1.06x faster
sqlglot_parse
1.76 ms
1.65 ms: 1.06x faster
sympy_str
379 ms
358 ms: 1.06x faster
chaos
83.6 ms
79.0 ms: 1.06x faster
unpickle_pure_python
290 us
275 us: 1.06x faster
crypto_pyaes
100 ms
94.9 ms: 1.06x faster
xml_etree_process
85.9 ms
81.4 ms: 1.06x faster
deltablue
4.44 ms
4.21 ms: 1.06x faster
mdp
3.80 sec
3.60 sec: 1.05x faster
genshi_text
31.7 ms
30.1 ms: 1.05x faster
asyncio_websockets
766 ms
731 ms: 1.05x faster
async_generators
567 ms
542 ms: 1.05x faster
xml_etree_generate
122 ms
118 ms: 1.04x faster
json
6.51 ms
6.28 ms: 1.04x faster
pprint_pformat
1.94 sec
1.87 sec: 1.04x faster
pprint_safe_repr
987 ms
954 ms: 1.03x faster
generators
40.0 ms
38.8 ms: 1.03x faster
python_startup_no_site
15.3 ms
14.9 ms: 1.03x faster
nbody
119 ms
124 ms: 1.04x slower
logging_silent
130 ns
140 ns: 1.07x slower
bench_thread_pool
2.89 ms
3.12 ms: 1.08x slower
mako
15.9 ms
17.5 ms: 1.09x slower
json_dumps
14.1 ms
15.5 ms: 1.10x slower
python_startup
22.4 ms
26.2 ms: 1.17x slower
gc_traversal
5.70 ms
7.60 ms: 1.33x slower
create_gc_cycles
2.41 ms
3.67 ms: 1.52x slower
bench_mp_pool
18.7 ms
94.2 ms: 5.04x slower
Geometric mean
(ref)
1.06x faster
Benchmark hidden because not significant (20): logging_format, coroutines, typing_runtime_protocols, 2to3, pickle_pure_python, json_loads, regex_dna, coverage, dulwich_log, comprehensions, sympy_expand, django_template, raytrace, meteor_contest, regex_v8, pycparser, pyflate, hexiom, scimark_lu, sqlglot_transpile
Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (8) of results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-linux-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
Geometric mean (including insignificant results): 1.082x faster
Reliability score: 100.00% likely to be faster
90% likely to have a speedup of 1.04x
95% likely to have a speedup of 1.04x
99% likely to have a speedup of 1.04x