- fork: python
- ref: ef63cca494571f50906b
- machine: linux-x86_64
- commit hash: ef63cca
- commit date: 2024-12-29
- overall geometric mean: 1.238x slower
- HPT reliability: 100.00%
- HPT 99th percentile: 1.24x slower
- Memory change: 1.19x
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| 2to3 | 254 ms | 352 ms: 1.39x slower |
| docutils | 2.54 sec | 3.01 sec: 1.18x slower |
| sphinx | 985 ms | 1.16 sec: 1.18x slower |
| Geometric mean | (ref) | 1.25x slower |
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| asyncio_websockets | 523 ms | 519 ms: 1.01x faster |
| coroutines | 21.7 ms | 24.7 ms: 1.14x slower |
| async_tree_cpu_io_mixed_tg | 481 ms | 569 ms: 1.18x slower |
| async_tree_cpu_io_mixed | 498 ms | 597 ms: 1.20x slower |
| async_tree_io_tg | 603 ms | 735 ms: 1.22x slower |
| async_tree_io | 620 ms | 765 ms: 1.23x slower |
| async_tree_none_tg | 253 ms | 318 ms: 1.26x slower |
| async_generators | 354 ms | 448 ms: 1.26x slower |
| async_tree_none | 275 ms | 353 ms: 1.28x slower |
| async_tree_memoization | 331 ms | 430 ms: 1.30x slower |
| async_tree_memoization_tg | 304 ms | 405 ms: 1.33x slower |
| Geometric mean | (ref) | 1.22x slower |
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| pidigits | 184 ms | 202 ms: 1.10x slower |
| nbody | 89.1 ms | 127 ms: 1.43x slower |
| float | 74.4 ms | 112 ms: 1.51x slower |
| Geometric mean | (ref) | 1.33x slower |
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| regex_v8 | 25.0 ms | 24.7 ms: 1.01x faster |
| regex_dna | 183 ms | 182 ms: 1.00x faster |
| regex_effbot | 2.83 ms | 2.91 ms: 1.03x slower |
| regex_compile | 125 ms | 168 ms: 1.34x slower |
| Geometric mean | (ref) | 1.08x slower |
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| xml_etree_iterparse | 89.8 ms | 89.3 ms: 1.01x faster |
| xml_etree_parse | 127 ms | 129 ms: 1.02x slower |
| json_loads | 26.0 us | 27.6 us: 1.06x slower |
| xml_etree_generate | 81.9 ms | 97.9 ms: 1.20x slower |
| json_dumps | 11.2 ms | 14.1 ms: 1.25x slower |
| xml_etree_process | 57.3 ms | 74.3 ms: 1.30x slower |
| tomli_loads | 1.91 sec | 2.58 sec: 1.35x slower |
| unpickle_pure_python | 207 us | 330 us: 1.59x slower |
| pickle_pure_python | 308 us | 501 us: 1.62x slower |
| Geometric mean | (ref) | 1.25x slower |
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| python_startup | 14.6 ms | 15.7 ms: 1.07x slower |
| python_startup_no_site | 7.43 ms | 9.79 ms: 1.32x slower |
| Geometric mean | (ref) | 1.19x slower |
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| genshi_xml | 47.8 ms | 62.5 ms: 1.31x slower |
| django_template | 35.1 ms | 49.6 ms: 1.41x slower |
| genshi_text | 21.0 ms | 30.5 ms: 1.45x slower |
| mako | 11.7 ms | 17.2 ms: 1.48x slower |
| Geometric mean | (ref) | 1.41x slower |
| Benchmark | results/bm-20241229-3.14.0a3+-ef63cca/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json | results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json |
|---|---|---|
| gc_traversal | 4.27 ms | 3.28 ms: 1.30x faster |
| sqlite_synth | 2.19 us | 2.15 us: 1.02x faster |
| regex_v8 | 25.0 ms | 24.7 ms: 1.01x faster |
| create_gc_cycles | 1.83 ms | 1.80 ms: 1.01x faster |
| asyncio_websockets | 523 ms | 519 ms: 1.01x faster |
| xml_etree_iterparse | 89.8 ms | 89.3 ms: 1.01x faster |
| regex_dna | 183 ms | 182 ms: 1.00x faster |
| xml_etree_parse | 127 ms | 129 ms: 1.02x slower |
| regex_effbot | 2.83 ms | 2.91 ms: 1.03x slower |
| json | 4.77 ms | 4.96 ms: 1.04x slower |
| json_loads | 26.0 us | 27.6 us: 1.06x slower |
| pathlib | 18.0 ms | 19.3 ms: 1.07x slower |
| python_startup | 14.6 ms | 15.7 ms: 1.07x slower |
| pidigits | 184 ms | 202 ms: 1.10x slower |
| mdp | 2.46 sec | 2.75 sec: 1.12x slower |
| coroutines | 21.7 ms | 24.7 ms: 1.14x slower |
| bench_mp_pool | 88.3 ms | 101 ms: 1.14x slower |
| k_core | 2.05 sec | 2.35 sec: 1.14x slower |
| sphinx | 985 ms | 1.16 sec: 1.18x slower |
| spectral_norm | 97.4 ms | 115 ms: 1.18x slower |
| bpe_tokeniser | 4.25 sec | 5.01 sec: 1.18x slower |
| async_tree_cpu_io_mixed_tg | 481 ms | 569 ms: 1.18x slower |
| docutils | 2.54 sec | 3.01 sec: 1.18x slower |
| xml_etree_generate | 81.9 ms | 97.9 ms: 1.20x slower |
| async_tree_cpu_io_mixed | 498 ms | 597 ms: 1.20x slower |
| many_optionals | 1.03 ms | 1.24 ms: 1.21x slower |
| scimark_sparse_mat_mult | 4.47 ms | 5.40 ms: 1.21x slower |
| dulwich_log | 75.1 ms | 90.9 ms: 1.21x slower |
| scimark_fft | 313 ms | 379 ms: 1.21x slower |
| telco | 7.18 ms | 8.69 ms: 1.21x slower |
| async_tree_io_tg | 603 ms | 735 ms: 1.22x slower |
| async_tree_io | 620 ms | 765 ms: 1.23x slower |
| pycparser | 1.12 sec | 1.39 sec: 1.24x slower |
| pylint | 280 ms | 349 ms: 1.25x slower |
| json_dumps | 11.2 ms | 14.1 ms: 1.25x slower |
| nqueens | 77.8 ms | 97.3 ms: 1.25x slower |
| async_tree_none_tg | 253 ms | 318 ms: 1.26x slower |
| coverage | 78.4 ms | 98.8 ms: 1.26x slower |
| async_generators | 354 ms | 448 ms: 1.26x slower |
| sympy_expand | 456 ms | 579 ms: 1.27x slower |
| sympy_sum | 153 ms | 195 ms: 1.27x slower |
| shortest_path | 429 ms | 548 ms: 1.28x slower |
| connected_components | 390 ms | 498 ms: 1.28x slower |
| sympy_integrate | 19.8 ms | 25.3 ms: 1.28x slower |
| async_tree_none | 275 ms | 353 ms: 1.28x slower |
| sqlglot_optimize | 51.6 ms | 66.2 ms: 1.28x slower |
| xml_etree_process | 57.3 ms | 74.3 ms: 1.30x slower |
| async_tree_memoization | 331 ms | 430 ms: 1.30x slower |
| deepcopy | 251 us | 326 us: 1.30x slower |
| meteor_contest | 99.7 ms | 130 ms: 1.31x slower |
| genshi_xml | 47.8 ms | 62.5 ms: 1.31x slower |
| sympy_str | 272 ms | 356 ms: 1.31x slower |
| subparsers | 22.0 ms | 28.8 ms: 1.31x slower |
| sqlglot_normalize | 102 ms | 134 ms: 1.31x slower |
| python_startup_no_site | 7.43 ms | 9.79 ms: 1.32x slower |
| thrift | 741 us | 987 us: 1.33x slower |
| async_tree_memoization_tg | 304 ms | 405 ms: 1.33x slower |
| typing_runtime_protocols | 156 us | 208 us: 1.33x slower |
| regex_compile | 125 ms | 168 ms: 1.34x slower |
| tomli_loads | 1.91 sec | 2.58 sec: 1.35x slower |
| fannkuch | 366 ms | 499 ms: 1.36x slower |
| crypto_pyaes | 65.9 ms | 89.9 ms: 1.37x slower |
| deepcopy_reduce | 2.56 us | 3.50 us: 1.37x slower |
| deepcopy_memo | 29.2 us | 40.4 us: 1.38x slower |
| 2to3 | 254 ms | 352 ms: 1.39x slower |
| pprint_safe_repr | 689 ms | 965 ms: 1.40x slower |
| django_template | 35.1 ms | 49.6 ms: 1.41x slower |
| pprint_pformat | 1.41 sec | 2.00 sec: 1.42x slower |
| sqlalchemy_declarative | 128 ms | 182 ms: 1.42x slower |
| nbody | 89.1 ms | 127 ms: 1.43x slower |
| generators | 27.3 ms | 39.2 ms: 1.44x slower |
| sqlalchemy_imperative | 19.4 ms | 28.0 ms: 1.44x slower |
| genshi_text | 21.0 ms | 30.5 ms: 1.45x slower |
| scimark_lu | 108 ms | 157 ms: 1.45x slower |
| mako | 11.7 ms | 17.2 ms: 1.48x slower |
| float | 74.4 ms | 112 ms: 1.51x slower |
| logging_format | 6.65 us | 10.2 us: 1.53x slower |
| logging_simple | 5.87 us | 9.09 us: 1.55x slower |
| pyflate | 412 ms | 652 ms: 1.58x slower |
| unpickle_pure_python | 207 us | 330 us: 1.59x slower |
| comprehensions | 17.0 us | 27.1 us: 1.60x slower |
| richards_super | 47.0 ms | 75.2 ms: 1.60x slower |
| hexiom | 5.86 ms | 9.50 ms: 1.62x slower |
| pickle_pure_python | 308 us | 501 us: 1.62x slower |
| chaos | 57.9 ms | 94.5 ms: 1.63x slower |
| richards | 41.1 ms | 67.1 ms: 1.63x slower |
| scimark_monte_carlo | 62.1 ms | 106 ms: 1.71x slower |
| sqlglot_transpile | 1.55 ms | 2.74 ms: 1.77x slower |
| logging_silent | 99.9 ns | 185 ns: 1.85x slower |
| sqlglot_parse | 1.24 ms | 2.35 ms: 1.89x slower |
| raytrace | 255 ms | 489 ms: 1.92x slower |
| scimark_sor | 110 ms | 215 ms: 1.94x slower |
| go | 115 ms | 237 ms: 2.06x slower |
| deltablue | 3.09 ms | 7.45 ms: 2.41x slower |
| bench_thread_pool | 1.03 ms | 3.37 ms: 3.27x slower |
| Geometric mean | (ref) | 1.33x slower |
| Ignored benchmarks (1) of results/bm-20241229-3.14.0a3+-ef63cca-NOGIL/bm-20241229-vultr-x86_64-python-ef63cca494571f50906b-3.14.0a3+-ef63cca.json: html5lib |
- Geometric mean (including insignificant results): 1.238x slower
- Reliability score: 100.00% likely to be slow
- 90% likely to have a slowdown of 1.25x
- 95% likely to have a slowdown of 1.25x
- 99% likely to have a slowdown of 1.24x
- memory change: 1.19x