From 0d2f696cfa8a1cf948659d77d703d735191d010d Mon Sep 17 00:00:00 2001 From: mpage Date: Mon, 16 Dec 2024 07:23:04 +0000 Subject: [PATCH] Benchmarking results for @mpage --- README.md | 3 + RESULTS.md | 3 + configs.json | 4 +- configs.svg | 346 +- longitudinal.json | 3 +- longitudinal.svg | 3 +- memory_configs.json | 4 +- memory_configs.svg | 304 +- memory_long.json | 3 +- memory_long.svg | 3 +- .../README.md | 77 + ...7cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md | 204 + ...cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg | 3063 +++++++++++++++ ...f3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md | 201 + ...3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg | 3038 +++++++++++++++ ...f3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg | 3212 ++++++++++++++++ ...307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md | 212 ++ ...07cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg | 3283 +++++++++++++++++ ...7cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md | 208 ++ ...cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg | 3050 +++++++++++++++ ...f3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md | 204 + ...3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg | 2965 +++++++++++++++ ...f3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg | 3152 ++++++++++++++++ ...307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md | 213 ++ ...07cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg | 3201 ++++++++++++++++ .../bm-20241215-3.14.0a2+-47c5a0f/README.md | 25 + ...7cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md | 194 + ...cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg | 3148 ++++++++++++++++ ...f3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md | 186 + ...3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg | 3123 ++++++++++++++++ 30 files changed, 33306 insertions(+), 329 deletions(-) create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/README.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md create mode 100644 results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg diff --git a/README.md b/README.md index e7f09fc6..7dcce300 100644 --- a/README.md +++ b/README.md @@ -12,6 +12,8 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f) | python/47c5a0f307cff3ed4775 | 47c5a0f | 1.125x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.080x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | | +| [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL) | python/47c5a0f307cff3ed4775 | 47c5a0f (NOGIL) | 1.150x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.180x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | 1.238x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base-mem.svg) | | [2024-12-15](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL) | mpage/gh_115999_for_iter_i | 3c144b3 (NOGIL) | 1.036x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.svg) | 1.070x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.svg) | 1.132x ↑
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base-mem.svg) | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac) | python/0ac40acec045c4ce780c | 0ac40ac | 1.128x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.084x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL) | python/0ac40acec045c4ce780c | 0ac40ac (NOGIL) | 1.156x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.185x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | 1.246x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.svg)[🧠](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base-mem.svg) | @@ -26,6 +28,7 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | | [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f) | python/47c5a0f307cff3ed4775 | 47c5a0f | 1.087x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.048x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | | +| [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL) | python/47c5a0f307cff3ed4775 | 47c5a0f (NOGIL) | 1.215x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.240x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | 1.271x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base-mem.svg) | | [2024-12-15](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL) | mpage/gh_115999_for_iter_i | 3c144b3 (NOGIL) | 1.080x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.svg) | 1.109x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.svg) | 1.164x ↑
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base-mem.svg) | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac) | python/0ac40acec045c4ce780c | 0ac40ac | 1.084x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.045x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL) | python/0ac40acec045c4ce780c | 0ac40ac (NOGIL) | 1.211x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.237x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | 1.265x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.svg)[🧠](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base-mem.svg) | diff --git a/RESULTS.md b/RESULTS.md index 30e6d3ec..521fb4c1 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -6,6 +6,8 @@ ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f) | python/47c5a0f307cff3ed4775 | 47c5a0f | 1.125x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.080x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | | +| [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL) | python/47c5a0f307cff3ed4775 | 47c5a0f (NOGIL) | 1.150x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.180x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | 1.238x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base-mem.svg) | | [2024-12-15](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL) | mpage/gh_115999_for_iter_i | 3c144b3 (NOGIL) | 1.036x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.svg) | 1.070x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.svg) | 1.132x ↑
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-linux-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base-mem.svg) | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac) | python/0ac40acec045c4ce780c | 0ac40ac | 1.128x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.084x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL) | python/0ac40acec045c4ce780c | 0ac40ac (NOGIL) | 1.156x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.185x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | 1.246x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.svg)[🧠](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base-mem.svg) | @@ -196,6 +198,7 @@ | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | | [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f) | python/47c5a0f307cff3ed4775 | 47c5a0f | 1.087x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.048x ↑
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | | +| [2024-12-15](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL) | python/47c5a0f307cff3ed4775 | 47c5a0f (NOGIL) | 1.215x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) | 1.240x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) | 1.271x ↓
[📄](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base-mem.svg) | | [2024-12-15](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL) | mpage/gh_115999_for_iter_i | 3c144b3 (NOGIL) | 1.080x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.12.6.svg) | 1.109x ↓
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-3.13.0rc2.svg) | 1.164x ↑
[📄](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.md)[📈](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base.svg)[🧠](results/bm-20241215-3.14.0a2%2B-3c144b3-NOGIL/bm-20241215-vultr-x86_64-mpage-gh_115999_for_iter_i-3.14.0a2%2B-3c144b3-vs-base-mem.svg) | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac) | python/0ac40acec045c4ce780c | 0ac40ac | 1.084x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.045x ↑
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | | | [2024-12-14](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL) | python/0ac40acec045c4ce780c | 0ac40ac (NOGIL) | 1.211x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.12.6.svg) | 1.237x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-3.13.0rc2.svg) | 1.265x ↓
[📄](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.md)[📈](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base.svg)[🧠](results/bm-20241214-3.14.0a2%2B-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2%2B-0ac40ac-vs-base-mem.svg) | diff --git a/configs.json b/configs.json index e7a1eadf..c5041917 100644 --- a/configs.json +++ b/configs.json @@ -136,5 +136,7 @@ "bm-20241213-3.14.0a2+-2de048c/bm-20241213-linux-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json,bm-20241213-3.14.0a2+-2de048c-NOGIL/bm-20241213-linux-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json": 0.7427613051242764, "bm-20241213-3.14.0a2+-2de048c/bm-20241213-vultr-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json,bm-20241213-3.14.0a2+-2de048c-NOGIL/bm-20241213-vultr-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json": 0.7313478854071794, "bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,bm-20241214-3.14.0a2+-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json": 0.7542825772176688, - "bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,bm-20241214-3.14.0a2+-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json": 0.7348532599607164 + "bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,bm-20241214-3.14.0a2+-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json": 0.7348532599607164, + "bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json": 0.762344403638922, + "bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json": 0.7288464134495539 } \ No newline at end of file diff --git a/configs.svg b/configs.svg index d5053583..82e57d4f 100644 --- a/configs.svg +++ b/configs.svg @@ -8,10 +8,10 @@ - + - - + + @@ -27,9 +27,9 @@ - - - + + + @@ -41,9 +41,9 @@ - - - + + + @@ -55,9 +55,9 @@ - - - + + + @@ -66,9 +66,9 @@ - - - + + + @@ -79,9 +79,9 @@ - + - + @@ -95,7 +95,7 @@ - + @@ -107,7 +107,7 @@ - + @@ -116,7 +116,7 @@ - + @@ -125,7 +125,7 @@ - + @@ -133,153 +133,155 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + @@ -421,49 +423,49 @@ - + - + - + - + - + - + - + @@ -472,7 +474,7 @@ - + @@ -481,7 +483,7 @@ - + @@ -490,7 +492,7 @@ - + @@ -499,7 +501,7 @@ - + @@ -508,7 +510,7 @@ - + diff --git a/longitudinal.json b/longitudinal.json index 792ce0a4..aa577ea2 100644 --- a/longitudinal.json +++ b/longitudinal.json @@ -175,5 +175,6 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241213-3.14.0a2+-2de048c/bm-20241213-vultr-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json,3.13.0rc2": 1.043286929940174, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,3.13.0rc2": 1.0838663302819633, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,3.13.0rc2": 1.0434799307946538, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,3.13.0rc2": 1.0469723365172854 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,3.13.0rc2": 1.0469723365172854, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,3.13.0rc2": 1.0804048795871652 } \ No newline at end of file diff --git a/longitudinal.svg b/longitudinal.svg index a4f90359..23ba7723 100644 --- a/longitudinal.svg +++ b/longitudinal.svg @@ -523,7 +523,7 @@ - + @@ -591,6 +591,7 @@ + diff --git a/memory_configs.json b/memory_configs.json index d4807be6..34fc6731 100644 --- a/memory_configs.json +++ b/memory_configs.json @@ -136,5 +136,7 @@ "bm-20241213-3.14.0a2+-2de048c/bm-20241213-linux-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json,bm-20241213-3.14.0a2+-2de048c-NOGIL/bm-20241213-linux-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json": 1.18, "bm-20241213-3.14.0a2+-2de048c/bm-20241213-vultr-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json,bm-20241213-3.14.0a2+-2de048c-NOGIL/bm-20241213-vultr-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json": 1.19, "bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,bm-20241214-3.14.0a2+-0ac40ac-NOGIL/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json": 1.18, - "bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,bm-20241214-3.14.0a2+-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json": 1.19 + "bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,bm-20241214-3.14.0a2+-0ac40ac-NOGIL/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json": 1.19, + "bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json": 1.18, + "bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json": 1.19 } \ No newline at end of file diff --git a/memory_configs.svg b/memory_configs.svg index 834c7dfb..f2cdd479 100644 --- a/memory_configs.svg +++ b/memory_configs.svg @@ -10,8 +10,8 @@ - - + + @@ -27,9 +27,9 @@ - - - + + + @@ -41,9 +41,9 @@ - - - + + + @@ -55,9 +55,9 @@ - - - + + + @@ -66,9 +66,9 @@ - - - + + + @@ -171,152 +171,154 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/memory_long.json b/memory_long.json index 6a35dd5a..3d3dd31b 100644 --- a/memory_long.json +++ b/memory_long.json @@ -175,5 +175,6 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241213-3.14.0a2+-2de048c/bm-20241213-vultr-x86_64-python-2de048ce79e621f5ae05-3.14.0a2+-2de048c.json,3.13.0rc2": 1.09, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-linux-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,3.13.0rc2": 1.12, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241214-3.14.0a2+-0ac40ac/bm-20241214-vultr-x86_64-python-0ac40acec045c4ce780c-3.14.0a2+-0ac40ac.json,3.13.0rc2": 1.09, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,3.13.0rc2": 1.09 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,3.13.0rc2": 1.09, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json,3.13.0rc2": 1.12 } \ No newline at end of file diff --git a/memory_long.svg b/memory_long.svg index bf7a7d22..544026f1 100644 --- a/memory_long.svg +++ b/memory_long.svg @@ -517,7 +517,7 @@ - + @@ -584,6 +584,7 @@ + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/README.md b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/README.md new file mode 100644 index 00000000..de99229b --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/README.md @@ -0,0 +1,77 @@ +# Results + +- fork: python/47c5a0f307cff3ed4775 +- version: 3.14.0a2+ +- config: NOGIL +- commit hash: [47c5a0f](https://github.com/python/cpython/commit/47c5a0f) +- commit date: 2024-12-15T23:17:01+00:00 +- commit merge base: [b74c8f58e875d909ce6b5b9dbcddd6d8331d2081](https://github.com/python/cpython/commit/b74c8f58e875d909ce6b5b9dbcddd6d8331d2081) +- ref: 47c5a0f307cff3ed4775 + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12343624912) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f.json) + +### vs. 3.12.6 + +- Geometric mean: 1.150x slower (HPT: reliability of 100.00%, 1.11x slower at 99th %ile) +- Memory usage: 1.34x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md) +- [📈time plot](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.180x slower (HPT: reliability of 100.00%, 1.14x slower at 99th %ile) +- Memory usage: 1.33x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md) +- [📈time plot](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.238x slower (HPT: reliability of 100.00%, 1.23x slower at 99th %ile) +- Memory usage: 1.18x +- [🧠memory plot](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base-mem.svg) +- [📄table](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.md) +- [📈time plot](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12343624912) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f.json) + +### vs. 3.12.6 + +- Geometric mean: 1.215x slower (HPT: reliability of 100.00%, 1.17x slower at 99th %ile) +- Memory usage: 1.33x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md) +- [📈time plot](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.240x slower (HPT: reliability of 100.00%, 1.18x slower at 99th %ile) +- Memory usage: 1.32x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md) +- [📈time plot](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.271x slower (HPT: reliability of 100.00%, 1.27x slower at 99th %ile) +- Memory usage: 1.19x +- new benchmarks: html5lib +- [🧠memory plot](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base-mem.svg) +- [📄table](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.md) +- [📈time plot](bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-base.svg) + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md new file mode 100644 index 00000000..ba8c73a7 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md @@ -0,0 +1,204 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.150x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.11x slower +- Memory change: 1.34x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 594 ms: 1.30x slower | +| docutils | 4.00 sec | 4.46 sec: 1.12x slower | +| html5lib | 88.9 ms | 127 ms: 1.42x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 1.01 sec: 1.92x faster | +| async_tree_io | 1.85 sec | 1.06 sec: 1.74x faster | +| async_tree_memoization_tg | 930 ms | 610 ms: 1.52x faster | +| async_tree_none_tg | 704 ms | 464 ms: 1.52x faster | +| async_tree_memoization | 977 ms | 656 ms: 1.49x faster | +| async_tree_none | 741 ms | 509 ms: 1.46x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 777 ms: 1.42x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 877 ms: 1.23x faster | +| async_generators | 589 ms | 659 ms: 1.12x slower | +| coroutines | 29.5 ms | 33.3 ms: 1.13x slower | +| Geometric mean | (ref) | 1.33x faster | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 250 ms | 225 ms: 1.11x faster | +| nbody | 119 ms | 160 ms: 1.34x slower | +| float | 123 ms | 169 ms: 1.37x slower | +| Geometric mean | (ref) | 1.18x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.50 ms: 1.14x faster | +| regex_dna | 278 ms | 303 ms: 1.09x slower | +| regex_compile | 187 ms | 214 ms: 1.15x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (1): regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 169 ms | 134 ms: 1.26x faster | +| xml_etree_parse | 241 ms | 211 ms: 1.14x faster | +| xml_etree_generate | 127 ms | 137 ms: 1.08x slower | +| tomli_loads | 2.88 sec | 3.37 sec: 1.17x slower | +| xml_etree_process | 83.7 ms | 99.3 ms: 1.19x slower | +| json_dumps | 14.3 ms | 17.6 ms: 1.23x slower | +| unpickle_pure_python | 300 us | 416 us: 1.39x slower | +| pickle_pure_python | 436 us | 650 us: 1.49x slower | +| Geometric mean | (ref) | 1.11x slower | + +Benchmark hidden because not significant (1): json_loads + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 19.8 ms: 1.12x slower | +| python_startup | 23.7 ms | 32.5 ms: 1.37x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 67.6 ms | 86.6 ms: 1.28x slower | +| genshi_text | 30.2 ms | 41.0 ms: 1.36x slower | +| django_template | 44.9 ms | 61.8 ms: 1.38x slower | +| mako | 15.7 ms | 26.1 ms: 1.66x slower | +| Geometric mean | (ref) | 1.41x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 1.01 sec: 1.92x faster | +| async_tree_io | 1.85 sec | 1.06 sec: 1.74x faster | +| async_tree_memoization_tg | 930 ms | 610 ms: 1.52x faster | +| async_tree_none_tg | 704 ms | 464 ms: 1.52x faster | +| async_tree_memoization | 977 ms | 656 ms: 1.49x faster | +| async_tree_none | 741 ms | 509 ms: 1.46x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 777 ms: 1.42x faster | +| xml_etree_iterparse | 169 ms | 134 ms: 1.26x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 877 ms: 1.23x faster | +| xml_etree_parse | 241 ms | 211 ms: 1.14x faster | +| regex_effbot | 5.13 ms | 4.50 ms: 1.14x faster | +| deepcopy | 468 us | 417 us: 1.12x faster | +| pidigits | 250 ms | 225 ms: 1.11x faster | +| pathlib | 31.6 ms | 30.0 ms: 1.05x faster | +| sqlite_synth | 3.87 us | 3.71 us: 1.04x faster | +| json | 6.85 ms | 6.56 ms: 1.04x faster | +| pycparser | 1.79 sec | 1.90 sec: 1.06x slower | +| deepcopy_reduce | 4.04 us | 4.34 us: 1.08x slower | +| xml_etree_generate | 127 ms | 137 ms: 1.08x slower | +| nqueens | 117 ms | 127 ms: 1.08x slower | +| regex_dna | 278 ms | 303 ms: 1.09x slower | +| pylint | 465 ms | 517 ms: 1.11x slower | +| gc_traversal | 5.86 ms | 6.52 ms: 1.11x slower | +| docutils | 4.00 sec | 4.46 sec: 1.12x slower | +| async_generators | 589 ms | 659 ms: 1.12x slower | +| crypto_pyaes | 107 ms | 120 ms: 1.12x slower | +| python_startup_no_site | 17.6 ms | 19.8 ms: 1.12x slower | +| scimark_sparse_mat_mult | 6.70 ms | 7.55 ms: 1.13x slower | +| coroutines | 29.5 ms | 33.3 ms: 1.13x slower | +| dulwich_log | 100 ms | 114 ms: 1.13x slower | +| mdp | 3.97 sec | 4.51 sec: 1.13x slower | +| sqlglot_optimize | 76.0 ms | 87.1 ms: 1.15x slower | +| regex_compile | 187 ms | 214 ms: 1.15x slower | +| bpe_tokeniser | 6.59 sec | 7.62 sec: 1.16x slower | +| tomli_loads | 2.88 sec | 3.37 sec: 1.17x slower | +| comprehensions | 27.1 us | 31.7 us: 1.17x slower | +| typing_runtime_protocols | 224 us | 263 us: 1.17x slower | +| meteor_contest | 146 ms | 173 ms: 1.18x slower | +| xml_etree_process | 83.7 ms | 99.3 ms: 1.19x slower | +| fannkuch | 540 ms | 650 ms: 1.20x slower | +| generators | 41.1 ms | 50.6 ms: 1.23x slower | +| json_dumps | 14.3 ms | 17.6 ms: 1.23x slower | +| sqlalchemy_declarative | 218 ms | 269 ms: 1.24x slower | +| telco | 9.59 ms | 12.0 ms: 1.25x slower | +| pyflate | 727 ms | 920 ms: 1.27x slower | +| genshi_xml | 67.6 ms | 86.6 ms: 1.28x slower | +| logging_simple | 9.45 us | 12.1 us: 1.28x slower | +| 2to3 | 456 ms | 594 ms: 1.30x slower | +| pprint_safe_repr | 967 ms | 1.26 sec: 1.30x slower | +| pprint_pformat | 1.98 sec | 2.61 sec: 1.32x slower | +| sympy_integrate | 29.8 ms | 39.3 ms: 1.32x slower | +| logging_format | 9.59 us | 12.9 us: 1.34x slower | +| nbody | 119 ms | 160 ms: 1.34x slower | +| genshi_text | 30.2 ms | 41.0 ms: 1.36x slower | +| python_startup | 23.7 ms | 32.5 ms: 1.37x slower | +| float | 123 ms | 169 ms: 1.37x slower | +| coverage | 95.4 ms | 131 ms: 1.37x slower | +| django_template | 44.9 ms | 61.8 ms: 1.38x slower | +| thrift | 1.06 ms | 1.46 ms: 1.38x slower | +| unpickle_pure_python | 300 us | 416 us: 1.39x slower | +| richards_super | 72.8 ms | 102 ms: 1.40x slower | +| html5lib | 88.9 ms | 127 ms: 1.42x slower | +| scimark_lu | 152 ms | 218 ms: 1.44x slower | +| scimark_monte_carlo | 96.4 ms | 143 ms: 1.49x slower | +| pickle_pure_python | 436 us | 650 us: 1.49x slower | +| sqlalchemy_imperative | 24.7 ms | 37.2 ms: 1.51x slower | +| chaos | 84.9 ms | 129 ms: 1.52x slower | +| sympy_str | 385 ms | 586 ms: 1.52x slower | +| hexiom | 8.27 ms | 12.7 ms: 1.53x slower | +| logging_silent | 139 ns | 216 ns: 1.55x slower | +| raytrace | 408 ms | 643 ms: 1.58x slower | +| richards | 60.3 ms | 95.5 ms: 1.58x slower | +| sqlglot_transpile | 2.34 ms | 3.74 ms: 1.60x slower | +| mako | 15.7 ms | 26.1 ms: 1.66x slower | +| scimark_sor | 167 ms | 291 ms: 1.75x slower | +| create_gc_cycles | 1.94 ms | 3.40 ms: 1.76x slower | +| go | 172 ms | 314 ms: 1.82x slower | +| sqlglot_parse | 1.79 ms | 3.29 ms: 1.84x slower | +| sympy_sum | 222 ms | 423 ms: 1.91x slower | +| sympy_expand | 582 ms | 1.12 sec: 1.93x slower | +| deltablue | 4.27 ms | 10.9 ms: 2.55x slower | +| bench_mp_pool | 20.7 ms | 93.3 ms: 4.51x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmark hidden because not significant (8): spectral_norm, deepcopy_memo, json_loads, asyncio_websockets, bench_thread_pool, scimark_fft, regex_v8, sqlglot_normalize +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.150x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.13x +- 95% likely to have a slowdown of 1.12x +- 99% likely to have a slowdown of 1.11x + +# Memory +- memory change: 1.34x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg new file mode 100644 index 00000000..c8c2aa4b --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg @@ -0,0 +1,3063 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md new file mode 100644 index 00000000..0a2c4070 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md @@ -0,0 +1,201 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.180x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.14x slower +- Memory change: 1.33x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 594 ms: 1.34x slower | +| docutils | 4.01 sec | 4.46 sec: 1.11x slower | +| html5lib | 92.6 ms | 127 ms: 1.37x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 1.01 sec: 1.39x faster | +| async_tree_io | 1.39 sec | 1.06 sec: 1.30x faster | +| async_tree_none | 572 ms | 509 ms: 1.12x faster | +| async_tree_memoization_tg | 670 ms | 610 ms: 1.10x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 777 ms: 1.10x faster | +| async_tree_none_tg | 504 ms | 464 ms: 1.08x faster | +| async_tree_memoization | 709 ms | 656 ms: 1.08x faster | +| coroutines | 30.9 ms | 33.3 ms: 1.08x slower | +| async_generators | 567 ms | 659 ms: 1.16x slower | +| Geometric mean | (ref) | 1.08x faster | + +Benchmark hidden because not significant (2): asyncio_websockets, async_tree_cpu_io_mixed + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 251 ms | 225 ms: 1.11x faster | +| nbody | 119 ms | 160 ms: 1.35x slower | +| float | 116 ms | 169 ms: 1.46x slower | +| Geometric mean | (ref) | 1.21x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 4.74 ms | 4.50 ms: 1.05x faster | +| regex_dna | 282 ms | 303 ms: 1.08x slower | +| regex_compile | 182 ms | 214 ms: 1.18x slower | +| Geometric mean | (ref) | 1.05x slower | + +Benchmark hidden because not significant (1): regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 177 ms | 134 ms: 1.32x faster | +| xml_etree_parse | 231 ms | 211 ms: 1.10x faster | +| json_loads | 34.3 us | 37.7 us: 1.10x slower | +| xml_etree_generate | 122 ms | 137 ms: 1.12x slower | +| xml_etree_process | 85.9 ms | 99.3 ms: 1.16x slower | +| tomli_loads | 2.78 sec | 3.37 sec: 1.21x slower | +| json_dumps | 14.1 ms | 17.6 ms: 1.25x slower | +| unpickle_pure_python | 290 us | 416 us: 1.43x slower | +| pickle_pure_python | 416 us | 650 us: 1.56x slower | +| Geometric mean | (ref) | 1.14x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 19.8 ms: 1.29x slower | +| python_startup | 22.4 ms | 32.5 ms: 1.45x slower | +| Geometric mean | (ref) | 1.37x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 72.1 ms | 86.6 ms: 1.20x slower | +| genshi_text | 31.7 ms | 41.0 ms: 1.29x slower | +| django_template | 44.3 ms | 61.8 ms: 1.40x slower | +| mako | 15.9 ms | 26.1 ms: 1.63x slower | +| Geometric mean | (ref) | 1.37x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 1.01 sec: 1.39x faster | +| xml_etree_iterparse | 177 ms | 134 ms: 1.32x faster | +| async_tree_io | 1.39 sec | 1.06 sec: 1.30x faster | +| deepcopy | 498 us | 417 us: 1.19x faster | +| async_tree_none | 572 ms | 509 ms: 1.12x faster | +| pidigits | 251 ms | 225 ms: 1.11x faster | +| async_tree_memoization_tg | 670 ms | 610 ms: 1.10x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 777 ms: 1.10x faster | +| xml_etree_parse | 231 ms | 211 ms: 1.10x faster | +| async_tree_none_tg | 504 ms | 464 ms: 1.08x faster | +| async_tree_memoization | 709 ms | 656 ms: 1.08x faster | +| sqlite_synth | 3.99 us | 3.71 us: 1.07x faster | +| regex_effbot | 4.74 ms | 4.50 ms: 1.05x faster | +| spectral_norm | 157 ms | 150 ms: 1.05x faster | +| deepcopy_reduce | 4.10 us | 4.34 us: 1.06x slower | +| regex_dna | 282 ms | 303 ms: 1.08x slower | +| coroutines | 30.9 ms | 33.3 ms: 1.08x slower | +| scimark_fft | 473 ms | 512 ms: 1.08x slower | +| pylint | 470 ms | 517 ms: 1.10x slower | +| json_loads | 34.3 us | 37.7 us: 1.10x slower | +| docutils | 4.01 sec | 4.46 sec: 1.11x slower | +| scimark_sparse_mat_mult | 6.76 ms | 7.55 ms: 1.12x slower | +| xml_etree_generate | 122 ms | 137 ms: 1.12x slower | +| nqueens | 112 ms | 127 ms: 1.13x slower | +| gc_traversal | 5.70 ms | 6.52 ms: 1.14x slower | +| meteor_contest | 150 ms | 173 ms: 1.15x slower | +| xml_etree_process | 85.9 ms | 99.3 ms: 1.16x slower | +| async_generators | 567 ms | 659 ms: 1.16x slower | +| sqlglot_optimize | 74.7 ms | 87.1 ms: 1.17x slower | +| typing_runtime_protocols | 226 us | 263 us: 1.17x slower | +| regex_compile | 182 ms | 214 ms: 1.18x slower | +| sqlglot_normalize | 140 ms | 165 ms: 1.18x slower | +| mdp | 3.80 sec | 4.51 sec: 1.19x slower | +| fannkuch | 547 ms | 650 ms: 1.19x slower | +| crypto_pyaes | 100 ms | 120 ms: 1.20x slower | +| genshi_xml | 72.1 ms | 86.6 ms: 1.20x slower | +| pycparser | 1.57 sec | 1.90 sec: 1.21x slower | +| tomli_loads | 2.78 sec | 3.37 sec: 1.21x slower | +| dulwich_log | 93.7 ms | 114 ms: 1.21x slower | +| bpe_tokeniser | 6.28 sec | 7.62 sec: 1.21x slower | +| coverage | 107 ms | 131 ms: 1.22x slower | +| bench_thread_pool | 2.89 ms | 3.52 ms: 1.22x slower | +| json_dumps | 14.1 ms | 17.6 ms: 1.25x slower | +| generators | 40.0 ms | 50.6 ms: 1.26x slower | +| pprint_safe_repr | 987 ms | 1.26 sec: 1.28x slower | +| python_startup_no_site | 15.3 ms | 19.8 ms: 1.29x slower | +| genshi_text | 31.7 ms | 41.0 ms: 1.29x slower | +| sympy_integrate | 30.2 ms | 39.3 ms: 1.30x slower | +| thrift | 1.10 ms | 1.46 ms: 1.33x slower | +| 2to3 | 445 ms | 594 ms: 1.34x slower | +| pprint_pformat | 1.94 sec | 2.61 sec: 1.34x slower | +| nbody | 119 ms | 160 ms: 1.35x slower | +| html5lib | 92.6 ms | 127 ms: 1.37x slower | +| pyflate | 664 ms | 920 ms: 1.39x slower | +| logging_format | 9.24 us | 12.9 us: 1.39x slower | +| richards_super | 73.2 ms | 102 ms: 1.40x slower | +| django_template | 44.3 ms | 61.8 ms: 1.40x slower | +| create_gc_cycles | 2.41 ms | 3.40 ms: 1.41x slower | +| logging_simple | 8.56 us | 12.1 us: 1.42x slower | +| comprehensions | 22.2 us | 31.7 us: 1.42x slower | +| unpickle_pure_python | 290 us | 416 us: 1.43x slower | +| python_startup | 22.4 ms | 32.5 ms: 1.45x slower | +| float | 116 ms | 169 ms: 1.46x slower | +| richards | 65.5 ms | 95.5 ms: 1.46x slower | +| scimark_lu | 146 ms | 218 ms: 1.49x slower | +| chaos | 83.6 ms | 129 ms: 1.54x slower | +| sympy_str | 379 ms | 586 ms: 1.54x slower | +| pickle_pure_python | 416 us | 650 us: 1.56x slower | +| hexiom | 8.11 ms | 12.7 ms: 1.56x slower | +| scimark_monte_carlo | 90.6 ms | 143 ms: 1.58x slower | +| scimark_sor | 179 ms | 291 ms: 1.63x slower | +| mako | 15.9 ms | 26.1 ms: 1.63x slower | +| go | 191 ms | 314 ms: 1.64x slower | +| logging_silent | 130 ns | 216 ns: 1.66x slower | +| sqlglot_transpile | 2.20 ms | 3.74 ms: 1.70x slower | +| raytrace | 344 ms | 643 ms: 1.87x slower | +| sympy_expand | 601 ms | 1.12 sec: 1.87x slower | +| sqlglot_parse | 1.76 ms | 3.29 ms: 1.87x slower | +| sympy_sum | 210 ms | 423 ms: 2.01x slower | +| deltablue | 4.44 ms | 10.9 ms: 2.45x slower | +| bench_mp_pool | 18.7 ms | 93.3 ms: 4.99x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmark hidden because not significant (7): telco, asyncio_websockets, async_tree_cpu_io_mixed, pathlib, json, regex_v8, deepcopy_memo +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.180x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.17x +- 95% likely to have a slowdown of 1.16x +- 99% likely to have a slowdown of 1.14x + +# Memory +- memory change: 1.33x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg new file mode 100644 index 00000000..cdb209ea --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg @@ -0,0 +1,3038 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg new file mode 100644 index 00000000..64bb7cee --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg @@ -0,0 +1,3212 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md new file mode 100644 index 00000000..34527777 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md @@ -0,0 +1,212 @@ +# Results vs. base + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.238x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.23x slower +- Memory change: 1.18x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 415 ms | 594 ms: 1.43x slower | +| docutils | 3.61 sec | 4.46 sec: 1.24x slower | +| html5lib | 86.0 ms | 127 ms: 1.47x slower | +| sphinx | 1.40 sec | 1.67 sec: 1.20x slower | +| Geometric mean | (ref) | 1.33x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| asyncio_websockets | 715 ms | 754 ms: 1.06x slower | +| coroutines | 30.6 ms | 33.3 ms: 1.09x slower | +| async_tree_cpu_io_mixed_tg | 668 ms | 777 ms: 1.16x slower | +| async_tree_io_tg | 856 ms | 1.01 sec: 1.18x slower | +| async_generators | 549 ms | 659 ms: 1.20x slower | +| async_tree_io | 877 ms | 1.06 sec: 1.21x slower | +| async_tree_none_tg | 366 ms | 464 ms: 1.27x slower | +| async_tree_memoization | 501 ms | 656 ms: 1.31x slower | +| async_tree_cpu_io_mixed | 669 ms | 877 ms: 1.31x slower | +| async_tree_memoization_tg | 462 ms | 610 ms: 1.32x slower | +| async_tree_none | 385 ms | 509 ms: 1.32x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 239 ms | 225 ms: 1.06x faster | +| nbody | 124 ms | 160 ms: 1.29x slower | +| float | 111 ms | 169 ms: 1.52x slower | +| Geometric mean | (ref) | 1.23x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_v8 | 32.1 ms | 33.3 ms: 1.04x slower | +| regex_effbot | 4.30 ms | 4.50 ms: 1.05x slower | +| regex_dna | 259 ms | 303 ms: 1.17x slower | +| regex_compile | 162 ms | 214 ms: 1.33x slower | +| Geometric mean | (ref) | 1.14x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| xml_etree_iterparse | 151 ms | 134 ms: 1.12x faster | +| json_loads | 34.2 us | 37.7 us: 1.10x slower | +| xml_etree_generate | 121 ms | 137 ms: 1.13x slower | +| json_dumps | 15.5 ms | 17.6 ms: 1.14x slower | +| xml_etree_process | 84.0 ms | 99.3 ms: 1.18x slower | +| tomli_loads | 2.61 sec | 3.37 sec: 1.29x slower | +| unpickle_pure_python | 279 us | 416 us: 1.49x slower | +| pickle_pure_python | 414 us | 650 us: 1.57x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (1): xml_etree_parse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup | 25.1 ms | 32.5 ms: 1.29x slower | +| python_startup_no_site | 14.4 ms | 19.8 ms: 1.37x slower | +| Geometric mean | (ref) | 1.33x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_xml | 67.2 ms | 86.6 ms: 1.29x slower | +| django_template | 44.3 ms | 61.8 ms: 1.40x slower | +| genshi_text | 28.5 ms | 41.0 ms: 1.44x slower | +| mako | 16.7 ms | 26.1 ms: 1.56x slower | +| Geometric mean | (ref) | 1.42x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 8.13 ms | 6.52 ms: 1.25x faster | +| xml_etree_iterparse | 151 ms | 134 ms: 1.12x faster | +| pidigits | 239 ms | 225 ms: 1.06x faster | +| json | 6.36 ms | 6.56 ms: 1.03x slower | +| regex_v8 | 32.1 ms | 33.3 ms: 1.04x slower | +| regex_effbot | 4.30 ms | 4.50 ms: 1.05x slower | +| bench_mp_pool | 88.5 ms | 93.3 ms: 1.05x slower | +| asyncio_websockets | 715 ms | 754 ms: 1.06x slower | +| k_core | 4.00 sec | 4.32 sec: 1.08x slower | +| pathlib | 27.7 ms | 30.0 ms: 1.08x slower | +| coroutines | 30.6 ms | 33.3 ms: 1.09x slower | +| spectral_norm | 137 ms | 150 ms: 1.10x slower | +| json_loads | 34.2 us | 37.7 us: 1.10x slower | +| xml_etree_generate | 121 ms | 137 ms: 1.13x slower | +| connected_components | 815 ms | 926 ms: 1.14x slower | +| json_dumps | 15.5 ms | 17.6 ms: 1.14x slower | +| async_tree_cpu_io_mixed_tg | 668 ms | 777 ms: 1.16x slower | +| bench_thread_pool | 3.01 ms | 3.52 ms: 1.17x slower | +| dulwich_log | 97.0 ms | 114 ms: 1.17x slower | +| shortest_path | 890 ms | 1.04 sec: 1.17x slower | +| regex_dna | 259 ms | 303 ms: 1.17x slower | +| scimark_fft | 435 ms | 512 ms: 1.18x slower | +| async_tree_io_tg | 856 ms | 1.01 sec: 1.18x slower | +| xml_etree_process | 84.0 ms | 99.3 ms: 1.18x slower | +| telco | 10.0 ms | 12.0 ms: 1.19x slower | +| sphinx | 1.40 sec | 1.67 sec: 1.20x slower | +| typing_runtime_protocols | 220 us | 263 us: 1.20x slower | +| async_generators | 549 ms | 659 ms: 1.20x slower | +| scimark_sparse_mat_mult | 6.26 ms | 7.55 ms: 1.21x slower | +| meteor_contest | 143 ms | 173 ms: 1.21x slower | +| sqlglot_optimize | 71.9 ms | 87.1 ms: 1.21x slower | +| async_tree_io | 877 ms | 1.06 sec: 1.21x slower | +| many_optionals | 1.13 ms | 1.38 ms: 1.22x slower | +| deepcopy_reduce | 3.53 us | 4.34 us: 1.23x slower | +| sqlglot_normalize | 134 ms | 165 ms: 1.23x slower | +| docutils | 3.61 sec | 4.46 sec: 1.24x slower | +| coverage | 106 ms | 131 ms: 1.24x slower | +| pycparser | 1.53 sec | 1.90 sec: 1.24x slower | +| generators | 40.3 ms | 50.6 ms: 1.26x slower | +| nqueens | 100 ms | 127 ms: 1.26x slower | +| async_tree_none_tg | 366 ms | 464 ms: 1.27x slower | +| mdp | 3.52 sec | 4.51 sec: 1.28x slower | +| pylint | 402 ms | 517 ms: 1.29x slower | +| genshi_xml | 67.2 ms | 86.6 ms: 1.29x slower | +| tomli_loads | 2.61 sec | 3.37 sec: 1.29x slower | +| deepcopy | 323 us | 417 us: 1.29x slower | +| python_startup | 25.1 ms | 32.5 ms: 1.29x slower | +| crypto_pyaes | 92.9 ms | 120 ms: 1.29x slower | +| nbody | 124 ms | 160 ms: 1.29x slower | +| async_tree_memoization | 501 ms | 656 ms: 1.31x slower | +| async_tree_cpu_io_mixed | 669 ms | 877 ms: 1.31x slower | +| fannkuch | 493 ms | 650 ms: 1.32x slower | +| async_tree_memoization_tg | 462 ms | 610 ms: 1.32x slower | +| bpe_tokeniser | 5.76 sec | 7.62 sec: 1.32x slower | +| async_tree_none | 385 ms | 509 ms: 1.32x slower | +| regex_compile | 162 ms | 214 ms: 1.33x slower | +| pprint_pformat | 1.95 sec | 2.61 sec: 1.34x slower | +| pprint_safe_repr | 938 ms | 1.26 sec: 1.34x slower | +| deepcopy_memo | 37.5 us | 51.2 us: 1.36x slower | +| python_startup_no_site | 14.4 ms | 19.8 ms: 1.37x slower | +| subparsers | 29.9 ms | 41.2 ms: 1.38x slower | +| django_template | 44.3 ms | 61.8 ms: 1.40x slower | +| thrift | 1.05 ms | 1.46 ms: 1.40x slower | +| sympy_integrate | 27.8 ms | 39.3 ms: 1.42x slower | +| scimark_lu | 153 ms | 218 ms: 1.42x slower | +| pyflate | 643 ms | 920 ms: 1.43x slower | +| 2to3 | 415 ms | 594 ms: 1.43x slower | +| genshi_text | 28.5 ms | 41.0 ms: 1.44x slower | +| logging_format | 8.76 us | 12.9 us: 1.47x slower | +| html5lib | 86.0 ms | 127 ms: 1.47x slower | +| unpickle_pure_python | 279 us | 416 us: 1.49x slower | +| comprehensions | 21.2 us | 31.7 us: 1.49x slower | +| logging_silent | 143 ns | 216 ns: 1.51x slower | +| float | 111 ms | 169 ms: 1.52x slower | +| logging_simple | 7.97 us | 12.1 us: 1.52x slower | +| richards_super | 67.2 ms | 102 ms: 1.52x slower | +| richards | 62.6 ms | 95.5 ms: 1.53x slower | +| mako | 16.7 ms | 26.1 ms: 1.56x slower | +| pickle_pure_python | 414 us | 650 us: 1.57x slower | +| sqlalchemy_declarative | 170 ms | 269 ms: 1.58x slower | +| hexiom | 7.98 ms | 12.7 ms: 1.59x slower | +| sympy_str | 362 ms | 586 ms: 1.62x slower | +| chaos | 79.3 ms | 129 ms: 1.63x slower | +| scimark_monte_carlo | 87.2 ms | 143 ms: 1.64x slower | +| sqlalchemy_imperative | 21.4 ms | 37.2 ms: 1.74x slower | +| sqlglot_transpile | 2.08 ms | 3.74 ms: 1.80x slower | +| sqlglot_parse | 1.82 ms | 3.29 ms: 1.81x slower | +| scimark_sor | 157 ms | 291 ms: 1.85x slower | +| raytrace | 346 ms | 643 ms: 1.86x slower | +| sympy_expand | 581 ms | 1.12 sec: 1.93x slower | +| go | 156 ms | 314 ms: 2.02x slower | +| sympy_sum | 200 ms | 423 ms: 2.12x slower | +| deltablue | 4.35 ms | 10.9 ms: 2.50x slower | +| Geometric mean | (ref) | 1.32x slower | + +Benchmark hidden because not significant (3): create_gc_cycles, sqlite_synth, xml_etree_parse + +- Geometric mean (including insignificant results): 1.238x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.25x +- 95% likely to have a slowdown of 1.24x +- 99% likely to have a slowdown of 1.23x + +# Memory +- memory change: 1.18x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg new file mode 100644 index 00000000..b313bb1a --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg @@ -0,0 +1,3283 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md new file mode 100644 index 00000000..c02abcc7 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md @@ -0,0 +1,208 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.215x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.17x slower +- Memory change: 1.33x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 364 ms: 1.38x slower | +| docutils | 2.64 sec | 3.07 sec: 1.16x slower | +| html5lib | 63.6 ms | 96.2 ms: 1.51x slower | +| Geometric mean | (ref) | 1.34x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 790 ms: 1.41x faster | +| async_tree_io | 1.08 sec | 814 ms: 1.33x faster | +| async_tree_memoization_tg | 560 ms | 432 ms: 1.29x faster | +| async_tree_none_tg | 446 ms | 345 ms: 1.29x faster | +| async_tree_none | 464 ms | 375 ms: 1.24x faster | +| async_tree_memoization | 555 ms | 458 ms: 1.21x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 598 ms: 1.21x faster | +| async_tree_cpu_io_mixed | 715 ms | 619 ms: 1.15x faster | +| asyncio_websockets | 517 ms | 521 ms: 1.01x slower | +| coroutines | 23.9 ms | 24.7 ms: 1.03x slower | +| async_generators | 384 ms | 459 ms: 1.19x slower | +| Geometric mean | (ref) | 1.16x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 184 ms | 181 ms: 1.02x faster | +| nbody | 89.3 ms | 131 ms: 1.46x slower | +| float | 80.8 ms | 137 ms: 1.70x slower | +| Geometric mean | (ref) | 1.35x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 2.89 ms: 1.10x faster | +| regex_dna | 168 ms | 187 ms: 1.12x slower | +| regex_v8 | 20.6 ms | 25.1 ms: 1.22x slower | +| regex_compile | 142 ms | 176 ms: 1.24x slower | +| Geometric mean | (ref) | 1.11x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 96.7 ms | 90.5 ms: 1.07x faster | +| xml_etree_parse | 139 ms | 132 ms: 1.05x faster | +| json_loads | 26.5 us | 29.0 us: 1.09x slower | +| xml_etree_generate | 85.2 ms | 97.6 ms: 1.15x slower | +| tomli_loads | 2.11 sec | 2.54 sec: 1.21x slower | +| xml_etree_process | 59.0 ms | 79.1 ms: 1.34x slower | +| json_dumps | 10.4 ms | 14.0 ms: 1.35x slower | +| unpickle_pure_python | 221 us | 340 us: 1.54x slower | +| pickle_pure_python | 308 us | 505 us: 1.64x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 10.2 ms: 1.43x slower | +| python_startup | 9.93 ms | 17.2 ms: 1.73x slower | +| Geometric mean | (ref) | 1.58x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 50.2 ms | 63.6 ms: 1.27x slower | +| genshi_text | 22.8 ms | 30.4 ms: 1.33x slower | +| django_template | 34.7 ms | 50.2 ms: 1.45x slower | +| mako | 11.0 ms | 17.1 ms: 1.55x slower | +| Geometric mean | (ref) | 1.40x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 790 ms: 1.41x faster | +| async_tree_io | 1.08 sec | 814 ms: 1.33x faster | +| async_tree_memoization_tg | 560 ms | 432 ms: 1.29x faster | +| async_tree_none_tg | 446 ms | 345 ms: 1.29x faster | +| async_tree_none | 464 ms | 375 ms: 1.24x faster | +| async_tree_memoization | 555 ms | 458 ms: 1.21x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 598 ms: 1.21x faster | +| async_tree_cpu_io_mixed | 715 ms | 619 ms: 1.15x faster | +| deepcopy | 352 us | 319 us: 1.10x faster | +| regex_effbot | 3.17 ms | 2.89 ms: 1.10x faster | +| pathlib | 21.5 ms | 20.0 ms: 1.08x faster | +| xml_etree_iterparse | 96.7 ms | 90.5 ms: 1.07x faster | +| xml_etree_parse | 139 ms | 132 ms: 1.05x faster | +| pidigits | 184 ms | 181 ms: 1.02x faster | +| deepcopy_memo | 40.3 us | 40.5 us: 1.01x slower | +| asyncio_websockets | 517 ms | 521 ms: 1.01x slower | +| json | 5.02 ms | 5.09 ms: 1.01x slower | +| gc_traversal | 3.46 ms | 3.52 ms: 1.02x slower | +| spectral_norm | 110 ms | 113 ms: 1.02x slower | +| coroutines | 23.9 ms | 24.7 ms: 1.03x slower | +| bpe_tokeniser | 4.74 sec | 5.03 sec: 1.06x slower | +| json_loads | 26.5 us | 29.0 us: 1.09x slower | +| regex_dna | 168 ms | 187 ms: 1.12x slower | +| deepcopy_reduce | 3.08 us | 3.44 us: 1.12x slower | +| scimark_fft | 342 ms | 388 ms: 1.14x slower | +| xml_etree_generate | 85.2 ms | 97.6 ms: 1.15x slower | +| docutils | 2.64 sec | 3.07 sec: 1.16x slower | +| pylint | 319 ms | 371 ms: 1.16x slower | +| mdp | 2.42 sec | 2.84 sec: 1.17x slower | +| crypto_pyaes | 76.6 ms | 90.1 ms: 1.18x slower | +| generators | 32.2 ms | 38.2 ms: 1.18x slower | +| dulwich_log | 78.9 ms | 93.7 ms: 1.19x slower | +| async_generators | 384 ms | 459 ms: 1.19x slower | +| tomli_loads | 2.11 sec | 2.54 sec: 1.21x slower | +| regex_v8 | 20.6 ms | 25.1 ms: 1.22x slower | +| nqueens | 80.1 ms | 98.9 ms: 1.24x slower | +| regex_compile | 142 ms | 176 ms: 1.24x slower | +| sqlglot_optimize | 53.3 ms | 66.2 ms: 1.24x slower | +| meteor_contest | 104 ms | 129 ms: 1.25x slower | +| sqlglot_normalize | 107 ms | 133 ms: 1.25x slower | +| typing_runtime_protocols | 163 us | 205 us: 1.25x slower | +| genshi_xml | 50.2 ms | 63.6 ms: 1.27x slower | +| scimark_sparse_mat_mult | 4.39 ms | 5.63 ms: 1.28x slower | +| pprint_safe_repr | 743 ms | 966 ms: 1.30x slower | +| pycparser | 1.17 sec | 1.53 sec: 1.31x slower | +| sqlalchemy_imperative | 21.8 ms | 28.7 ms: 1.32x slower | +| telco | 6.53 ms | 8.60 ms: 1.32x slower | +| pprint_pformat | 1.52 sec | 2.01 sec: 1.32x slower | +| genshi_text | 22.8 ms | 30.4 ms: 1.33x slower | +| xml_etree_process | 59.0 ms | 79.1 ms: 1.34x slower | +| fannkuch | 372 ms | 499 ms: 1.34x slower | +| json_dumps | 10.4 ms | 14.0 ms: 1.35x slower | +| 2to3 | 264 ms | 364 ms: 1.38x slower | +| comprehensions | 19.8 us | 27.5 us: 1.39x slower | +| coverage | 71.4 ms | 100 ms: 1.40x slower | +| sqlalchemy_declarative | 143 ms | 201 ms: 1.41x slower | +| thrift | 791 us | 1.12 ms: 1.42x slower | +| python_startup_no_site | 7.16 ms | 10.2 ms: 1.43x slower | +| sympy_integrate | 20.5 ms | 29.6 ms: 1.44x slower | +| django_template | 34.7 ms | 50.2 ms: 1.45x slower | +| nbody | 89.3 ms | 131 ms: 1.46x slower | +| pyflate | 448 ms | 669 ms: 1.49x slower | +| logging_format | 7.35 us | 11.0 us: 1.50x slower | +| html5lib | 63.6 ms | 96.2 ms: 1.51x slower | +| logging_simple | 6.63 us | 10.1 us: 1.52x slower | +| unpickle_pure_python | 221 us | 340 us: 1.54x slower | +| mako | 11.0 ms | 17.1 ms: 1.55x slower | +| hexiom | 6.17 ms | 9.84 ms: 1.59x slower | +| scimark_lu | 114 ms | 183 ms: 1.61x slower | +| sympy_str | 292 ms | 478 ms: 1.64x slower | +| pickle_pure_python | 308 us | 505 us: 1.64x slower | +| chaos | 62.8 ms | 104 ms: 1.66x slower | +| richards_super | 51.9 ms | 86.4 ms: 1.67x slower | +| create_gc_cycles | 1.09 ms | 1.84 ms: 1.68x slower | +| richards | 45.9 ms | 77.8 ms: 1.69x slower | +| logging_silent | 109 ns | 185 ns: 1.69x slower | +| float | 80.8 ms | 137 ms: 1.70x slower | +| python_startup | 9.93 ms | 17.2 ms: 1.73x slower | +| scimark_monte_carlo | 68.4 ms | 119 ms: 1.74x slower | +| sqlglot_transpile | 1.67 ms | 2.97 ms: 1.78x slower | +| scimark_sor | 130 ms | 232 ms: 1.78x slower | +| raytrace | 299 ms | 548 ms: 1.83x slower | +| sqlglot_parse | 1.36 ms | 2.59 ms: 1.91x slower | +| go | 139 ms | 267 ms: 1.91x slower | +| sympy_expand | 468 ms | 955 ms: 2.04x slower | +| sympy_sum | 166 ms | 351 ms: 2.11x slower | +| deltablue | 3.45 ms | 8.07 ms: 2.34x slower | +| bench_thread_pool | 941 us | 3.40 ms: 3.61x slower | +| bench_mp_pool | 10.8 ms | 108 ms: 10.00x slower | +| Geometric mean | (ref) | 1.32x slower | + +Benchmark hidden because not significant (1): sqlite_synth +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.215x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.20x +- 95% likely to have a slowdown of 1.18x +- 99% likely to have a slowdown of 1.17x + +# Memory +- memory change: 1.33x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg new file mode 100644 index 00000000..9a8f6007 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg @@ -0,0 +1,3050 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md new file mode 100644 index 00000000..8c5d4924 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md @@ -0,0 +1,204 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.240x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.18x slower +- Memory change: 1.32x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 364 ms: 1.40x slower | +| docutils | 2.62 sec | 3.07 sec: 1.17x slower | +| html5lib | 67.0 ms | 96.2 ms: 1.44x slower | +| Geometric mean | (ref) | 1.33x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 790 ms: 1.16x faster | +| async_tree_io | 876 ms | 814 ms: 1.08x faster | +| async_tree_cpu_io_mixed | 666 ms | 619 ms: 1.08x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 598 ms: 1.07x faster | +| async_tree_none_tg | 336 ms | 345 ms: 1.02x slower | +| async_tree_memoization_tg | 414 ms | 432 ms: 1.04x slower | +| coroutines | 23.6 ms | 24.7 ms: 1.05x slower | +| async_tree_none | 354 ms | 375 ms: 1.06x slower | +| async_generators | 377 ms | 459 ms: 1.22x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (2): async_tree_memoization, asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 181 ms: 1.20x faster | +| nbody | 85.1 ms | 131 ms: 1.53x slower | +| float | 77.5 ms | 137 ms: 1.77x slower | +| Geometric mean | (ref) | 1.32x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.89 ms: 1.07x faster | +| regex_dna | 180 ms | 187 ms: 1.04x slower | +| regex_v8 | 22.7 ms | 25.1 ms: 1.11x slower | +| regex_compile | 132 ms | 176 ms: 1.33x slower | +| Geometric mean | (ref) | 1.10x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 94.9 ms | 90.5 ms: 1.05x faster | +| xml_etree_parse | 136 ms | 132 ms: 1.03x faster | +| json_loads | 27.0 us | 29.0 us: 1.07x slower | +| xml_etree_generate | 85.4 ms | 97.6 ms: 1.14x slower | +| tomli_loads | 2.01 sec | 2.54 sec: 1.27x slower | +| json_dumps | 10.5 ms | 14.0 ms: 1.33x slower | +| xml_etree_process | 59.3 ms | 79.1 ms: 1.33x slower | +| unpickle_pure_python | 210 us | 340 us: 1.62x slower | +| pickle_pure_python | 294 us | 505 us: 1.72x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 10.2 ms: 1.39x slower | +| python_startup | 11.0 ms | 17.2 ms: 1.57x slower | +| Geometric mean | (ref) | 1.47x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 48.8 ms | 63.6 ms: 1.30x slower | +| genshi_text | 21.5 ms | 30.4 ms: 1.41x slower | +| django_template | 34.1 ms | 50.2 ms: 1.47x slower | +| mako | 11.3 ms | 17.1 ms: 1.51x slower | +| Geometric mean | (ref) | 1.42x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 181 ms: 1.20x faster | +| async_tree_io_tg | 913 ms | 790 ms: 1.16x faster | +| deepcopy | 355 us | 319 us: 1.11x faster | +| async_tree_io | 876 ms | 814 ms: 1.08x faster | +| async_tree_cpu_io_mixed | 666 ms | 619 ms: 1.08x faster | +| regex_effbot | 3.08 ms | 2.89 ms: 1.07x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 598 ms: 1.07x faster | +| xml_etree_iterparse | 94.9 ms | 90.5 ms: 1.05x faster | +| xml_etree_parse | 136 ms | 132 ms: 1.03x faster | +| spectral_norm | 111 ms | 113 ms: 1.01x slower | +| async_tree_none_tg | 336 ms | 345 ms: 1.02x slower | +| json | 4.93 ms | 5.09 ms: 1.03x slower | +| deepcopy_memo | 39.1 us | 40.5 us: 1.04x slower | +| regex_dna | 180 ms | 187 ms: 1.04x slower | +| pathlib | 19.2 ms | 20.0 ms: 1.04x slower | +| async_tree_memoization_tg | 414 ms | 432 ms: 1.04x slower | +| coroutines | 23.6 ms | 24.7 ms: 1.05x slower | +| async_tree_none | 354 ms | 375 ms: 1.06x slower | +| json_loads | 27.0 us | 29.0 us: 1.07x slower | +| telco | 7.82 ms | 8.60 ms: 1.10x slower | +| deepcopy_reduce | 3.11 us | 3.44 us: 1.11x slower | +| regex_v8 | 22.7 ms | 25.1 ms: 1.11x slower | +| scimark_fft | 349 ms | 388 ms: 1.11x slower | +| gc_traversal | 3.14 ms | 3.52 ms: 1.12x slower | +| bpe_tokeniser | 4.45 sec | 5.03 sec: 1.13x slower | +| xml_etree_generate | 85.4 ms | 97.6 ms: 1.14x slower | +| pylint | 317 ms | 371 ms: 1.17x slower | +| docutils | 2.62 sec | 3.07 sec: 1.17x slower | +| scimark_sparse_mat_mult | 4.71 ms | 5.63 ms: 1.20x slower | +| mdp | 2.36 sec | 2.84 sec: 1.20x slower | +| coverage | 83.0 ms | 100 ms: 1.21x slower | +| async_generators | 377 ms | 459 ms: 1.22x slower | +| dulwich_log | 74.8 ms | 93.7 ms: 1.25x slower | +| sqlglot_optimize | 52.7 ms | 66.2 ms: 1.26x slower | +| nqueens | 78.6 ms | 98.9 ms: 1.26x slower | +| sqlglot_normalize | 106 ms | 133 ms: 1.26x slower | +| tomli_loads | 2.01 sec | 2.54 sec: 1.27x slower | +| meteor_contest | 102 ms | 129 ms: 1.27x slower | +| genshi_xml | 48.8 ms | 63.6 ms: 1.30x slower | +| pprint_safe_repr | 738 ms | 966 ms: 1.31x slower | +| typing_runtime_protocols | 155 us | 205 us: 1.32x slower | +| generators | 28.8 ms | 38.2 ms: 1.33x slower | +| crypto_pyaes | 67.9 ms | 90.1 ms: 1.33x slower | +| json_dumps | 10.5 ms | 14.0 ms: 1.33x slower | +| xml_etree_process | 59.3 ms | 79.1 ms: 1.33x slower | +| regex_compile | 132 ms | 176 ms: 1.33x slower | +| pprint_pformat | 1.50 sec | 2.01 sec: 1.34x slower | +| fannkuch | 370 ms | 499 ms: 1.35x slower | +| pycparser | 1.12 sec | 1.53 sec: 1.37x slower | +| create_gc_cycles | 1.34 ms | 1.84 ms: 1.37x slower | +| python_startup_no_site | 7.39 ms | 10.2 ms: 1.39x slower | +| 2to3 | 260 ms | 364 ms: 1.40x slower | +| genshi_text | 21.5 ms | 30.4 ms: 1.41x slower | +| html5lib | 67.0 ms | 96.2 ms: 1.44x slower | +| thrift | 778 us | 1.12 ms: 1.44x slower | +| django_template | 34.1 ms | 50.2 ms: 1.47x slower | +| pyflate | 449 ms | 669 ms: 1.49x slower | +| sympy_integrate | 19.8 ms | 29.6 ms: 1.49x slower | +| mako | 11.3 ms | 17.1 ms: 1.51x slower | +| nbody | 85.1 ms | 131 ms: 1.53x slower | +| python_startup | 11.0 ms | 17.2 ms: 1.57x slower | +| logging_format | 6.84 us | 11.0 us: 1.61x slower | +| unpickle_pure_python | 210 us | 340 us: 1.62x slower | +| scimark_lu | 113 ms | 183 ms: 1.63x slower | +| logging_simple | 6.16 us | 10.1 us: 1.64x slower | +| hexiom | 5.99 ms | 9.84 ms: 1.64x slower | +| comprehensions | 16.5 us | 27.5 us: 1.67x slower | +| richards_super | 51.6 ms | 86.4 ms: 1.67x slower | +| pickle_pure_python | 294 us | 505 us: 1.72x slower | +| richards | 45.2 ms | 77.8 ms: 1.72x slower | +| scimark_sor | 134 ms | 232 ms: 1.72x slower | +| sympy_str | 275 ms | 478 ms: 1.74x slower | +| float | 77.5 ms | 137 ms: 1.77x slower | +| logging_silent | 103 ns | 185 ns: 1.80x slower | +| chaos | 57.3 ms | 104 ms: 1.82x slower | +| scimark_monte_carlo | 65.4 ms | 119 ms: 1.82x slower | +| go | 141 ms | 267 ms: 1.89x slower | +| sqlglot_transpile | 1.56 ms | 2.97 ms: 1.91x slower | +| sqlglot_parse | 1.25 ms | 2.59 ms: 2.08x slower | +| sympy_expand | 457 ms | 955 ms: 2.09x slower | +| raytrace | 253 ms | 548 ms: 2.17x slower | +| sympy_sum | 156 ms | 351 ms: 2.25x slower | +| deltablue | 3.12 ms | 8.07 ms: 2.58x slower | +| bench_thread_pool | 919 us | 3.40 ms: 3.70x slower | +| bench_mp_pool | 11.0 ms | 108 ms: 9.83x slower | +| Geometric mean | (ref) | 1.37x slower | + +Benchmark hidden because not significant (3): async_tree_memoization, sqlite_synth, asyncio_websockets +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.240x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.22x +- 95% likely to have a slowdown of 1.21x +- 99% likely to have a slowdown of 1.18x + +# Memory +- memory change: 1.32x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg new file mode 100644 index 00000000..4aaf3d3d --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg @@ -0,0 +1,2965 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg new file mode 100644 index 00000000..c0aa4a19 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base-mem.svg @@ -0,0 +1,3152 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md new file mode 100644 index 00000000..6c5d77cb --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.md @@ -0,0 +1,213 @@ +# Results vs. base + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.271x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.27x slower +- Memory change: 1.19x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 254 ms | 364 ms: 1.43x slower | +| docutils | 2.55 sec | 3.07 sec: 1.20x slower | +| sphinx | 994 ms | 1.17 sec: 1.18x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| coroutines | 22.1 ms | 24.7 ms: 1.12x slower | +| async_tree_cpu_io_mixed_tg | 484 ms | 598 ms: 1.23x slower | +| async_tree_cpu_io_mixed | 497 ms | 619 ms: 1.25x slower | +| async_generators | 354 ms | 459 ms: 1.30x slower | +| async_tree_io_tg | 609 ms | 790 ms: 1.30x slower | +| async_tree_io | 618 ms | 814 ms: 1.32x slower | +| async_tree_none_tg | 254 ms | 345 ms: 1.36x slower | +| async_tree_none | 274 ms | 375 ms: 1.37x slower | +| async_tree_memoization | 331 ms | 458 ms: 1.39x slower | +| async_tree_memoization_tg | 305 ms | 432 ms: 1.42x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 185 ms | 181 ms: 1.02x faster | +| nbody | 88.9 ms | 131 ms: 1.47x slower | +| float | 77.2 ms | 137 ms: 1.78x slower | +| Geometric mean | (ref) | 1.37x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_dna | 184 ms | 187 ms: 1.02x slower | +| regex_effbot | 2.83 ms | 2.89 ms: 1.02x slower | +| regex_compile | 126 ms | 176 ms: 1.40x slower | +| Geometric mean | (ref) | 1.10x slower | + +Benchmark hidden because not significant (1): regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| xml_etree_parse | 128 ms | 132 ms: 1.03x slower | +| json_loads | 26.2 us | 29.0 us: 1.11x slower | +| xml_etree_generate | 83.4 ms | 97.6 ms: 1.17x slower | +| json_dumps | 11.2 ms | 14.0 ms: 1.24x slower | +| tomli_loads | 1.96 sec | 2.54 sec: 1.30x slower | +| xml_etree_process | 58.1 ms | 79.1 ms: 1.36x slower | +| pickle_pure_python | 320 us | 505 us: 1.58x slower | +| unpickle_pure_python | 210 us | 340 us: 1.62x slower | +| Geometric mean | (ref) | 1.25x slower | + +Benchmark hidden because not significant (1): xml_etree_iterparse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup | 14.6 ms | 17.2 ms: 1.18x slower | +| python_startup_no_site | 7.46 ms | 10.2 ms: 1.37x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_xml | 49.2 ms | 63.6 ms: 1.29x slower | +| django_template | 35.2 ms | 50.2 ms: 1.42x slower | +| genshi_text | 21.3 ms | 30.4 ms: 1.43x slower | +| mako | 11.5 ms | 17.1 ms: 1.49x slower | +| Geometric mean | (ref) | 1.41x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 4.26 ms | 3.52 ms: 1.21x faster | +| pidigits | 185 ms | 181 ms: 1.02x faster | +| sqlite_synth | 2.24 us | 2.20 us: 1.02x faster | +| create_gc_cycles | 1.82 ms | 1.84 ms: 1.01x slower | +| regex_dna | 184 ms | 187 ms: 1.02x slower | +| regex_effbot | 2.83 ms | 2.89 ms: 1.02x slower | +| xml_etree_parse | 128 ms | 132 ms: 1.03x slower | +| json | 4.75 ms | 5.09 ms: 1.07x slower | +| json_loads | 26.2 us | 29.0 us: 1.11x slower | +| pathlib | 18.0 ms | 20.0 ms: 1.11x slower | +| coroutines | 22.1 ms | 24.7 ms: 1.12x slower | +| k_core | 2.06 sec | 2.35 sec: 1.14x slower | +| spectral_norm | 97.7 ms | 113 ms: 1.15x slower | +| mdp | 2.45 sec | 2.84 sec: 1.16x slower | +| xml_etree_generate | 83.4 ms | 97.6 ms: 1.17x slower | +| python_startup | 14.6 ms | 17.2 ms: 1.18x slower | +| sphinx | 994 ms | 1.17 sec: 1.18x slower | +| bpe_tokeniser | 4.22 sec | 5.03 sec: 1.19x slower | +| telco | 7.20 ms | 8.60 ms: 1.19x slower | +| docutils | 2.55 sec | 3.07 sec: 1.20x slower | +| bench_mp_pool | 88.2 ms | 108 ms: 1.23x slower | +| async_tree_cpu_io_mixed_tg | 484 ms | 598 ms: 1.23x slower | +| scimark_fft | 314 ms | 388 ms: 1.24x slower | +| many_optionals | 1.02 ms | 1.26 ms: 1.24x slower | +| connected_components | 400 ms | 498 ms: 1.24x slower | +| json_dumps | 11.2 ms | 14.0 ms: 1.24x slower | +| nqueens | 79.4 ms | 98.9 ms: 1.25x slower | +| async_tree_cpu_io_mixed | 497 ms | 619 ms: 1.25x slower | +| dulwich_log | 75.2 ms | 93.7 ms: 1.25x slower | +| shortest_path | 441 ms | 552 ms: 1.25x slower | +| deepcopy | 252 us | 319 us: 1.27x slower | +| coverage | 78.7 ms | 100 ms: 1.27x slower | +| sqlglot_optimize | 51.8 ms | 66.2 ms: 1.28x slower | +| sqlglot_normalize | 103 ms | 133 ms: 1.29x slower | +| genshi_xml | 49.2 ms | 63.6 ms: 1.29x slower | +| meteor_contest | 99.6 ms | 129 ms: 1.30x slower | +| async_generators | 354 ms | 459 ms: 1.30x slower | +| tomli_loads | 1.96 sec | 2.54 sec: 1.30x slower | +| async_tree_io_tg | 609 ms | 790 ms: 1.30x slower | +| scimark_sparse_mat_mult | 4.30 ms | 5.63 ms: 1.31x slower | +| crypto_pyaes | 68.4 ms | 90.1 ms: 1.32x slower | +| async_tree_io | 618 ms | 814 ms: 1.32x slower | +| typing_runtime_protocols | 155 us | 205 us: 1.32x slower | +| pylint | 280 ms | 371 ms: 1.33x slower | +| deepcopy_reduce | 2.58 us | 3.44 us: 1.34x slower | +| pprint_safe_repr | 713 ms | 966 ms: 1.35x slower | +| fannkuch | 368 ms | 499 ms: 1.36x slower | +| async_tree_none_tg | 254 ms | 345 ms: 1.36x slower | +| xml_etree_process | 58.1 ms | 79.1 ms: 1.36x slower | +| async_tree_none | 274 ms | 375 ms: 1.37x slower | +| pycparser | 1.11 sec | 1.53 sec: 1.37x slower | +| python_startup_no_site | 7.46 ms | 10.2 ms: 1.37x slower | +| generators | 27.8 ms | 38.2 ms: 1.38x slower | +| deepcopy_memo | 29.4 us | 40.5 us: 1.38x slower | +| pprint_pformat | 1.45 sec | 2.01 sec: 1.38x slower | +| async_tree_memoization | 331 ms | 458 ms: 1.39x slower | +| subparsers | 21.8 ms | 30.4 ms: 1.40x slower | +| regex_compile | 126 ms | 176 ms: 1.40x slower | +| async_tree_memoization_tg | 305 ms | 432 ms: 1.42x slower | +| django_template | 35.2 ms | 50.2 ms: 1.42x slower | +| genshi_text | 21.3 ms | 30.4 ms: 1.43x slower | +| 2to3 | 254 ms | 364 ms: 1.43x slower | +| nbody | 88.9 ms | 131 ms: 1.47x slower | +| mako | 11.5 ms | 17.1 ms: 1.49x slower | +| sympy_integrate | 19.7 ms | 29.6 ms: 1.50x slower | +| sqlalchemy_imperative | 19.0 ms | 28.7 ms: 1.51x slower | +| thrift | 725 us | 1.12 ms: 1.54x slower | +| pyflate | 432 ms | 669 ms: 1.55x slower | +| pickle_pure_python | 320 us | 505 us: 1.58x slower | +| sqlalchemy_declarative | 126 ms | 201 ms: 1.59x slower | +| comprehensions | 17.1 us | 27.5 us: 1.61x slower | +| unpickle_pure_python | 210 us | 340 us: 1.62x slower | +| scimark_lu | 111 ms | 183 ms: 1.64x slower | +| logging_format | 6.71 us | 11.0 us: 1.65x slower | +| logging_simple | 6.06 us | 10.1 us: 1.66x slower | +| hexiom | 5.77 ms | 9.84 ms: 1.71x slower | +| richards_super | 50.1 ms | 86.4 ms: 1.72x slower | +| logging_silent | 106 ns | 185 ns: 1.75x slower | +| richards | 44.5 ms | 77.8 ms: 1.75x slower | +| sympy_str | 271 ms | 478 ms: 1.77x slower | +| float | 77.2 ms | 137 ms: 1.78x slower | +| chaos | 58.0 ms | 104 ms: 1.79x slower | +| scimark_sor | 123 ms | 232 ms: 1.88x slower | +| scimark_monte_carlo | 62.9 ms | 119 ms: 1.89x slower | +| sqlglot_transpile | 1.57 ms | 2.97 ms: 1.89x slower | +| sqlglot_parse | 1.25 ms | 2.59 ms: 2.07x slower | +| sympy_expand | 454 ms | 955 ms: 2.11x slower | +| raytrace | 256 ms | 548 ms: 2.14x slower | +| go | 116 ms | 267 ms: 2.29x slower | +| sympy_sum | 151 ms | 351 ms: 2.32x slower | +| deltablue | 3.16 ms | 8.07 ms: 2.56x slower | +| bench_thread_pool | 1.03 ms | 3.40 ms: 3.30x slower | +| Geometric mean | (ref) | 1.39x slower | + +Benchmark hidden because not significant (3): asyncio_websockets, regex_v8, xml_etree_iterparse +Ignored benchmarks (1) of results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json: html5lib + +- Geometric mean (including insignificant results): 1.271x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.30x +- 95% likely to have a slowdown of 1.29x +- 99% likely to have a slowdown of 1.27x + +# Memory +- memory change: 1.19x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg new file mode 100644 index 00000000..928cf683 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f-NOGIL/bm-20241215-vultr-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-base.svg @@ -0,0 +1,3201 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f/README.md b/results/bm-20241215-3.14.0a2+-47c5a0f/README.md index 49f58632..201e70a9 100644 --- a/results/bm-20241215-3.14.0a2+-47c5a0f/README.md +++ b/results/bm-20241215-3.14.0a2+-47c5a0f/README.md @@ -8,6 +8,31 @@ - commit merge base: [b74c8f58e875d909ce6b5b9dbcddd6d8331d2081](https://github.com/python/cpython/commit/b74c8f58e875d909ce6b5b9dbcddd6d8331d2081) - ref: 47c5a0f307cff3ed4775 +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12343624912) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f.json) + +### vs. 3.12.6 + +- Geometric mean: 1.125x faster (HPT: reliability of 100.00%, 1.05x faster at 99th %ile) +- Memory usage: 1.13x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.md) +- [📈time plot](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.080x faster (HPT: reliability of 100.00%, 1.04x faster at 99th %ile) +- Memory usage: 1.12x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.md) +- [📈time plot](bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2%2B-47c5a0f-vs-3.13.0rc2.svg) + ## linux x86_64 (vultr) - [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12343624912) diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md new file mode 100644 index 00000000..1e1a709a --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.md @@ -0,0 +1,194 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.125x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.05x faster +- Memory change: 1.13x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 415 ms: 1.10x faster | +| docutils | 4.00 sec | 3.61 sec: 1.11x faster | +| Geometric mean | (ref) | 1.08x faster | + +Benchmark hidden because not significant (1): html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 856 ms: 2.26x faster | +| async_tree_io | 1.85 sec | 877 ms: 2.11x faster | +| async_tree_memoization_tg | 930 ms | 462 ms: 2.01x faster | +| async_tree_memoization | 977 ms | 501 ms: 1.95x faster | +| async_tree_none | 741 ms | 385 ms: 1.93x faster | +| async_tree_none_tg | 704 ms | 366 ms: 1.92x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 668 ms: 1.65x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 669 ms: 1.61x faster | +| async_generators | 589 ms | 549 ms: 1.07x faster | +| asyncio_websockets | 748 ms | 715 ms: 1.05x faster | +| coroutines | 29.5 ms | 30.6 ms: 1.04x slower | +| Geometric mean | (ref) | 1.62x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 123 ms | 111 ms: 1.11x faster | +| pidigits | 250 ms | 239 ms: 1.04x faster | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (1): nbody + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.30 ms: 1.19x faster | +| regex_compile | 187 ms | 162 ms: 1.16x faster | +| regex_dna | 278 ms | 259 ms: 1.08x faster | +| Geometric mean | (ref) | 1.11x faster | + +Benchmark hidden because not significant (1): regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 241 ms | 203 ms: 1.19x faster | +| xml_etree_iterparse | 169 ms | 151 ms: 1.13x faster | +| json_loads | 37.9 us | 34.2 us: 1.11x faster | +| tomli_loads | 2.88 sec | 2.61 sec: 1.10x faster | +| unpickle_pure_python | 300 us | 279 us: 1.07x faster | +| pickle_pure_python | 436 us | 414 us: 1.05x faster | +| xml_etree_generate | 127 ms | 121 ms: 1.05x faster | +| json_dumps | 14.3 ms | 15.5 ms: 1.08x slower | +| Geometric mean | (ref) | 1.07x faster | + +Benchmark hidden because not significant (1): xml_etree_process + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 14.4 ms: 1.22x faster | +| python_startup | 23.7 ms | 25.1 ms: 1.06x slower | +| Geometric mean | (ref) | 1.07x faster | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 30.2 ms | 28.5 ms: 1.06x faster | +| mako | 15.7 ms | 16.7 ms: 1.06x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): django_template, genshi_xml + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 856 ms: 2.26x faster | +| async_tree_io | 1.85 sec | 877 ms: 2.11x faster | +| async_tree_memoization_tg | 930 ms | 462 ms: 2.01x faster | +| async_tree_memoization | 977 ms | 501 ms: 1.95x faster | +| async_tree_none | 741 ms | 385 ms: 1.93x faster | +| async_tree_none_tg | 704 ms | 366 ms: 1.92x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 668 ms: 1.65x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 669 ms: 1.61x faster | +| deepcopy | 468 us | 323 us: 1.45x faster | +| deepcopy_memo | 52.4 us | 37.5 us: 1.40x faster | +| comprehensions | 27.1 us | 21.2 us: 1.28x faster | +| sqlalchemy_declarative | 218 ms | 170 ms: 1.28x faster | +| python_startup_no_site | 17.6 ms | 14.4 ms: 1.22x faster | +| regex_effbot | 5.13 ms | 4.30 ms: 1.19x faster | +| xml_etree_parse | 241 ms | 203 ms: 1.19x faster | +| logging_simple | 9.45 us | 7.97 us: 1.18x faster | +| raytrace | 408 ms | 346 ms: 1.18x faster | +| sqlglot_normalize | 157 ms | 134 ms: 1.17x faster | +| pycparser | 1.79 sec | 1.53 sec: 1.17x faster | +| nqueens | 117 ms | 100 ms: 1.17x faster | +| pylint | 465 ms | 402 ms: 1.16x faster | +| sqlalchemy_imperative | 24.7 ms | 21.4 ms: 1.16x faster | +| regex_compile | 187 ms | 162 ms: 1.16x faster | +| crypto_pyaes | 107 ms | 92.9 ms: 1.15x faster | +| bench_thread_pool | 3.48 ms | 3.01 ms: 1.15x faster | +| scimark_fft | 500 ms | 435 ms: 1.15x faster | +| deepcopy_reduce | 4.04 us | 3.53 us: 1.14x faster | +| bpe_tokeniser | 6.59 sec | 5.76 sec: 1.14x faster | +| pathlib | 31.6 ms | 27.7 ms: 1.14x faster | +| spectral_norm | 156 ms | 137 ms: 1.14x faster | +| pyflate | 727 ms | 643 ms: 1.13x faster | +| mdp | 3.97 sec | 3.52 sec: 1.13x faster | +| xml_etree_iterparse | 169 ms | 151 ms: 1.13x faster | +| sqlglot_transpile | 2.34 ms | 2.08 ms: 1.12x faster | +| sympy_sum | 222 ms | 200 ms: 1.11x faster | +| docutils | 4.00 sec | 3.61 sec: 1.11x faster | +| json_loads | 37.9 us | 34.2 us: 1.11x faster | +| float | 123 ms | 111 ms: 1.11x faster | +| go | 172 ms | 156 ms: 1.11x faster | +| scimark_monte_carlo | 96.4 ms | 87.2 ms: 1.10x faster | +| tomli_loads | 2.88 sec | 2.61 sec: 1.10x faster | +| 2to3 | 456 ms | 415 ms: 1.10x faster | +| fannkuch | 540 ms | 493 ms: 1.10x faster | +| logging_format | 9.59 us | 8.76 us: 1.09x faster | +| richards_super | 72.8 ms | 67.2 ms: 1.08x faster | +| json | 6.85 ms | 6.36 ms: 1.08x faster | +| regex_dna | 278 ms | 259 ms: 1.08x faster | +| sqlite_synth | 3.87 us | 3.60 us: 1.08x faster | +| unpickle_pure_python | 300 us | 279 us: 1.07x faster | +| async_generators | 589 ms | 549 ms: 1.07x faster | +| sympy_integrate | 29.8 ms | 27.8 ms: 1.07x faster | +| scimark_sparse_mat_mult | 6.70 ms | 6.26 ms: 1.07x faster | +| chaos | 84.9 ms | 79.3 ms: 1.07x faster | +| sympy_str | 385 ms | 362 ms: 1.06x faster | +| scimark_sor | 167 ms | 157 ms: 1.06x faster | +| genshi_text | 30.2 ms | 28.5 ms: 1.06x faster | +| sqlglot_optimize | 76.0 ms | 71.9 ms: 1.06x faster | +| pickle_pure_python | 436 us | 414 us: 1.05x faster | +| xml_etree_generate | 127 ms | 121 ms: 1.05x faster | +| asyncio_websockets | 748 ms | 715 ms: 1.05x faster | +| pidigits | 250 ms | 239 ms: 1.04x faster | +| pprint_safe_repr | 967 ms | 938 ms: 1.03x faster | +| coroutines | 29.5 ms | 30.6 ms: 1.04x slower | +| telco | 9.59 ms | 10.0 ms: 1.05x slower | +| mako | 15.7 ms | 16.7 ms: 1.06x slower | +| python_startup | 23.7 ms | 25.1 ms: 1.06x slower | +| json_dumps | 14.3 ms | 15.5 ms: 1.08x slower | +| coverage | 95.4 ms | 106 ms: 1.11x slower | +| gc_traversal | 5.86 ms | 8.13 ms: 1.39x slower | +| create_gc_cycles | 1.94 ms | 3.39 ms: 1.75x slower | +| bench_mp_pool | 20.7 ms | 88.5 ms: 4.27x slower | +| Geometric mean | (ref) | 1.11x faster | + +Benchmark hidden because not significant (19): hexiom, html5lib, dulwich_log, meteor_contest, generators, typing_runtime_protocols, pprint_pformat, django_template, regex_v8, thrift, genshi_xml, sympy_expand, xml_etree_process, scimark_lu, sqlglot_parse, deltablue, logging_silent, nbody, richards +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.125x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.07x +- 95% likely to have a speedup of 1.06x +- 99% likely to have a speedup of 1.05x + +# Memory +- memory change: 1.13x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg new file mode 100644 index 00000000..f6919309 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.12.6.svg @@ -0,0 +1,3148 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md new file mode 100644 index 00000000..0e13b631 --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.md @@ -0,0 +1,186 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 47c5a0f307cff3ed4775 +- machine: linux-x86_64 +- commit hash: 47c5a0f +- commit date: 2024-12-15 +- overall geometric mean: 1.080x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.04x faster +- Memory change: 1.12x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 415 ms: 1.07x faster | +| docutils | 4.01 sec | 3.61 sec: 1.11x faster | +| html5lib | 92.6 ms | 86.0 ms: 1.08x faster | +| Geometric mean | (ref) | 1.09x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 856 ms: 1.64x faster | +| async_tree_io | 1.39 sec | 877 ms: 1.58x faster | +| async_tree_none | 572 ms | 385 ms: 1.49x faster | +| async_tree_memoization_tg | 670 ms | 462 ms: 1.45x faster | +| async_tree_memoization | 709 ms | 501 ms: 1.42x faster | +| async_tree_none_tg | 504 ms | 366 ms: 1.38x faster | +| async_tree_cpu_io_mixed | 889 ms | 669 ms: 1.33x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 668 ms: 1.28x faster | +| asyncio_websockets | 766 ms | 715 ms: 1.07x faster | +| async_generators | 567 ms | 549 ms: 1.03x faster | +| Geometric mean | (ref) | 1.32x faster | + +Benchmark hidden because not significant (1): coroutines + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 251 ms | 239 ms: 1.05x faster | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (2): float, nbody + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 182 ms | 162 ms: 1.13x faster | +| regex_effbot | 4.74 ms | 4.30 ms: 1.10x faster | +| regex_dna | 282 ms | 259 ms: 1.09x faster | +| Geometric mean | (ref) | 1.08x faster | + +Benchmark hidden because not significant (1): regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 177 ms | 151 ms: 1.18x faster | +| xml_etree_parse | 231 ms | 203 ms: 1.14x faster | +| tomli_loads | 2.78 sec | 2.61 sec: 1.07x faster | +| unpickle_pure_python | 290 us | 279 us: 1.04x faster | +| json_dumps | 14.1 ms | 15.5 ms: 1.10x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (4): xml_etree_process, xml_etree_generate, pickle_pure_python, json_loads + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 14.4 ms: 1.06x faster | +| python_startup | 22.4 ms | 25.1 ms: 1.12x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 31.7 ms | 28.5 ms: 1.11x faster | +| genshi_xml | 72.1 ms | 67.2 ms: 1.07x faster | +| mako | 15.9 ms | 16.7 ms: 1.04x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (1): django_template + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 856 ms: 1.64x faster | +| async_tree_io | 1.39 sec | 877 ms: 1.58x faster | +| deepcopy | 498 us | 323 us: 1.54x faster | +| async_tree_none | 572 ms | 385 ms: 1.49x faster | +| async_tree_memoization_tg | 670 ms | 462 ms: 1.45x faster | +| async_tree_memoization | 709 ms | 501 ms: 1.42x faster | +| async_tree_none_tg | 504 ms | 366 ms: 1.38x faster | +| deepcopy_memo | 50.1 us | 37.5 us: 1.34x faster | +| async_tree_cpu_io_mixed | 889 ms | 669 ms: 1.33x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 668 ms: 1.28x faster | +| go | 191 ms | 156 ms: 1.23x faster | +| telco | 12.2 ms | 10.0 ms: 1.21x faster | +| xml_etree_iterparse | 177 ms | 151 ms: 1.18x faster | +| pylint | 470 ms | 402 ms: 1.17x faster | +| deepcopy_reduce | 4.10 us | 3.53 us: 1.16x faster | +| spectral_norm | 157 ms | 137 ms: 1.15x faster | +| scimark_sor | 179 ms | 157 ms: 1.14x faster | +| xml_etree_parse | 231 ms | 203 ms: 1.14x faster | +| regex_compile | 182 ms | 162 ms: 1.13x faster | +| nqueens | 112 ms | 100 ms: 1.12x faster | +| docutils | 4.01 sec | 3.61 sec: 1.11x faster | +| fannkuch | 547 ms | 493 ms: 1.11x faster | +| genshi_text | 31.7 ms | 28.5 ms: 1.11x faster | +| sqlite_synth | 3.99 us | 3.60 us: 1.11x faster | +| regex_effbot | 4.74 ms | 4.30 ms: 1.10x faster | +| bpe_tokeniser | 6.28 sec | 5.76 sec: 1.09x faster | +| regex_dna | 282 ms | 259 ms: 1.09x faster | +| sympy_integrate | 30.2 ms | 27.8 ms: 1.09x faster | +| richards_super | 73.2 ms | 67.2 ms: 1.09x faster | +| scimark_fft | 473 ms | 435 ms: 1.09x faster | +| mdp | 3.80 sec | 3.52 sec: 1.08x faster | +| pathlib | 29.9 ms | 27.7 ms: 1.08x faster | +| scimark_sparse_mat_mult | 6.76 ms | 6.26 ms: 1.08x faster | +| crypto_pyaes | 100 ms | 92.9 ms: 1.08x faster | +| html5lib | 92.6 ms | 86.0 ms: 1.08x faster | +| logging_simple | 8.56 us | 7.97 us: 1.07x faster | +| asyncio_websockets | 766 ms | 715 ms: 1.07x faster | +| 2to3 | 445 ms | 415 ms: 1.07x faster | +| genshi_xml | 72.1 ms | 67.2 ms: 1.07x faster | +| tomli_loads | 2.78 sec | 2.61 sec: 1.07x faster | +| python_startup_no_site | 15.3 ms | 14.4 ms: 1.06x faster | +| sqlglot_transpile | 2.20 ms | 2.08 ms: 1.06x faster | +| logging_format | 9.24 us | 8.76 us: 1.05x faster | +| chaos | 83.6 ms | 79.3 ms: 1.05x faster | +| pprint_safe_repr | 987 ms | 938 ms: 1.05x faster | +| thrift | 1.10 ms | 1.05 ms: 1.05x faster | +| sympy_sum | 210 ms | 200 ms: 1.05x faster | +| meteor_contest | 150 ms | 143 ms: 1.05x faster | +| pidigits | 251 ms | 239 ms: 1.05x faster | +| comprehensions | 22.2 us | 21.2 us: 1.05x faster | +| richards | 65.5 ms | 62.6 ms: 1.05x faster | +| sqlglot_normalize | 140 ms | 134 ms: 1.04x faster | +| unpickle_pure_python | 290 us | 279 us: 1.04x faster | +| scimark_monte_carlo | 90.6 ms | 87.2 ms: 1.04x faster | +| async_generators | 567 ms | 549 ms: 1.03x faster | +| sympy_expand | 601 ms | 581 ms: 1.03x faster | +| pyflate | 664 ms | 643 ms: 1.03x faster | +| pycparser | 1.57 sec | 1.53 sec: 1.03x faster | +| mako | 15.9 ms | 16.7 ms: 1.04x slower | +| scimark_lu | 146 ms | 153 ms: 1.05x slower | +| json_dumps | 14.1 ms | 15.5 ms: 1.10x slower | +| logging_silent | 130 ns | 143 ns: 1.10x slower | +| python_startup | 22.4 ms | 25.1 ms: 1.12x slower | +| create_gc_cycles | 2.41 ms | 3.39 ms: 1.41x slower | +| gc_traversal | 5.70 ms | 8.13 ms: 1.43x slower | +| bench_mp_pool | 18.7 ms | 88.5 ms: 4.73x slower | +| Geometric mean | (ref) | 1.06x faster | + +Benchmark hidden because not significant (22): sympy_str, float, sqlglot_optimize, typing_runtime_protocols, json, regex_v8, xml_etree_process, deltablue, hexiom, coverage, xml_etree_generate, pickle_pure_python, coroutines, json_loads, django_template, pprint_pformat, raytrace, generators, sqlglot_parse, dulwich_log, nbody, bench_thread_pool +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.080x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.05x +- 95% likely to have a speedup of 1.04x +- 99% likely to have a speedup of 1.04x + +# Memory +- memory change: 1.12x \ No newline at end of file diff --git a/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg new file mode 100644 index 00000000..7076d85d --- /dev/null +++ b/results/bm-20241215-3.14.0a2+-47c5a0f/bm-20241215-linux-x86_64-python-47c5a0f307cff3ed4775-3.14.0a2+-47c5a0f-vs-3.13.0rc2.svg @@ -0,0 +1,3123 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +