Skip to content

Commit

Permalink
Benchmarking results for @mpage
Browse files Browse the repository at this point in the history
  • Loading branch information
mpage committed Dec 17, 2024
1 parent 575e99f commit b9b88f5
Show file tree
Hide file tree
Showing 10 changed files with 13,748 additions and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-3aa9426) | corona10/gh_115999_BINARY_SUB | 3aa9426 | 1.061x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.svg) | 1.022x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.svg) | 1.004x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base-mem.svg) |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL) | corona10/gh_115999_BINARY_SUB | 3aa9426 (NOGIL) | 1.226x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.svg) | 1.250x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.svg) | 1.006x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base-mem.svg) |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL) | corona10/gh_115999_BINARY_SUB | 7b72e7b (NOGIL) | 1.224x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.svg) | 1.249x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.svg) | 1.008x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base-mem.svg) |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-7b72e7b) | corona10/gh_115999_BINARY_SUB | 7b72e7b | 1.066x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.svg) | 1.027x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.svg) | 1.000x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base-mem.svg) |
Expand Down
1 change: 1 addition & 0 deletions RESULTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -199,6 +199,7 @@
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-3aa9426) | corona10/gh_115999_BINARY_SUB | 3aa9426 | 1.061x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.svg) | 1.022x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.svg) | 1.004x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-3aa9426/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base-mem.svg) |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL) | corona10/gh_115999_BINARY_SUB | 3aa9426 (NOGIL) | 1.226x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.svg) | 1.250x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.svg) | 1.006x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-3aa9426-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base-mem.svg) |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL) | corona10/gh_115999_BINARY_SUB | 7b72e7b (NOGIL) | 1.224x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.svg) | 1.249x ↓<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.svg) | 1.008x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-7b72e7b-NOGIL/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base-mem.svg) |
| [2024-12-17](results/bm-20241217-3.14.0a2%2B-7b72e7b) | corona10/gh_115999_BINARY_SUB | 7b72e7b | 1.066x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.12.6.svg) | 1.027x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-3.13.0rc2.svg) | 1.000x ↑<br>[📄](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.md)[📈](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base.svg)[🧠](results/bm-20241217-3.14.0a2%2B-7b72e7b/bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-7b72e7b-vs-base-mem.svg) |
Expand Down
43 changes: 43 additions & 0 deletions results/bm-20241217-3.14.0a2+-3aa9426/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
# Results

- fork: corona10/gh_115999_BINARY_SUB
- version: 3.14.0a2+
- config:
- commit hash: [3aa9426](https://github.com/corona10/cpython/commit/3aa9426)
- commit date: 2024-12-17T10:58:01+09:00
- commit merge base: [70154855cf698560dd9a5e484a649839cd68dc7c](https://github.com/python/cpython/commit/70154855cf698560dd9a5e484a649839cd68dc7c)
- ref: gh_115999_BINARY_SUB

## linux x86_64 (vultr)

- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12367418304)
- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz
- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39
- [raw results](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426.json)

### vs. 3.12.6

- Geometric mean: 1.061x faster (HPT: reliability of 99.99%, 1.01x faster at 99th %ile)
- Memory usage: 1.11x
- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers
- [📄table](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.md)
- [📈time plot](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.12.6.svg)

### vs. 3.13.0rc2

- Geometric mean: 1.022x faster (HPT: reliability of 97.48%, 1.00x faster at 99th %ile)
- Memory usage: 1.10x
- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
- [📄table](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.md)
- [📈time plot](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-3.13.0rc2.svg)

### vs. base

- Geometric mean: 1.004x slower (HPT: reliability of 99.60%, 1.00x faster at 99th %ile)
- Memory usage: 1.00x
- [🧠memory plot](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base-mem.svg)
- [📄table](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.md)
- [📈time plot](bm-20241217-vultr-x86_64-corona10-gh_115999_BINARY_SUB-3.14.0a2%2B-3aa9426-vs-base.svg)

Loading

0 comments on commit b9b88f5

Please sign in to comment.