Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

implement a better statement selection logic #654

Merged
merged 1 commit into from
Sep 10, 2024
Merged

implement a better statement selection logic #654

merged 1 commit into from
Sep 10, 2024

Conversation

aviatesk
Copy link
Owner

@aviatesk aviatesk commented Sep 5, 2024 •
edited
Loading

Specifically, this commit aims to review the implementation of
add_control_flow! and improves its accuracy. Ideally, it should pass
JET's existing test cases as well as the newly added ones, including the
test cases from JuliaDebug/LoweredCodeUtils.jl#99. The goal is to share
the same high-precision CFG selection logic between LoweredCodeUtils
and JET.

The new algorithm is based on what was proposed in [Wei84]1. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
INFL in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be short-circuited
from the conditional branch to the nearest common post-dominator.

COMBAK: It is important to note that in Julia's IR (CodeInfo),
"short-circuiting" a specific code region is not a simple task. Simply
ignoring the path to the post-dominator does not guarantee fall-through
to the post-dominator. Therefore, a more careful implementation is
required for this aspect.

Footnotes

  1. M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984. https://ieeexplore.ieee.org/document/5010248 ↩

@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 5, 2024 •
edited
Loading

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 5 Sep 2024 - 14:35
  • Baseline: 5 Sep 2024 - 14:46
  • Package commits:
  • Target: 868476
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["JETAnalyzer{BasicPass} top-level", "demo"] 1.02 (5%) 1.01 (1%) ❌
["JETAnalyzer{SoundPass}", "identity(nothing)"] 1.05 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1897 s 0 s 196 s 6205 s 0 s
 #2 3244 MHz 1631 s 0 s 226 s 6432 s 0 s
 #3 3186 MHz 1934 s 0 s 217 s 6157 s 0 s
 #4 2566 MHz 2262 s 0 s 205 s 5839 s 0 s
 Memory: 15.606491088867188 GB (12287.6875 MB free)
 Uptime: 833.47 sec
 Load Avg: 1.01 1.01 0.65
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3244 MHz 3217 s 0 s 356 s 10842 s 0 s
 #2 2445 MHz 2871 s 0 s 402 s 11134 s 0 s
 #3 3114 MHz 3868 s 0 s 380 s 10180 s 0 s
 #4 2504 MHz 4477 s 0 s 373 s 9578 s 0 s
 Memory: 15.606491088867188 GB (12219.71875 MB free)
 Uptime: 1446.53 sec
 Load Avg: 1.07 1.09 0.92
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 5 Sep 2024 - 14:35
  • Package commit: 868476
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 176.095 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 498.117 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 251.842 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.723 ms (5%) 2.20 MiB (1%) 36866
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.705 s (5%) 490.985 ms 1.49 GiB (1%) 27583711
["JETAnalyzer{BasicPass} top-level", "simple"] 7.696 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 84.147 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 127.612 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.131 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 131.154 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.092 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.382 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 164.804 ms (5%) 76.32 MiB (1%) 958899
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.235 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 136.264 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.439 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 126.587 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.722 ms (5%) 235.85 MiB (1%) 3470971
["OptAnalyzer", "rand(Bool)"] 21.748 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 230.951 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.039 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.546 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 233.020 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1897 s 0 s 196 s 6205 s 0 s
 #2 3244 MHz 1631 s 0 s 226 s 6432 s 0 s
 #3 3186 MHz 1934 s 0 s 217 s 6157 s 0 s
 #4 2566 MHz 2262 s 0 s 205 s 5839 s 0 s
 Memory: 15.606491088867188 GB (12287.6875 MB free)
 Uptime: 833.47 sec
 Load Avg: 1.01 1.01 0.65
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 5 Sep 2024 - 14:46
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 174.776 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 498.160 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 253.779 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.068 ms (5%) 2.17 MiB (1%) 36439
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.983 s (5%) 487.408 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 7.975 ms (5%) 2.01 MiB (1%) 35481
["JETAnalyzer{BasicPass}", "identity(nothing)"] 84.338 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 129.364 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.004 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 133.179 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.245 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 82.023 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 167.129 ms (5%) 76.73 MiB (1%) 958946
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.196 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 136.335 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.493 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 125.073 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 423.103 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.761 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 222.756 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.989 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.576 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 235.221 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3244 MHz 3217 s 0 s 356 s 10842 s 0 s
 #2 2445 MHz 2871 s 0 s 402 s 11134 s 0 s
 #3 3114 MHz 3868 s 0 s 380 s 10180 s 0 s
 #4 2504 MHz 4477 s 0 s 373 s 9578 s 0 s
 Memory: 15.606491088867188 GB (12219.71875 MB free)
 Uptime: 1446.53 sec
 Load Avg: 1.07 1.09 0.92
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 6 Sep 2024 - 07:14
  • Baseline: 6 Sep 2024 - 07:24
  • Package commits:
  • Target: 2bfd86
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 0.89 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 0.98 (5%) 1.01 (1%) ❌
["JETAnalyzer{BasicPass}", "identity(nothing)"] 0.94 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.86 (5%) ✅ 1.00 (1%)
["JETAnalyzer{SoundPass}", "identity(nothing)"] 0.84 (5%) ✅ 1.00 (1%)
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.92 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1863 s 0 s 207 s 6801 s 0 s
 #2 3243 MHz 1472 s 0 s 212 s 7197 s 0 s
 #3 2584 MHz 2266 s 0 s 222 s 6367 s 0 s
 #4 2445 MHz 2178 s 0 s 238 s 6446 s 0 s
 Memory: 15.606487274169922 GB (12261.6953125 MB free)
 Uptime: 891.05 sec
 Load Avg: 1.08 1.04 0.68
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3589 s 0 s 370 s 11061 s 0 s
 #2 3243 MHz 2715 s 0 s 361 s 11956 s 0 s
 #3 2618 MHz 4521 s 0 s 374 s 10115 s 0 s
 #4 2445 MHz 3698 s 0 s 421 s 10896 s 0 s
 Memory: 15.606487274169922 GB (12454.9140625 MB free)
 Uptime: 1507.39 sec
 Load Avg: 1.06 1.13 0.96
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 6 Sep 2024 - 7:14
  • Package commit: 2bfd86
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.234 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 495.984 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 253.622 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.228 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.193 s (5%) 501.719 ms 1.49 GiB (1%) 27583788
["JETAnalyzer{BasicPass} top-level", "simple"] 8.034 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 83.957 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 129.083 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.562 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 132.568 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.147 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 83.336 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 161.173 ms (5%) 76.45 MiB (1%) 958910
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.354 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 139.070 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.503 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 126.768 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 414.205 ms (5%) 235.85 MiB (1%) 3470965
["OptAnalyzer", "rand(Bool)"] 21.986 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 223.469 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.000 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.508 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 231.114 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1863 s 0 s 207 s 6801 s 0 s
 #2 3243 MHz 1472 s 0 s 212 s 7197 s 0 s
 #3 2584 MHz 2266 s 0 s 222 s 6367 s 0 s
 #4 2445 MHz 2178 s 0 s 238 s 6446 s 0 s
 Memory: 15.606487274169922 GB (12261.6953125 MB free)
 Uptime: 891.05 sec
 Load Avg: 1.08 1.04 0.68
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 6 Sep 2024 - 7:24
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 178.645 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 554.721 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 252.603 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.791 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.827 s (5%) 546.059 ms 1.48 GiB (1%) 27562178
["JETAnalyzer{BasicPass} top-level", "simple"] 7.983 ms (5%) 2.01 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 89.268 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 134.813 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.964 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 154.040 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.362 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 99.707 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 169.532 ms (5%) 76.29 MiB (1%) 958889
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.368 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 151.192 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.458 ms (5%) 1.95 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.540 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 423.030 ms (5%) 235.85 MiB (1%) 3470965
["OptAnalyzer", "rand(Bool)"] 22.372 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 232.098 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.115 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.715 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 241.071 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3589 s 0 s 370 s 11061 s 0 s
 #2 3243 MHz 2715 s 0 s 361 s 11956 s 0 s
 #3 2618 MHz 4521 s 0 s 374 s 10115 s 0 s
 #4 2445 MHz 3698 s 0 s 421 s 10896 s 0 s
 Memory: 15.606487274169922 GB (12454.9140625 MB free)
 Uptime: 1507.39 sec
 Load Avg: 1.06 1.13 0.96
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.84
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 7 Sep 2024 - 05:14
  • Baseline: 7 Sep 2024 - 05:24
  • Package commits:
  • Target: 5281bf
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.10 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.01 (5%) 1.01 (1%) ❌
["JETAnalyzer{BasicPass} top-level", "self analysis"] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3233 MHz 2051 s 0 s 220 s 6818 s 0 s
 #2 3242 MHz 1497 s 0 s 225 s 7359 s 0 s
 #3 3003 MHz 1787 s 0 s 246 s 7056 s 0 s
 #4 2445 MHz 2452 s 0 s 203 s 6426 s 0 s
 Memory: 15.606491088867188 GB (12341.6328125 MB free)
 Uptime: 912.18 sec
 Load Avg: 1.01 1.0 0.65
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3420 s 0 s 359 s 11426 s 0 s
 #2 2445 MHz 2984 s 0 s 405 s 11810 s 0 s
 #3 3242 MHz 3983 s 0 s 396 s 10831 s 0 s
 #4 3244 MHz 4097 s 0 s 345 s 10761 s 0 s
 Memory: 15.606491088867188 GB (12445.23046875 MB free)
 Uptime: 1525.09 sec
 Load Avg: 1.01 1.07 0.91
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 7 Sep 2024 - 5:14
  • Package commit: 5281bf
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 176.109 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 551.469 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 251.193 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.904 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.886 s (5%) 488.932 ms 1.49 GiB (1%) 27583791
["JETAnalyzer{BasicPass} top-level", "simple"] 7.869 ms (5%) 2.02 MiB (1%) 35537
["JETAnalyzer{BasicPass}", "identity(nothing)"] 85.900 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 129.165 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 37.922 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 130.554 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.180 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 83.576 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 167.190 ms (5%) 76.51 MiB (1%) 958929
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.282 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 137.677 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.582 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 124.332 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 421.840 ms (5%) 235.85 MiB (1%) 3470972
["OptAnalyzer", "rand(Bool)"] 21.641 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 221.964 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.014 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.534 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 232.749 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3233 MHz 2051 s 0 s 220 s 6818 s 0 s
 #2 3242 MHz 1497 s 0 s 225 s 7359 s 0 s
 #3 3003 MHz 1787 s 0 s 246 s 7056 s 0 s
 #4 2445 MHz 2452 s 0 s 203 s 6426 s 0 s
 Memory: 15.606491088867188 GB (12341.6328125 MB free)
 Uptime: 912.18 sec
 Load Avg: 1.01 1.0 0.65
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 7 Sep 2024 - 5:24
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 176.206 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 499.973 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 252.092 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.535 ms (5%) 2.17 MiB (1%) 36439
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.200 s (5%) 461.424 ms 1.48 GiB (1%) 27562179
["JETAnalyzer{BasicPass} top-level", "simple"] 7.731 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 84.558 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 128.441 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.450 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 134.581 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.239 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 85.119 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.813 ms (5%) 76.53 MiB (1%) 958918
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.017 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 140.431 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.622 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 124.062 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 419.930 ms (5%) 235.85 MiB (1%) 3470965
["OptAnalyzer", "rand(Bool)"] 22.243 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 221.494 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.921 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.568 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 233.766 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3420 s 0 s 359 s 11426 s 0 s
 #2 2445 MHz 2984 s 0 s 405 s 11810 s 0 s
 #3 3242 MHz 3983 s 0 s 396 s 10831 s 0 s
 #4 3244 MHz 4097 s 0 s 345 s 10761 s 0 s
 Memory: 15.606491088867188 GB (12445.23046875 MB free)
 Uptime: 1525.09 sec
 Load Avg: 1.01 1.07 0.91
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 06:54
  • Baseline: 9 Sep 2024 - 07:04
  • Package commits:
  • Target: aafb34
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 0.92 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.02 (5%) 1.01 (1%) ❌
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3280 MHz 1908 s 0 s 200 s 5613 s 0 s
 #2 3241 MHz 2268 s 0 s 231 s 5214 s 0 s
 #3 2984 MHz 1979 s 0 s 231 s 5517 s 0 s
 #4 2445 MHz 1548 s 0 s 208 s 5968 s 0 s
 Memory: 15.606491088867188 GB (12383.08984375 MB free)
 Uptime: 775.68 sec
 Load Avg: 1.04 1.02 0.65
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3921 s 0 s 368 s 9513 s 0 s
 #2 2747 MHz 3560 s 0 s 374 s 9861 s 0 s
 #3 2445 MHz 3700 s 0 s 396 s 9712 s 0 s
 #4 3241 MHz 3198 s 0 s 373 s 10235 s 0 s
 Memory: 15.606491088867188 GB (12349.05859375 MB free)
 Uptime: 1384.84 sec
 Load Avg: 1.0 1.06 0.91
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 6:54
  • Package commit: aafb34
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 173.847 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 499.992 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 249.417 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.578 ms (5%) 2.20 MiB (1%) 36870
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.687 s (5%) 477.925 ms 1.49 GiB (1%) 27583827
["JETAnalyzer{BasicPass} top-level", "simple"] 7.738 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 82.344 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 127.771 ms (5%) 43.24 MiB (1%) 812226
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.249 ms (5%) 14.55 MiB (1%) 267529
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 131.966 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.174 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 84.909 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 163.667 ms (5%) 76.19 MiB (1%) 958880
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.851 ms (5%) 16.52 MiB (1%) 285510
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 136.435 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.481 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 119.753 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 416.964 ms (5%) 235.84 MiB (1%) 3470960
["OptAnalyzer", "rand(Bool)"] 21.892 ms (5%) 14.20 MiB (1%) 210823
["OptAnalyzer", "sum(\"julia\") (cached)"] 222.326 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.912 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.547 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.410 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3280 MHz 1908 s 0 s 200 s 5613 s 0 s
 #2 3241 MHz 2268 s 0 s 231 s 5214 s 0 s
 #3 2984 MHz 1979 s 0 s 231 s 5517 s 0 s
 #4 2445 MHz 1548 s 0 s 208 s 5968 s 0 s
 Memory: 15.606491088867188 GB (12383.08984375 MB free)
 Uptime: 775.68 sec
 Load Avg: 1.04 1.02 0.65
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:4
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 173.857 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 543.904 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 244.592 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 31.842 ms (5%) 2.17 MiB (1%) 36439
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.398 s (5%) 467.327 ms 1.48 GiB (1%) 27562177
["JETAnalyzer{BasicPass} top-level", "simple"] 7.624 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 82.805 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 122.889 ms (5%) 43.24 MiB (1%) 812228
["JETAnalyzer{BasicPass}", "rand(Bool)"] 37.383 ms (5%) 14.55 MiB (1%) 267531
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 125.945 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.014 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 81.041 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 159.831 ms (5%) 76.89 MiB (1%) 958941
["JETAnalyzer{SoundPass}", "rand(Bool)"] 40.899 ms (5%) 16.52 MiB (1%) 285512
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 127.709 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.350 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 119.693 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 413.963 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.677 ms (5%) 14.20 MiB (1%) 210825
["OptAnalyzer", "sum(\"julia\") (cached)"] 213.318 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.777 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.415 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 232.655 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3921 s 0 s 368 s 9513 s 0 s
 #2 2747 MHz 3560 s 0 s 374 s 9861 s 0 s
 #3 2445 MHz 3700 s 0 s 396 s 9712 s 0 s
 #4 3241 MHz 3198 s 0 s 373 s 10235 s 0 s
 Memory: 15.606491088867188 GB (12349.05859375 MB free)
 Uptime: 1384.84 sec
 Load Avg: 1.0 1.06 0.91
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:14
  • Baseline: 9 Sep 2024 - 07:24
  • Package commits:
  • Target: 01d5fc
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.00 (5%) 1.01 (1%) ❌
["JETAnalyzer{BasicPass}", "identity(nothing)"] 0.94 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.93 (5%) ✅ 1.00 (1%)
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.97 (5%) 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.91 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "println(QuoteNode(nothing))"] 0.95 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3232 MHz 1955 s 0 s 217 s 6520 s 0 s
 #2 2445 MHz 1806 s 0 s 224 s 6667 s 0 s
 #3 3241 MHz 1701 s 0 s 222 s 6749 s 0 s
 #4 3243 MHz 2331 s 0 s 212 s 6148 s 0 s
 Memory: 15.606491088867188 GB (12397.3125 MB free)
 Uptime: 872.85 sec
 Load Avg: 1.05 1.04 0.69
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3404 s 0 s 365 s 11104 s 0 s
 #2 2445 MHz 2815 s 0 s 397 s 11668 s 0 s
 #3 3244 MHz 4042 s 0 s 386 s 10432 s 0 s
 #4 3197 MHz 4305 s 0 s 368 s 10203 s 0 s
 Memory: 15.606491088867188 GB (12433.08203125 MB free)
 Uptime: 1492.47 sec
 Load Avg: 1.02 1.09 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:14
  • Package commit: 01d5fc
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 181.999 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 565.191 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.217 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.518 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.953 s (5%) 485.916 ms 1.49 GiB (1%) 27583832
["JETAnalyzer{BasicPass} top-level", "simple"] 7.985 ms (5%) 2.02 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 85.848 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 133.930 ms (5%) 43.24 MiB (1%) 812228
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.857 ms (5%) 14.49 MiB (1%) 267529
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.119 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.283 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 91.951 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 170.569 ms (5%) 76.20 MiB (1%) 958885
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.906 ms (5%) 16.45 MiB (1%) 285510
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 141.361 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.821 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 131.324 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 425.903 ms (5%) 235.85 MiB (1%) 3470970
["OptAnalyzer", "rand(Bool)"] 22.188 ms (5%) 14.20 MiB (1%) 210825
["OptAnalyzer", "sum(\"julia\") (cached)"] 226.940 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.149 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.790 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.906 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3232 MHz 1955 s 0 s 217 s 6520 s 0 s
 #2 2445 MHz 1806 s 0 s 224 s 6667 s 0 s
 #3 3241 MHz 1701 s 0 s 222 s 6749 s 0 s
 #4 3243 MHz 2331 s 0 s 212 s 6148 s 0 s
 Memory: 15.606491088867188 GB (12397.3125 MB free)
 Uptime: 872.85 sec
 Load Avg: 1.05 1.04 0.69
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 182.193 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 511.208 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 258.183 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.625 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.216 s (5%) 519.404 ms 1.48 GiB (1%) 27562177
["JETAnalyzer{BasicPass} top-level", "simple"] 7.906 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 90.848 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 138.094 ms (5%) 43.24 MiB (1%) 812228
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.802 ms (5%) 14.55 MiB (1%) 267531
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 151.180 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.385 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 96.088 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 175.438 ms (5%) 77.06 MiB (1%) 958964
["JETAnalyzer{SoundPass}", "rand(Bool)"] 44.646 ms (5%) 16.52 MiB (1%) 285512
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 155.318 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.609 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 135.992 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 448.977 ms (5%) 235.85 MiB (1%) 3470964
["OptAnalyzer", "rand(Bool)"] 22.415 ms (5%) 14.20 MiB (1%) 210825
["OptAnalyzer", "sum(\"julia\") (cached)"] 236.539 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.356 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.789 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 243.899 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3404 s 0 s 365 s 11104 s 0 s
 #2 2445 MHz 2815 s 0 s 397 s 11668 s 0 s
 #3 3244 MHz 4042 s 0 s 386 s 10432 s 0 s
 #4 3197 MHz 4305 s 0 s 368 s 10203 s 0 s
 Memory: 15.606491088867188 GB (12433.08203125 MB free)
 Uptime: 1492.47 sec
 Load Avg: 1.02 1.09 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 9 Sep 2024 - 07:24
  • Baseline: 9 Sep 2024 - 07:34
  • Package commits:
  • Target: 460a32
  • Baseline: 2dfcd4
  • Julia commits:
  • Target: 6f3fdf
  • Baseline: 6f3fdf
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.03 (5%) 1.01 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:24
  • Package commit: 460a32
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 179.215 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 561.847 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 257.098 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 33.268 ms (5%) 2.20 MiB (1%) 36862
["JETAnalyzer{BasicPass} top-level", "self analysis"] 10.036 s (5%) 522.681 ms 1.49 GiB (1%) 27583829
["JETAnalyzer{BasicPass} top-level", "simple"] 8.270 ms (5%) 2.03 MiB (1%) 35538
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.424 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.191 ms (5%) 43.24 MiB (1%) 812230
["JETAnalyzer{BasicPass}", "rand(Bool)"] 39.594 ms (5%) 14.55 MiB (1%) 267533
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 140.995 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.234 ms (5%) 1.87 MiB (1%) 33191
["JETAnalyzer{SoundPass}", "identity(nothing)"] 88.045 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 166.514 ms (5%) 76.20 MiB (1%) 958879
["JETAnalyzer{SoundPass}", "rand(Bool)"] 41.999 ms (5%) 16.52 MiB (1%) 285514
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.689 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.499 ms (5%) 1.96 MiB (1%) 34638
["OptAnalyzer", "identity(nothing)"] 127.269 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 422.898 ms (5%) 235.84 MiB (1%) 3470962
["OptAnalyzer", "rand(Bool)"] 21.966 ms (5%) 14.20 MiB (1%) 210827
["OptAnalyzer", "sum(\"julia\") (cached)"] 233.600 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 11.058 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.705 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 236.470 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 1762 s 0 s 219 s 5557 s 0 s
 #2 2589 MHz 1897 s 0 s 206 s 5421 s 0 s
 #3 3243 MHz 2310 s 0 s 223 s 5007 s 0 s
 #4 2445 MHz 1814 s 0 s 233 s 5490 s 0 s
 Memory: 15.606491088867188 GB (12359.8046875 MB free)
 Uptime: 756.93 sec
 Load Avg: 1.06 1.02 0.66
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 9 Sep 2024 - 7:34
  • Package commit: 2dfcd4
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 177.474 ms (5%) 64.67 KiB (1%) 17
["First-Time-To-JET", "rand(Bool)"] 505.157 ms (5%) 65.08 KiB (1%) 17
["First-Time-To-JET", "sum(\"julia\")"] 255.930 ms (5%) 65.08 KiB (1%) 17
["JETAnalyzer{BasicPass} top-level", "demo"] 32.431 ms (5%) 2.17 MiB (1%) 36431
["JETAnalyzer{BasicPass} top-level", "self analysis"] 9.797 s (5%) 511.330 ms 1.48 GiB (1%) 27562176
["JETAnalyzer{BasicPass} top-level", "simple"] 8.032 ms (5%) 2.03 MiB (1%) 35482
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.813 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 130.067 ms (5%) 43.24 MiB (1%) 812229
["JETAnalyzer{BasicPass}", "rand(Bool)"] 38.791 ms (5%) 14.55 MiB (1%) 267532
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 142.858 μs (5%) 16.30 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 5.202 ms (5%) 1.88 MiB (1%) 33192
["JETAnalyzer{SoundPass}", "identity(nothing)"] 86.553 μs (5%) 7.94 KiB (1%) 113
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 168.073 ms (5%) 76.20 MiB (1%) 958886
["JETAnalyzer{SoundPass}", "rand(Bool)"] 42.798 ms (5%) 16.52 MiB (1%) 285513
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 149.501 μs (5%) 20.02 KiB (1%) 252
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 5.623 ms (5%) 1.95 MiB (1%) 34637
["OptAnalyzer", "identity(nothing)"] 125.525 μs (5%) 25.39 KiB (1%) 362
["OptAnalyzer", "println(QuoteNode(nothing))"] 418.785 ms (5%) 235.84 MiB (1%) 3470961
["OptAnalyzer", "rand(Bool)"] 21.908 ms (5%) 14.20 MiB (1%) 210826
["OptAnalyzer", "sum(\"julia\") (cached)"] 224.582 μs (5%) 56.98 KiB (1%) 774
["OptAnalyzer", "sum(\"julia\")"] 10.824 ms (5%) 6.48 MiB (1%) 96854
["show(::IO, ::JETCallResult)", "report_call"] 4.607 ms (5%) 1.33 MiB (1%) 18166
["show(::IO, ::JETCallResult)", "report_opt"] 234.762 ms (5%) 74.35 MiB (1%) 1141214

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 3372 s 0 s 387 s 9894 s 0 s
 #2 3243 MHz 3521 s 0 s 354 s 9767 s 0 s
 #3 3115 MHz 4579 s 0 s 382 s 8698 s 0 s
 #4 2782 MHz 3001 s 0 s 419 s 10234 s 0 s
 Memory: 15.606491088867188 GB (12251.65625 MB free)
 Uptime: 1369.75 sec
 Load Avg: 1.05 1.12 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@aviatesk aviatesk force-pushed the avi/select_statements-again branch 6 times, most recently from 406fa38 to 66effba Compare September 10, 2024 09:20
@aviatesk
implement a better statement selection logic
b9a42a7 
Specifically, this commit aims to review the implementation of
`add_control_flow!` and improves its accuracy. Ideally, it should pass
JET's existing test cases as well as the newly added ones, including the
test cases from JuliaDebug/LoweredCodeUtils.jl#99. The goal is to share
the same high-precision CFG selection logic between LoweredCodeUtils
and JET.

The new algorithm is based on what was proposed in [^Wei84]. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
**INFL** in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be short-circuited
from the conditional branch to the nearest common post-dominator.

COMBAK: It is important to note that in Julia's IR (`CodeInfo`),
"short-circuiting" a specific code region is not a simple task. Simply
ignoring the path to the post-dominator does not guarantee fall-through
to the post-dominator. Therefore, a more careful implementation is
required for this aspect.

[Wei84]: M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984.
@aviatesk aviatesk force-pushed the avi/select_statements-again branch from 66effba to b9a42a7 Compare September 10, 2024 09:25
@aviatesk aviatesk changed the title wip: implement a better statement selection logic implement a better statement selection logic Sep 10, 2024
@aviatesk
Copy link
Owner Author

I finally feel like I've implemented a really good algorithm. I’ve confirmed that even if we backport the code implemented in this PR to LCU, the LCU test cases still pass.

@aviatesk aviatesk merged commit 7596848 into master Sep 10, 2024
9 of 11 checks passed
@aviatesk aviatesk deleted the avi/select_statements-again branch September 10, 2024 09:35
aviatesk added a commit to JuliaDebug/LoweredCodeUtils.jl that referenced this pull request Sep 10, 2024
@aviatesk
switch to a new CFG selection logic
96a2a21 
This commit aims to port the new CFG selection logic implemented in
aviatesk/JET.jl#654 to LCU, so that it can be shared between LCU and JET.

The new algorithm is based on what was proposed in [Wei84][^Wei84]. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
"𝑰𝑵𝑭𝑳" in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be
short-circuited[^short-circuit] from the conditional branch to the
nearest common post-dominator.

Regarding the `GotoNode`, it is now marked only for active blocks after
all requirements have converged, rather than marking it inside the
`add_loop!` or such. This approach eliminates the need to add
unnecessary blocks inside the loop, and the need to use `add_loop!`
while allowing the required CFG to be executed safely.

[^Wei84]: M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984. https://ieeexplore.ieee.org/document/5010248
[^short-circuit]: It is important to note that in Julia's IR (`CodeInfo`),
  "short-circuiting" a specific code region is not a simple task. Simply
  ignoring the path to the post-dominator does not guarantee fall-through
  to the post-dominator. Therefore, a more careful implementation is
  required for this aspect.
@aviatesk aviatesk mentioned this pull request Sep 10, 2024
Merged
aviatesk added a commit to JuliaDebug/LoweredCodeUtils.jl that referenced this pull request Sep 10, 2024
@aviatesk
switch to a new CFG selection logic
66aeae9 
This commit aims to port the new CFG selection logic implemented in
aviatesk/JET.jl#654 to LCU, so that it can be shared between LCU and JET.

The new algorithm is based on what was proposed in [Wei84][^Wei84]. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
"𝑰𝑵𝑭𝑳" in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be
short-circuited[^short-circuit] from the conditional branch to the
nearest common post-dominator.

Regarding the `GotoNode`, it is now marked only for active blocks after
all requirements have converged, rather than marking it inside the
`add_loop!` or such. This approach eliminates the need to add
unnecessary blocks inside the loop, and the need to use `add_loop!`
while allowing the required CFG to be executed safely.

[^Wei84]: M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984. https://ieeexplore.ieee.org/document/5010248

[^short-circuit]: It is important to note that in Julia's IR (`CodeInfo`),
  "short-circuiting" a specific code region is not a simple task. Simply
  ignoring the path to the post-dominator does not guarantee fall-through
  to the post-dominator. Therefore, a more careful implementation is
  required for this aspect.
aviatesk added a commit to JuliaDebug/LoweredCodeUtils.jl that referenced this pull request Sep 10, 2024
@aviatesk
switch to a new CFG selection logic
4c0028e 
This commit aims to port the new CFG selection logic implemented in
aviatesk/JET.jl#654 to LCU, so that it can be shared between LCU and JET.

The new algorithm is based on what was proposed in [Wei84][^Wei84]. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
"𝑰𝑵𝑭𝑳" in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be
short-circuited[^short-circuit] from the conditional branch to the
nearest common post-dominator.

Regarding the `GotoNode`, it is now marked only for active blocks after
all requirements have converged, rather than marking it inside the
`add_loop!` or such. This approach eliminates the need to add
unnecessary blocks inside the loop, and the need to use `add_loop!`
while allowing the required CFG to be executed safely.

[^Wei84]: M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984. https://ieeexplore.ieee.org/document/5010248

[^short-circuit]: It is important to note that in Julia's IR (`CodeInfo`),
  "short-circuiting" a specific code region is not a simple task. Simply
  ignoring the path to the post-dominator does not guarantee fall-through
  to the post-dominator. Therefore, a more careful implementation is
  required for this aspect.
aviatesk added a commit that referenced this pull request Sep 10, 2024
@aviatesk
some follow up on #654
1d08755
aviatesk added a commit to JuliaDebug/LoweredCodeUtils.jl that referenced this pull request Sep 10, 2024
@aviatesk
switch to a new CFG selection logic
81db250 
This commit aims to port the new CFG selection logic implemented in
aviatesk/JET.jl#654 to LCU, so that it can be shared between LCU and JET.

The new algorithm is based on what was proposed in [Wei84][^Wei84]. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
"𝑰𝑵𝑭𝑳" in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be
short-circuited[^short-circuit] from the conditional branch to the
nearest common post-dominator.

Regarding the `GotoNode`, it is now marked only for active blocks after
all requirements have converged, rather than marking it inside the
`add_loop!` or such. This approach eliminates the need to add
unnecessary blocks inside the loop, and the need to use `add_loop!`
while allowing the required CFG to be executed safely.

[^Wei84]: M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984. https://ieeexplore.ieee.org/document/5010248

[^short-circuit]: It is important to note that in Julia's IR (`CodeInfo`),
  "short-circuiting" a specific code region is not a simple task. Simply
  ignoring the path to the post-dominator does not guarantee fall-through
  to the post-dominator. Therefore, a more careful implementation is
  required for this aspect.
aviatesk added a commit to JuliaDebug/LoweredCodeUtils.jl that referenced this pull request Sep 10, 2024
@aviatesk
switch to a new CFG selection logic
1a398ab 
This commit aims to port the new CFG selection logic implemented in
aviatesk/JET.jl#654 to LCU, so that it can be shared between LCU and JET.

The new algorithm is based on what was proposed in [Wei84][^Wei84]. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
"𝑰𝑵𝑭𝑳" in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be
short-circuited[^short-circuit] from the conditional branch to the
nearest common post-dominator.

Regarding the `GotoNode`, it is now marked only for active blocks after
all requirements have converged, rather than marking it inside the
`add_loop!` or such. This approach eliminates the need to add
unnecessary blocks inside the loop, and the need to use `add_loop!`
while allowing the required CFG to be executed safely.

[^Wei84]: M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984. https://ieeexplore.ieee.org/document/5010248

[^short-circuit]: It is important to note that in Julia's IR (`CodeInfo`),
  "short-circuiting" a specific code region is not a simple task. Simply
  ignoring the path to the post-dominator does not guarantee fall-through
  to the post-dominator. Therefore, a more careful implementation is
  required for this aspect.
aviatesk added a commit to JuliaDebug/LoweredCodeUtils.jl that referenced this pull request Sep 11, 2024
@aviatesk
switch to a new CFG selection logic (#116)
969e7c9 
* switch to a new CFG selection logic

This commit aims to port the new CFG selection logic implemented in
aviatesk/JET.jl#654 to LCU, so that it can be shared between LCU and JET.

The new algorithm is based on what was proposed in [Wei84][^Wei84]. If there is
even one active block in the blocks reachable from a conditional branch
up to its successors' nearest common post-dominator (referred to as
"𝑰𝑵𝑭𝑳" in the paper), it is necessary to follow that conditional
branch and execute the code. Otherwise, execution can be
short-circuited[^short-circuit] from the conditional branch to the
nearest common post-dominator.

Regarding the `GotoNode`, it is now marked only for active blocks after
all requirements have converged, rather than marking it inside the
`add_loop!` or such. This approach eliminates the need to add
unnecessary blocks inside the loop, and the need to use `add_loop!`
while allowing the required CFG to be executed safely.

[^Wei84]: M. Weiser, "Program Slicing," IEEE Transactions on Software Engineering, 10, pages 352-357, July 1984. https://ieeexplore.ieee.org/document/5010248

[^short-circuit]: It is important to note that in Julia's IR (`CodeInfo`),
  "short-circuiting" a specific code region is not a simple task. Simply
  ignoring the path to the post-dominator does not guarantee fall-through
  to the post-dominator. Therefore, a more careful implementation is
  required for this aspect.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@aviatesk