Port perf/benchmark_matrix_ops.jl to benchmark/*.jl #742

tkf · 2020-02-20T02:25:27Z

This PR adds benchmark/bench_matrix_ops.jl which is a straight-forward port of perf/benchmark_matrix_ops.jl.

benchmark/bench_matrix_ops.jl

github-actions · 2020-02-20T03:08:16Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmarks:
- Target: 20 Feb 2020 - 03:05
- Baseline: 20 Feb 2020 - 03:08
Package commits:
- Target: 00b6e8
- Baseline: c3686c
Julia commits:
- Target: 2d5741
- Baseline: 2d5741
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["qr", "S=1", "SMatrix"]`	0.84 (5%) ✅	1.00 (1%)
`["qr", "S=11", "Matrix"]`	1.13 (5%) ❌	1.00 (1%)
`["qr", "S=11", "SMatrix"]`	1.05 (5%) ❌	1.00 (1%)
`["qr", "S=12", "SMatrix"]`	0.86 (5%) ✅	1.00 (1%)
`["qr", "S=13", "Matrix"]`	0.92 (5%) ✅	1.00 (1%)
`["qr", "S=14", "Matrix"]`	1.08 (5%) ❌	1.00 (1%)
`["qr", "S=14", "SMatrix"]`	0.92 (5%) ✅	1.00 (1%)
`["qr", "S=15", "SMatrix"]`	0.87 (5%) ✅	1.00 (1%)
`["qr", "S=2", "Matrix"]`	0.95 (5%) ✅	1.00 (1%)
`["qr", "S=6", "Matrix"]`	0.85 (5%) ✅	1.00 (1%)
`["qr", "S=7", "Matrix"]`	0.94 (5%) ✅	1.00 (1%)
`["qr", "S=9", "Matrix"]`	1.05 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      58859 s          0 s       3963 s      10948 s          0 s
       #2  2095 MHz      17766 s          0 s       8397 s      47190 s          0 s
       
  Memory: 6.782741546630859 GB (3242.86328125 MB free)
  Uptime: 752.0 sec
  Load Avg:  1.17626953125  1.181640625  0.7548828125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      60010 s          0 s       4578 s      26762 s          0 s
       #2  2095 MHz      34468 s          0 s       8614 s      47848 s          0 s
       
  Memory: 6.782741546630859 GB (3466.953125 MB free)
  Uptime: 928.0 sec
  Load Avg:  1.01904296875  1.1064453125  0.8115234375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Target result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmark: 20 Feb 2020 - 3:5
Package commit: 00b6e8
Julia commit: 2d5741
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["matrix_ops", "*", "1", "Matrix"]`	151.268 ns (5%)	96 bytes (1%)	1
`["matrix_ops", "*", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "10", "Matrix"]`	364.037 ns (5%)	896 bytes (1%)	1
`["matrix_ops", "*", "10", "SMatrix"]`	145.112 ns (5%)
`["matrix_ops", "*", "2", "Matrix"]`	35.861 ns (5%)	112 bytes (1%)	1
`["matrix_ops", "*", "2", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "20", "Matrix"]`	1.440 μs (5%)	3.25 KiB (1%)	1
`["matrix_ops", "*", "20", "SMatrix"]`	635.149 ns (5%)
`["matrix_ops", "*", "3", "Matrix"]`	43.885 ns (5%)	160 bytes (1%)	1
`["matrix_ops", "*", "3", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "4", "Matrix"]`	170.970 ns (5%)	208 bytes (1%)	1
`["matrix_ops", "*", "4", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "\\", "1", "Matrix"]`	84.323 ns (5%)	208 bytes (1%)	3
`["matrix_ops", "\\", "1", "SMatrix"]`	1.600 ns (5%)
`["matrix_ops", "\\", "10", "Matrix"]`	3.688 μs (5%)	1.94 KiB (1%)	4
`["matrix_ops", "\\", "10", "SMatrix"]`	1.180 μs (5%)
`["matrix_ops", "\\", "2", "Matrix"]`	1.620 μs (5%)	352 bytes (1%)	4
`["matrix_ops", "\\", "2", "SMatrix"]`	3.400 ns (5%)
`["matrix_ops", "\\", "20", "Matrix"]`	10.600 μs (5%)	6.77 KiB (1%)	4
`["matrix_ops", "\\", "20", "SMatrix"]`	11.500 μs (5%)	10.02 KiB (1%)	5
`["matrix_ops", "\\", "3", "Matrix"]`	1.878 μs (5%)	464 bytes (1%)	4
`["matrix_ops", "\\", "3", "SMatrix"]`	16.650 ns (5%)
`["matrix_ops", "\\", "4", "Matrix"]`	1.767 μs (5%)	560 bytes (1%)	4
`["matrix_ops", "\\", "4", "SMatrix"]`	148.856 ns (5%)
`["matrix_ops", "det", "1", "Matrix"]`	42.341 ns (5%)	112 bytes (1%)	2
`["matrix_ops", "det", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "10", "Matrix"]`	879.283 ns (5%)	1.06 KiB (1%)	3
`["matrix_ops", "det", "10", "SMatrix"]`	463.472 ns (5%)
`["matrix_ops", "det", "2", "Matrix"]`	180.151 ns (5%)	240 bytes (1%)	3
`["matrix_ops", "det", "2", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "20", "Matrix"]`	6.450 μs (5%)	3.52 KiB (1%)	3
`["matrix_ops", "det", "20", "SMatrix"]`	6.867 μs (5%)	6.77 KiB (1%)	4
`["matrix_ops", "det", "3", "Matrix"]`	224.112 ns (5%)	304 bytes (1%)	3
`["matrix_ops", "det", "3", "SMatrix"]`	1.900 ns (5%)
`["matrix_ops", "det", "4", "Matrix"]`	281.095 ns (5%)	352 bytes (1%)	3
`["matrix_ops", "det", "4", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "exp", "1", "Matrix"]`	766.705 ns (5%)	1.69 KiB (1%)	20
`["matrix_ops", "exp", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "exp", "10", "Matrix"]`	9.100 μs (5%)	14.50 KiB (1%)	19
`["matrix_ops", "exp", "10", "SMatrix"]`	3.113 μs (5%)
`["matrix_ops", "exp", "2", "Matrix"]`	2.950 μs (5%)	3.52 KiB (1%)	32
`["matrix_ops", "exp", "2", "SMatrix"]`	51.631 ns (5%)
`["matrix_ops", "exp", "20", "Matrix"]`	31.501 μs (5%)	55.91 KiB (1%)	20
`["matrix_ops", "exp", "20", "SMatrix"]`	290.514 μs (5%)	10.02 KiB (1%)	5
`["matrix_ops", "exp", "3", "Matrix"]`	3.413 μs (5%)	4.91 KiB (1%)	32
`["matrix_ops", "exp", "3", "SMatrix"]`	122.486 ns (5%)
`["matrix_ops", "exp", "4", "Matrix"]`	3.972 μs (5%)	3.25 KiB (1%)	17
`["matrix_ops", "exp", "4", "SMatrix"]`	302.004 ns (5%)
`["matrix_ops", "inv", "1", "Matrix"]`	149.461 ns (5%)	96 bytes (1%)	1
`["matrix_ops", "inv", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "10", "Matrix"]`	2.022 μs (5%)	6.22 KiB (1%)	5
`["matrix_ops", "inv", "10", "SMatrix"]`	1.220 μs (5%)
`["matrix_ops", "inv", "2", "Matrix"]`	437.394 ns (5%)	1.39 KiB (1%)	5
`["matrix_ops", "inv", "2", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "20", "Matrix"]`	9.900 μs (5%)	13.67 KiB (1%)	5
`["matrix_ops", "inv", "20", "SMatrix"]`	10.400 μs (5%)	16.92 KiB (1%)	6
`["matrix_ops", "inv", "3", "Matrix"]`	555.102 ns (5%)	1.98 KiB (1%)	5
`["matrix_ops", "inv", "3", "SMatrix"]`	7.800 ns (5%)
`["matrix_ops", "inv", "4", "Matrix"]`	821.212 ns (5%)	2.50 KiB (1%)	5
`["matrix_ops", "inv", "4", "SMatrix"]`	0.001 ns (5%)
`["qr", "S=1", "Matrix"]`	101.801 ns (5%)	320 bytes (1%)	4
`["qr", "S=1", "SMatrix"]`	1.600 ns (5%)
`["qr", "S=10", "Matrix"]`	9.700 μs (5%)	2.66 KiB (1%)	4
`["qr", "S=10", "SMatrix"]`	689.823 ns (5%)
`["qr", "S=11", "Matrix"]`	12.600 μs (5%)	3.22 KiB (1%)	4
`["qr", "S=11", "SMatrix"]`	1.030 μs (5%)
`["qr", "S=12", "Matrix"]`	12.600 μs (5%)	3.69 KiB (1%)	4
`["qr", "S=12", "SMatrix"]`	1.180 μs (5%)
`["qr", "S=13", "Matrix"]`	14.101 μs (5%)	4.39 KiB (1%)	4
`["qr", "S=13", "SMatrix"]`	1.660 μs (5%)
`["qr", "S=14", "Matrix"]`	16.800 μs (5%)	5.33 KiB (1%)	4
`["qr", "S=14", "SMatrix"]`	1.940 μs (5%)
`["qr", "S=15", "Matrix"]`	16.100 μs (5%)	5.98 KiB (1%)	4
`["qr", "S=15", "SMatrix"]`	2.800 μs (5%)
`["qr", "S=16", "Matrix"]`	27.601 μs (5%)	6.41 KiB (1%)	4
`["qr", "S=16", "SMatrix"]`	3.488 μs (5%)
`["qr", "S=17", "Matrix"]`	30.101 μs (5%)	7.34 KiB (1%)	4
`["qr", "S=17", "SMatrix"]`	39.902 μs (5%)	19.56 KiB (1%)	10
`["qr", "S=18", "Matrix"]`	31.501 μs (5%)	8.09 KiB (1%)	4
`["qr", "S=18", "SMatrix"]`	43.102 μs (5%)	21.56 KiB (1%)	10
`["qr", "S=19", "Matrix"]`	33.102 μs (5%)	9.03 KiB (1%)	4
`["qr", "S=19", "SMatrix"]`	45.502 μs (5%)	24.06 KiB (1%)	10
`["qr", "S=2", "Matrix"]`	985.714 ns (5%)	368 bytes (1%)	4
`["qr", "S=2", "SMatrix"]`	8.909 ns (5%)
`["qr", "S=20", "Matrix"]`	35.101 μs (5%)	9.78 KiB (1%)	4
`["qr", "S=20", "SMatrix"]`	47.702 μs (5%)	26.06 KiB (1%)	10
`["qr", "S=21", "Matrix"]`	37.201 μs (5%)	10.91 KiB (1%)	4
`["qr", "S=21", "SMatrix"]`	51.002 μs (5%)	29.06 KiB (1%)	10
`["qr", "S=22", "Matrix"]`	38.702 μs (5%)	11.84 KiB (1%)	4
`["qr", "S=22", "SMatrix"]`	53.002 μs (5%)	31.56 KiB (1%)	10
`["qr", "S=3", "Matrix"]`	1.910 μs (5%)	512 bytes (1%)	4
`["qr", "S=3", "SMatrix"]`	31.591 ns (5%)
`["qr", "S=4", "Matrix"]`	2.933 μs (5%)	656 bytes (1%)	4
`["qr", "S=4", "SMatrix"]`	57.479 ns (5%)
`["qr", "S=5", "Matrix"]`	3.925 μs (5%)	896 bytes (1%)	4
`["qr", "S=5", "SMatrix"]`	132.520 ns (5%)
`["qr", "S=6", "Matrix"]`	5.050 μs (5%)	1.11 KiB (1%)	4
`["qr", "S=6", "SMatrix"]`	182.386 ns (5%)
`["qr", "S=7", "Matrix"]`	6.040 μs (5%)	1.48 KiB (1%)	4
`["qr", "S=7", "SMatrix"]`	269.951 ns (5%)
`["qr", "S=8", "Matrix"]`	7.225 μs (5%)	1.86 KiB (1%)	4
`["qr", "S=8", "SMatrix"]`	304.812 ns (5%)
`["qr", "S=9", "Matrix"]`	8.900 μs (5%)	2.19 KiB (1%)	4
`["qr", "S=9", "SMatrix"]`	521.482 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["matrix_ops", "*", "1"]
["matrix_ops", "*", "10"]
["matrix_ops", "*", "2"]
["matrix_ops", "*", "20"]
["matrix_ops", "*", "3"]
["matrix_ops", "*", "4"]
["matrix_ops", "\\", "1"]
["matrix_ops", "\\", "10"]
["matrix_ops", "\\", "2"]
["matrix_ops", "\\", "20"]
["matrix_ops", "\\", "3"]
["matrix_ops", "\\", "4"]
["matrix_ops", "det", "1"]
["matrix_ops", "det", "10"]
["matrix_ops", "det", "2"]
["matrix_ops", "det", "20"]
["matrix_ops", "det", "3"]
["matrix_ops", "det", "4"]
["matrix_ops", "exp", "1"]
["matrix_ops", "exp", "10"]
["matrix_ops", "exp", "2"]
["matrix_ops", "exp", "20"]
["matrix_ops", "exp", "3"]
["matrix_ops", "exp", "4"]
["matrix_ops", "inv", "1"]
["matrix_ops", "inv", "10"]
["matrix_ops", "inv", "2"]
["matrix_ops", "inv", "20"]
["matrix_ops", "inv", "3"]
["matrix_ops", "inv", "4"]
["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      58859 s          0 s       3963 s      10948 s          0 s
       #2  2095 MHz      17766 s          0 s       8397 s      47190 s          0 s
       
  Memory: 6.782741546630859 GB (3242.86328125 MB free)
  Uptime: 752.0 sec
  Load Avg:  1.17626953125  1.181640625  0.7548828125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmark: 20 Feb 2020 - 3:8
Package commit: c3686c
Julia commit: 2d5741
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["qr", "S=1", "Matrix"]`	98.629 ns (5%)	320 bytes (1%)	4
`["qr", "S=1", "SMatrix"]`	1.900 ns (5%)
`["qr", "S=10", "Matrix"]`	9.700 μs (5%)	2.66 KiB (1%)	4
`["qr", "S=10", "SMatrix"]`	702.061 ns (5%)
`["qr", "S=11", "Matrix"]`	11.200 μs (5%)	3.22 KiB (1%)	4
`["qr", "S=11", "SMatrix"]`	980.000 ns (5%)
`["qr", "S=12", "Matrix"]`	12.600 μs (5%)	3.69 KiB (1%)	4
`["qr", "S=12", "SMatrix"]`	1.380 μs (5%)
`["qr", "S=13", "Matrix"]`	15.400 μs (5%)	4.39 KiB (1%)	4
`["qr", "S=13", "SMatrix"]`	1.740 μs (5%)
`["qr", "S=14", "Matrix"]`	15.500 μs (5%)	5.33 KiB (1%)	4
`["qr", "S=14", "SMatrix"]`	2.120 μs (5%)
`["qr", "S=15", "Matrix"]`	16.301 μs (5%)	5.98 KiB (1%)	4
`["qr", "S=15", "SMatrix"]`	3.222 μs (5%)
`["qr", "S=16", "Matrix"]`	27.901 μs (5%)	6.41 KiB (1%)	4
`["qr", "S=16", "SMatrix"]`	3.550 μs (5%)
`["qr", "S=17", "Matrix"]`	29.801 μs (5%)	7.34 KiB (1%)	4
`["qr", "S=17", "SMatrix"]`	40.401 μs (5%)	19.56 KiB (1%)	10
`["qr", "S=18", "Matrix"]`	31.901 μs (5%)	8.09 KiB (1%)	4
`["qr", "S=18", "SMatrix"]`	42.802 μs (5%)	21.56 KiB (1%)	10
`["qr", "S=19", "Matrix"]`	33.701 μs (5%)	9.03 KiB (1%)	4
`["qr", "S=19", "SMatrix"]`	45.401 μs (5%)	24.06 KiB (1%)	10
`["qr", "S=2", "Matrix"]`	1.043 μs (5%)	368 bytes (1%)	4
`["qr", "S=2", "SMatrix"]`	8.909 ns (5%)
`["qr", "S=20", "Matrix"]`	35.001 μs (5%)	9.78 KiB (1%)	4
`["qr", "S=20", "SMatrix"]`	48.402 μs (5%)	26.06 KiB (1%)	10
`["qr", "S=21", "Matrix"]`	37.401 μs (5%)	10.91 KiB (1%)	4
`["qr", "S=21", "SMatrix"]`	51.402 μs (5%)	29.06 KiB (1%)	10
`["qr", "S=22", "Matrix"]`	39.001 μs (5%)	11.84 KiB (1%)	4
`["qr", "S=22", "SMatrix"]`	53.502 μs (5%)	31.56 KiB (1%)	10
`["qr", "S=3", "Matrix"]`	1.970 μs (5%)	512 bytes (1%)	4
`["qr", "S=3", "SMatrix"]`	33.203 ns (5%)
`["qr", "S=4", "Matrix"]`	3.033 μs (5%)	656 bytes (1%)	4
`["qr", "S=4", "SMatrix"]`	57.376 ns (5%)
`["qr", "S=5", "Matrix"]`	4.013 μs (5%)	896 bytes (1%)	4
`["qr", "S=5", "SMatrix"]`	131.906 ns (5%)
`["qr", "S=6", "Matrix"]`	5.934 μs (5%)	1.11 KiB (1%)	4
`["qr", "S=6", "SMatrix"]`	184.457 ns (5%)
`["qr", "S=7", "Matrix"]`	6.441 μs (5%)	1.48 KiB (1%)	4
`["qr", "S=7", "SMatrix"]`	264.755 ns (5%)
`["qr", "S=8", "Matrix"]`	7.275 μs (5%)	1.86 KiB (1%)	4
`["qr", "S=8", "SMatrix"]`	305.608 ns (5%)
`["qr", "S=9", "Matrix"]`	8.468 μs (5%)	2.19 KiB (1%)	4
`["qr", "S=9", "SMatrix"]`	522.571 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      60010 s          0 s       4578 s      26762 s          0 s
       #2  2095 MHz      34468 s          0 s       8614 s      47848 s          0 s
       
  Memory: 6.782741546630859 GB (3466.953125 MB free)
  Uptime: 928.0 sec
  Load Avg:  1.01904296875  1.1064453125  0.8115234375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.193
BogoMIPS:            4190.38
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

github-actions · 2020-02-20T03:20:21Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmarks:
- Target: 20 Feb 2020 - 03:17
- Baseline: 20 Feb 2020 - 03:20
Package commits:
- Target: 49436a
- Baseline: c3686c
Julia commits:
- Target: 2d5741
- Baseline: 2d5741
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["qr", "S=1", "Matrix"]`	1.18 (5%) ❌	1.00 (1%)
`["qr", "S=10", "SMatrix"]`	1.12 (5%) ❌	1.00 (1%)
`["qr", "S=11", "Matrix"]`	1.11 (5%) ❌	1.00 (1%)
`["qr", "S=11", "SMatrix"]`	1.13 (5%) ❌	1.00 (1%)
`["qr", "S=12", "Matrix"]`	1.11 (5%) ❌	1.00 (1%)
`["qr", "S=12", "SMatrix"]`	1.12 (5%) ❌	1.00 (1%)
`["qr", "S=13", "Matrix"]`	1.12 (5%) ❌	1.00 (1%)
`["qr", "S=13", "SMatrix"]`	1.13 (5%) ❌	1.00 (1%)
`["qr", "S=14", "Matrix"]`	1.10 (5%) ❌	1.00 (1%)
`["qr", "S=15", "Matrix"]`	1.21 (5%) ❌	1.00 (1%)
`["qr", "S=15", "SMatrix"]`	1.13 (5%) ❌	1.00 (1%)
`["qr", "S=16", "Matrix"]`	1.23 (5%) ❌	1.00 (1%)
`["qr", "S=17", "SMatrix"]`	1.08 (5%) ❌	1.00 (1%)
`["qr", "S=18", "Matrix"]`	1.13 (5%) ❌	1.00 (1%)
`["qr", "S=18", "SMatrix"]`	1.07 (5%) ❌	1.00 (1%)
`["qr", "S=19", "Matrix"]`	1.11 (5%) ❌	1.00 (1%)
`["qr", "S=19", "SMatrix"]`	1.10 (5%) ❌	1.00 (1%)
`["qr", "S=20", "Matrix"]`	1.12 (5%) ❌	1.00 (1%)
`["qr", "S=20", "SMatrix"]`	1.08 (5%) ❌	1.00 (1%)
`["qr", "S=21", "Matrix"]`	1.10 (5%) ❌	1.00 (1%)
`["qr", "S=22", "Matrix"]`	1.10 (5%) ❌	1.00 (1%)
`["qr", "S=22", "SMatrix"]`	1.09 (5%) ❌	1.00 (1%)
`["qr", "S=4", "Matrix"]`	1.10 (5%) ❌	1.00 (1%)
`["qr", "S=4", "SMatrix"]`	1.16 (5%) ❌	1.00 (1%)
`["qr", "S=6", "SMatrix"]`	0.77 (5%) ✅	1.00 (1%)
`["qr", "S=8", "Matrix"]`	1.19 (5%) ❌	1.00 (1%)
`["qr", "S=9", "Matrix"]`	0.84 (5%) ✅	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz     127407 s          0 s      12593 s      63552 s          0 s
       #2  2095 MHz      86713 s          0 s      16585 s     101170 s          0 s
       
  Memory: 6.782733917236328 GB (2398.703125 MB free)
  Uptime: 2063.0 sec
  Load Avg:  1.232421875  1.20751953125  1.10107421875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz     143602 s          0 s      12818 s      64662 s          0 s
       #2  2095 MHz      88271 s          0 s      17175 s     116517 s          0 s
       
  Memory: 6.782733917236328 GB (3315.83984375 MB free)
  Uptime: 2239.0 sec
  Load Avg:  1.1337890625  1.1630859375  1.09228515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Target result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmark: 20 Feb 2020 - 3:17
Package commit: 49436a
Julia commit: 2d5741
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["matrix_ops", "*", "1", "Matrix"]`	179.437 ns (5%)	96 bytes (1%)	1
`["matrix_ops", "*", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "10", "Matrix"]`	430.308 ns (5%)	896 bytes (1%)	1
`["matrix_ops", "*", "10", "SMatrix"]`	148.690 ns (5%)
`["matrix_ops", "*", "11", "Matrix"]`	567.030 ns (5%)	1.06 KiB (1%)	1
`["matrix_ops", "*", "11", "SMatrix"]`	234.355 ns (5%)
`["matrix_ops", "*", "12", "Matrix"]`	522.638 ns (5%)	1.22 KiB (1%)	1
`["matrix_ops", "*", "12", "SMatrix"]`	298.943 ns (5%)
`["matrix_ops", "*", "13", "Matrix"]`	656.576 ns (5%)	1.45 KiB (1%)	1
`["matrix_ops", "*", "13", "SMatrix"]`	430.713 ns (5%)
`["matrix_ops", "*", "14", "Matrix"]`	788.740 ns (5%)	1.77 KiB (1%)	1
`["matrix_ops", "*", "14", "SMatrix"]`	586.554 ns (5%)
`["matrix_ops", "*", "15", "Matrix"]`	995.778 ns (5%)	1.98 KiB (1%)	1
`["matrix_ops", "*", "15", "SMatrix"]`	536.529 ns (5%)
`["matrix_ops", "*", "16", "Matrix"]`	983.375 ns (5%)	2.13 KiB (1%)	1
`["matrix_ops", "*", "16", "SMatrix"]`	268.214 ns (5%)
`["matrix_ops", "*", "17", "Matrix"]`	1.400 μs (5%)	2.44 KiB (1%)	1
`["matrix_ops", "*", "17", "SMatrix"]`	758.732 ns (5%)
`["matrix_ops", "*", "18", "Matrix"]`	1.550 μs (5%)	2.69 KiB (1%)	1
`["matrix_ops", "*", "18", "SMatrix"]`	691.696 ns (5%)
`["matrix_ops", "*", "19", "Matrix"]`	1.840 μs (5%)	3.00 KiB (1%)	1
`["matrix_ops", "*", "19", "SMatrix"]`	1.043 μs (5%)
`["matrix_ops", "*", "2", "Matrix"]`	43.853 ns (5%)	112 bytes (1%)	1
`["matrix_ops", "*", "2", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "20", "Matrix"]`	1.770 μs (5%)	3.25 KiB (1%)	1
`["matrix_ops", "*", "20", "SMatrix"]`	707.722 ns (5%)
`["matrix_ops", "*", "3", "Matrix"]`	48.233 ns (5%)	160 bytes (1%)	1
`["matrix_ops", "*", "3", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "4", "Matrix"]`	202.697 ns (5%)	208 bytes (1%)	1
`["matrix_ops", "*", "4", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "5", "Matrix"]`	237.597 ns (5%)	288 bytes (1%)	1
`["matrix_ops", "*", "5", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "6", "Matrix"]`	253.694 ns (5%)	368 bytes (1%)	1
`["matrix_ops", "*", "6", "SMatrix"]`	50.456 ns (5%)
`["matrix_ops", "*", "7", "Matrix"]`	306.540 ns (5%)	496 bytes (1%)	1
`["matrix_ops", "*", "7", "SMatrix"]`	79.819 ns (5%)
`["matrix_ops", "*", "8", "Matrix"]`	285.587 ns (5%)	624 bytes (1%)	1
`["matrix_ops", "*", "8", "SMatrix"]`	22.569 ns (5%)
`["matrix_ops", "*", "9", "Matrix"]`	379.129 ns (5%)	736 bytes (1%)	1
`["matrix_ops", "*", "9", "SMatrix"]`	90.407 ns (5%)
`["matrix_ops", "\\", "1", "Matrix"]`	101.979 ns (5%)	208 bytes (1%)	3
`["matrix_ops", "\\", "1", "SMatrix"]`	2.200 ns (5%)
`["matrix_ops", "\\", "10", "Matrix"]`	4.050 μs (5%)	1.94 KiB (1%)	4
`["matrix_ops", "\\", "10", "SMatrix"]`	1.380 μs (5%)
`["matrix_ops", "\\", "11", "Matrix"]`	4.757 μs (5%)	2.33 KiB (1%)	4
`["matrix_ops", "\\", "11", "SMatrix"]`	1.740 μs (5%)
`["matrix_ops", "\\", "12", "Matrix"]`	5.043 μs (5%)	2.64 KiB (1%)	4
`["matrix_ops", "\\", "12", "SMatrix"]`	2.240 μs (5%)
`["matrix_ops", "\\", "13", "Matrix"]`	5.686 μs (5%)	3.13 KiB (1%)	4
`["matrix_ops", "\\", "13", "SMatrix"]`	2.867 μs (5%)
`["matrix_ops", "\\", "14", "Matrix"]`	5.750 μs (5%)	3.75 KiB (1%)	4
`["matrix_ops", "\\", "14", "SMatrix"]`	3.713 μs (5%)
`["matrix_ops", "\\", "15", "Matrix"]`	6.984 μs (5%)	4.20 KiB (1%)	4
`["matrix_ops", "\\", "15", "SMatrix"]`	6.680 μs (5%)	6.19 KiB (1%)	5
`["matrix_ops", "\\", "16", "Matrix"]`	6.720 μs (5%)	4.48 KiB (1%)	4
`["matrix_ops", "\\", "16", "SMatrix"]`	7.350 μs (5%)	6.61 KiB (1%)	5
`["matrix_ops", "\\", "17", "Matrix"]`	7.726 μs (5%)	5.13 KiB (1%)	4
`["matrix_ops", "\\", "17", "SMatrix"]`	7.834 μs (5%)	7.56 KiB (1%)	5
`["matrix_ops", "\\", "18", "Matrix"]`	10.700 μs (5%)	5.63 KiB (1%)	4
`["matrix_ops", "\\", "18", "SMatrix"]`	11.400 μs (5%)	8.31 KiB (1%)	5
`["matrix_ops", "\\", "19", "Matrix"]`	10.900 μs (5%)	6.27 KiB (1%)	4
`["matrix_ops", "\\", "19", "SMatrix"]`	12.500 μs (5%)	9.27 KiB (1%)	5
`["matrix_ops", "\\", "2", "Matrix"]`	1.590 μs (5%)	352 bytes (1%)	4
`["matrix_ops", "\\", "2", "SMatrix"]`	3.000 ns (5%)
`["matrix_ops", "\\", "20", "Matrix"]`	10.901 μs (5%)	6.77 KiB (1%)	4
`["matrix_ops", "\\", "20", "SMatrix"]`	11.401 μs (5%)	10.02 KiB (1%)	5
`["matrix_ops", "\\", "3", "Matrix"]`	1.870 μs (5%)	464 bytes (1%)	4
`["matrix_ops", "\\", "3", "SMatrix"]`	19.340 ns (5%)
`["matrix_ops", "\\", "4", "Matrix"]`	1.945 μs (5%)	560 bytes (1%)	4
`["matrix_ops", "\\", "4", "SMatrix"]`	147.243 ns (5%)
`["matrix_ops", "\\", "5", "Matrix"]`	2.289 μs (5%)	736 bytes (1%)	4
`["matrix_ops", "\\", "5", "SMatrix"]`	295.318 ns (5%)
`["matrix_ops", "\\", "6", "Matrix"]`	2.445 μs (5%)	896 bytes (1%)	4
`["matrix_ops", "\\", "6", "SMatrix"]`	468.520 ns (5%)
`["matrix_ops", "\\", "7", "Matrix"]`	2.967 μs (5%)	1.14 KiB (1%)	4
`["matrix_ops", "\\", "7", "SMatrix"]`	710.768 ns (5%)
`["matrix_ops", "\\", "8", "Matrix"]`	2.945 μs (5%)	1.39 KiB (1%)	4
`["matrix_ops", "\\", "8", "SMatrix"]`	794.804 ns (5%)
`["matrix_ops", "\\", "9", "Matrix"]`	3.588 μs (5%)	1.63 KiB (1%)	4
`["matrix_ops", "\\", "9", "SMatrix"]`	1.128 μs (5%)
`["matrix_ops", "det", "1", "Matrix"]`	49.495 ns (5%)	112 bytes (1%)	2
`["matrix_ops", "det", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "10", "Matrix"]`	1.074 μs (5%)	1.06 KiB (1%)	3
`["matrix_ops", "det", "10", "SMatrix"]`	542.888 ns (5%)
`["matrix_ops", "det", "11", "Matrix"]`	1.220 μs (5%)	1.27 KiB (1%)	3
`["matrix_ops", "det", "11", "SMatrix"]`	677.505 ns (5%)
`["matrix_ops", "det", "12", "Matrix"]`	1.440 μs (5%)	1.42 KiB (1%)	3
`["matrix_ops", "det", "12", "SMatrix"]`	930.969 ns (5%)
`["matrix_ops", "det", "13", "Matrix"]`	1.670 μs (5%)	1.67 KiB (1%)	3
`["matrix_ops", "det", "13", "SMatrix"]`	1.230 μs (5%)
`["matrix_ops", "det", "14", "Matrix"]`	1.970 μs (5%)	1.98 KiB (1%)	3
`["matrix_ops", "det", "14", "SMatrix"]`	1.750 μs (5%)
`["matrix_ops", "det", "15", "Matrix"]`	2.190 μs (5%)	2.22 KiB (1%)	3
`["matrix_ops", "det", "15", "SMatrix"]`	2.345 μs (5%)	4.20 KiB (1%)	4
`["matrix_ops", "det", "16", "Matrix"]`	2.811 μs (5%)	2.36 KiB (1%)	3
`["matrix_ops", "det", "16", "SMatrix"]`	3.278 μs (5%)	4.48 KiB (1%)	4
`["matrix_ops", "det", "17", "Matrix"]`	3.111 μs (5%)	2.69 KiB (1%)	3
`["matrix_ops", "det", "17", "SMatrix"]`	3.625 μs (5%)	5.13 KiB (1%)	4
`["matrix_ops", "det", "18", "Matrix"]`	5.784 μs (5%)	2.94 KiB (1%)	3
`["matrix_ops", "det", "18", "SMatrix"]`	6.840 μs (5%)	5.63 KiB (1%)	4
`["matrix_ops", "det", "19", "Matrix"]`	6.680 μs (5%)	3.27 KiB (1%)	3
`["matrix_ops", "det", "19", "SMatrix"]`	7.351 μs (5%)	6.27 KiB (1%)	4
`["matrix_ops", "det", "2", "Matrix"]`	207.296 ns (5%)	240 bytes (1%)	3
`["matrix_ops", "det", "2", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "20", "Matrix"]`	6.600 μs (5%)	3.52 KiB (1%)	3
`["matrix_ops", "det", "20", "SMatrix"]`	7.050 μs (5%)	6.77 KiB (1%)	4
`["matrix_ops", "det", "3", "Matrix"]`	225.417 ns (5%)	304 bytes (1%)	3
`["matrix_ops", "det", "3", "SMatrix"]`	2.600 ns (5%)
`["matrix_ops", "det", "4", "Matrix"]`	325.531 ns (5%)	352 bytes (1%)	3
`["matrix_ops", "det", "4", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "5", "Matrix"]`	340.381 ns (5%)	448 bytes (1%)	3
`["matrix_ops", "det", "5", "SMatrix"]`	131.188 ns (5%)
`["matrix_ops", "det", "6", "Matrix"]`	496.005 ns (5%)	528 bytes (1%)	3
`["matrix_ops", "det", "6", "SMatrix"]`	184.232 ns (5%)
`["matrix_ops", "det", "7", "Matrix"]`	606.309 ns (5%)	672 bytes (1%)	3
`["matrix_ops", "det", "7", "SMatrix"]`	250.419 ns (5%)
`["matrix_ops", "det", "8", "Matrix"]`	614.971 ns (5%)	800 bytes (1%)	3
`["matrix_ops", "det", "8", "SMatrix"]`	343.086 ns (5%)
`["matrix_ops", "det", "9", "Matrix"]`	895.450 ns (5%)	928 bytes (1%)	3
`["matrix_ops", "det", "9", "SMatrix"]`	429.971 ns (5%)
`["matrix_ops", "exp", "1", "Matrix"]`	827.011 ns (5%)	1.69 KiB (1%)	20
`["matrix_ops", "exp", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "exp", "10", "Matrix"]`	10.534 μs (5%)	14.50 KiB (1%)	19
`["matrix_ops", "exp", "10", "SMatrix"]`	3.500 μs (5%)
`["matrix_ops", "exp", "11", "Matrix"]`	12.101 μs (5%)	17.53 KiB (1%)	19
`["matrix_ops", "exp", "11", "SMatrix"]`	4.757 μs (5%)
`["matrix_ops", "exp", "12", "Matrix"]`	11.300 μs (5%)	20.03 KiB (1%)	19
`["matrix_ops", "exp", "12", "SMatrix"]`	6.184 μs (5%)
`["matrix_ops", "exp", "13", "Matrix"]`	13.201 μs (5%)	23.81 KiB (1%)	19
`["matrix_ops", "exp", "13", "SMatrix"]`	8.150 μs (5%)
`["matrix_ops", "exp", "14", "Matrix"]`	16.701 μs (5%)	28.81 KiB (1%)	19
`["matrix_ops", "exp", "14", "SMatrix"]`	10.500 μs (5%)
`["matrix_ops", "exp", "15", "Matrix"]`	18.901 μs (5%)	32.34 KiB (1%)	19
`["matrix_ops", "exp", "15", "SMatrix"]`	41.702 μs (5%)	6.19 KiB (1%)	5
`["matrix_ops", "exp", "16", "Matrix"]`	21.501 μs (5%)	34.59 KiB (1%)	19
`["matrix_ops", "exp", "16", "SMatrix"]`	61.803 μs (5%)	6.61 KiB (1%)	5
`["matrix_ops", "exp", "17", "Matrix"]`	24.701 μs (5%)	39.63 KiB (1%)	19
`["matrix_ops", "exp", "17", "SMatrix"]`	83.904 μs (5%)	7.56 KiB (1%)	5
`["matrix_ops", "exp", "18", "Matrix"]`	30.601 μs (5%)	46.31 KiB (1%)	20
`["matrix_ops", "exp", "18", "SMatrix"]`	187.609 μs (5%)	8.31 KiB (1%)	5
`["matrix_ops", "exp", "19", "Matrix"]`	34.001 μs (5%)	51.66 KiB (1%)	20
`["matrix_ops", "exp", "19", "SMatrix"]`	242.612 μs (5%)	9.27 KiB (1%)	5
`["matrix_ops", "exp", "2", "Matrix"]`	3.050 μs (5%)	3.52 KiB (1%)	32
`["matrix_ops", "exp", "2", "SMatrix"]`	60.347 ns (5%)
`["matrix_ops", "exp", "20", "Matrix"]`	34.701 μs (5%)	55.91 KiB (1%)	20
`["matrix_ops", "exp", "20", "SMatrix"]`	291.614 μs (5%)	10.02 KiB (1%)	5
`["matrix_ops", "exp", "3", "Matrix"]`	2.800 μs (5%)	2.59 KiB (1%)	17
`["matrix_ops", "exp", "3", "SMatrix"]`	137.646 ns (5%)
`["matrix_ops", "exp", "4", "Matrix"]`	4.138 μs (5%)	3.25 KiB (1%)	17
`["matrix_ops", "exp", "4", "SMatrix"]`	341.032 ns (5%)
`["matrix_ops", "exp", "5", "Matrix"]`	5.300 μs (5%)	4.38 KiB (1%)	17
`["matrix_ops", "exp", "5", "SMatrix"]`	600.032 ns (5%)
`["matrix_ops", "exp", "6", "Matrix"]`	5.184 μs (5%)	5.47 KiB (1%)	17
`["matrix_ops", "exp", "6", "SMatrix"]`	919.629 ns (5%)
`["matrix_ops", "exp", "7", "Matrix"]`	6.200 μs (5%)	7.25 KiB (1%)	17
`["matrix_ops", "exp", "7", "SMatrix"]`	1.820 μs (5%)
`["matrix_ops", "exp", "8", "Matrix"]`	6.260 μs (5%)	9.00 KiB (1%)	17
`["matrix_ops", "exp", "8", "SMatrix"]`	1.880 μs (5%)
`["matrix_ops", "exp", "9", "Matrix"]`	8.150 μs (5%)	12.00 KiB (1%)	19
`["matrix_ops", "exp", "9", "SMatrix"]`	2.511 μs (5%)
`["matrix_ops", "inv", "1", "Matrix"]`	173.125 ns (5%)	96 bytes (1%)	1
`["matrix_ops", "inv", "1", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "10", "Matrix"]`	2.334 μs (5%)	6.22 KiB (1%)	5
`["matrix_ops", "inv", "10", "SMatrix"]`	1.410 μs (5%)
`["matrix_ops", "inv", "11", "Matrix"]`	2.722 μs (5%)	6.92 KiB (1%)	5
`["matrix_ops", "inv", "11", "SMatrix"]`	1.780 μs (5%)
`["matrix_ops", "inv", "12", "Matrix"]`	3.011 μs (5%)	7.58 KiB (1%)	5
`["matrix_ops", "inv", "12", "SMatrix"]`	2.310 μs (5%)
`["matrix_ops", "inv", "13", "Matrix"]`	3.475 μs (5%)	8.33 KiB (1%)	5
`["matrix_ops", "inv", "13", "SMatrix"]`	2.978 μs (5%)
`["matrix_ops", "inv", "14", "Matrix"]`	4.000 μs (5%)	9.14 KiB (1%)	5
`["matrix_ops", "inv", "14", "SMatrix"]`	4.325 μs (5%)
`["matrix_ops", "inv", "15", "Matrix"]`	4.529 μs (5%)	9.88 KiB (1%)	5
`["matrix_ops", "inv", "15", "SMatrix"]`	4.858 μs (5%)	11.86 KiB (1%)	6
`["matrix_ops", "inv", "16", "Matrix"]`	5.201 μs (5%)	10.52 KiB (1%)	5
`["matrix_ops", "inv", "16", "SMatrix"]`	5.951 μs (5%)	12.64 KiB (1%)	6
`["matrix_ops", "inv", "17", "Matrix"]`	5.917 μs (5%)	11.34 KiB (1%)	5
`["matrix_ops", "inv", "17", "SMatrix"]`	6.534 μs (5%)	13.78 KiB (1%)	6
`["matrix_ops", "inv", "18", "Matrix"]`	9.201 μs (5%)	12.09 KiB (1%)	5
`["matrix_ops", "inv", "18", "SMatrix"]`	10.701 μs (5%)	14.78 KiB (1%)	6
`["matrix_ops", "inv", "19", "Matrix"]`	11.101 μs (5%)	12.92 KiB (1%)	5
`["matrix_ops", "inv", "19", "SMatrix"]`	10.401 μs (5%)	15.92 KiB (1%)	6
`["matrix_ops", "inv", "2", "Matrix"]`	454.322 ns (5%)	1.39 KiB (1%)	5
`["matrix_ops", "inv", "2", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "20", "Matrix"]`	10.001 μs (5%)	13.67 KiB (1%)	5
`["matrix_ops", "inv", "20", "SMatrix"]`	11.801 μs (5%)	16.92 KiB (1%)	6
`["matrix_ops", "inv", "3", "Matrix"]`	710.319 ns (5%)	1.98 KiB (1%)	5
`["matrix_ops", "inv", "3", "SMatrix"]`	8.700 ns (5%)
`["matrix_ops", "inv", "4", "Matrix"]`	937.110 ns (5%)	2.50 KiB (1%)	5
`["matrix_ops", "inv", "4", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "5", "Matrix"]`	1.135 μs (5%)	3.09 KiB (1%)	5
`["matrix_ops", "inv", "5", "SMatrix"]`	297.293 ns (5%)
`["matrix_ops", "inv", "6", "Matrix"]`	1.340 μs (5%)	3.67 KiB (1%)	5
`["matrix_ops", "inv", "6", "SMatrix"]`	478.555 ns (5%)
`["matrix_ops", "inv", "7", "Matrix"]`	1.520 μs (5%)	4.31 KiB (1%)	5
`["matrix_ops", "inv", "7", "SMatrix"]`	687.300 ns (5%)
`["matrix_ops", "inv", "8", "Matrix"]`	1.750 μs (5%)	4.94 KiB (1%)	5
`["matrix_ops", "inv", "8", "SMatrix"]`	811.660 ns (5%)
`["matrix_ops", "inv", "9", "Matrix"]`	2.090 μs (5%)	5.56 KiB (1%)	5
`["matrix_ops", "inv", "9", "SMatrix"]`	1.160 μs (5%)
`["qr", "S=1", "Matrix"]`	115.490 ns (5%)	320 bytes (1%)	4
`["qr", "S=1", "SMatrix"]`	1.600 ns (5%)
`["qr", "S=10", "Matrix"]`	9.701 μs (5%)	2.66 KiB (1%)	4
`["qr", "S=10", "SMatrix"]`	785.934 ns (5%)
`["qr", "S=11", "Matrix"]`	12.501 μs (5%)	3.22 KiB (1%)	4
`["qr", "S=11", "SMatrix"]`	1.113 μs (5%)
`["qr", "S=12", "Matrix"]`	14.101 μs (5%)	3.69 KiB (1%)	4
`["qr", "S=12", "SMatrix"]`	1.340 μs (5%)
`["qr", "S=13", "Matrix"]`	15.501 μs (5%)	4.39 KiB (1%)	4
`["qr", "S=13", "SMatrix"]`	1.878 μs (5%)
`["qr", "S=14", "Matrix"]`	16.802 μs (5%)	5.33 KiB (1%)	4
`["qr", "S=14", "SMatrix"]`	2.000 μs (5%)
`["qr", "S=15", "Matrix"]`	19.802 μs (5%)	5.98 KiB (1%)	4
`["qr", "S=15", "SMatrix"]`	3.163 μs (5%)
`["qr", "S=16", "Matrix"]`	31.003 μs (5%)	6.41 KiB (1%)	4
`["qr", "S=16", "SMatrix"]`	3.525 μs (5%)
`["qr", "S=17", "Matrix"]`	26.803 μs (5%)	7.34 KiB (1%)	4
`["qr", "S=17", "SMatrix"]`	40.305 μs (5%)	19.56 KiB (1%)	10
`["qr", "S=18", "Matrix"]`	32.204 μs (5%)	8.09 KiB (1%)	4
`["qr", "S=18", "SMatrix"]`	42.605 μs (5%)	21.56 KiB (1%)	10
`["qr", "S=19", "Matrix"]`	33.403 μs (5%)	9.03 KiB (1%)	4
`["qr", "S=19", "SMatrix"]`	45.905 μs (5%)	24.06 KiB (1%)	10
`["qr", "S=2", "Matrix"]`	1.130 μs (5%)	368 bytes (1%)	4
`["qr", "S=2", "SMatrix"]`	8.909 ns (5%)
`["qr", "S=20", "Matrix"]`	35.403 μs (5%)	9.78 KiB (1%)	4
`["qr", "S=20", "SMatrix"]`	47.405 μs (5%)	26.06 KiB (1%)	10
`["qr", "S=21", "Matrix"]`	36.804 μs (5%)	10.91 KiB (1%)	4
`["qr", "S=21", "SMatrix"]`	46.505 μs (5%)	29.06 KiB (1%)	10
`["qr", "S=22", "Matrix"]`	39.005 μs (5%)	11.84 KiB (1%)	4
`["qr", "S=22", "SMatrix"]`	53.506 μs (5%)	31.56 KiB (1%)	10
`["qr", "S=3", "Matrix"]`	2.100 μs (5%)	512 bytes (1%)	4
`["qr", "S=3", "SMatrix"]`	31.619 ns (5%)
`["qr", "S=4", "Matrix"]`	3.413 μs (5%)	656 bytes (1%)	4
`["qr", "S=4", "SMatrix"]`	66.674 ns (5%)
`["qr", "S=5", "Matrix"]`	4.143 μs (5%)	896 bytes (1%)	4
`["qr", "S=5", "SMatrix"]`	132.678 ns (5%)
`["qr", "S=6", "Matrix"]`	5.321 μs (5%)	1.11 KiB (1%)	4
`["qr", "S=6", "SMatrix"]`	183.629 ns (5%)
`["qr", "S=7", "Matrix"]`	6.426 μs (5%)	1.48 KiB (1%)	4
`["qr", "S=7", "SMatrix"]`	266.306 ns (5%)
`["qr", "S=8", "Matrix"]`	8.801 μs (5%)	1.86 KiB (1%)	4
`["qr", "S=8", "SMatrix"]`	308.130 ns (5%)
`["qr", "S=9", "Matrix"]`	8.300 μs (5%)	2.19 KiB (1%)	4
`["qr", "S=9", "SMatrix"]`	529.729 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["matrix_ops", "*", "1"]
["matrix_ops", "*", "10"]
["matrix_ops", "*", "11"]
["matrix_ops", "*", "12"]
["matrix_ops", "*", "13"]
["matrix_ops", "*", "14"]
["matrix_ops", "*", "15"]
["matrix_ops", "*", "16"]
["matrix_ops", "*", "17"]
["matrix_ops", "*", "18"]
["matrix_ops", "*", "19"]
["matrix_ops", "*", "2"]
["matrix_ops", "*", "20"]
["matrix_ops", "*", "3"]
["matrix_ops", "*", "4"]
["matrix_ops", "*", "5"]
["matrix_ops", "*", "6"]
["matrix_ops", "*", "7"]
["matrix_ops", "*", "8"]
["matrix_ops", "*", "9"]
["matrix_ops", "\\", "1"]
["matrix_ops", "\\", "10"]
["matrix_ops", "\\", "11"]
["matrix_ops", "\\", "12"]
["matrix_ops", "\\", "13"]
["matrix_ops", "\\", "14"]
["matrix_ops", "\\", "15"]
["matrix_ops", "\\", "16"]
["matrix_ops", "\\", "17"]
["matrix_ops", "\\", "18"]
["matrix_ops", "\\", "19"]
["matrix_ops", "\\", "2"]
["matrix_ops", "\\", "20"]
["matrix_ops", "\\", "3"]
["matrix_ops", "\\", "4"]
["matrix_ops", "\\", "5"]
["matrix_ops", "\\", "6"]
["matrix_ops", "\\", "7"]
["matrix_ops", "\\", "8"]
["matrix_ops", "\\", "9"]
["matrix_ops", "det", "1"]
["matrix_ops", "det", "10"]
["matrix_ops", "det", "11"]
["matrix_ops", "det", "12"]
["matrix_ops", "det", "13"]
["matrix_ops", "det", "14"]
["matrix_ops", "det", "15"]
["matrix_ops", "det", "16"]
["matrix_ops", "det", "17"]
["matrix_ops", "det", "18"]
["matrix_ops", "det", "19"]
["matrix_ops", "det", "2"]
["matrix_ops", "det", "20"]
["matrix_ops", "det", "3"]
["matrix_ops", "det", "4"]
["matrix_ops", "det", "5"]
["matrix_ops", "det", "6"]
["matrix_ops", "det", "7"]
["matrix_ops", "det", "8"]
["matrix_ops", "det", "9"]
["matrix_ops", "exp", "1"]
["matrix_ops", "exp", "10"]
["matrix_ops", "exp", "11"]
["matrix_ops", "exp", "12"]
["matrix_ops", "exp", "13"]
["matrix_ops", "exp", "14"]
["matrix_ops", "exp", "15"]
["matrix_ops", "exp", "16"]
["matrix_ops", "exp", "17"]
["matrix_ops", "exp", "18"]
["matrix_ops", "exp", "19"]
["matrix_ops", "exp", "2"]
["matrix_ops", "exp", "20"]
["matrix_ops", "exp", "3"]
["matrix_ops", "exp", "4"]
["matrix_ops", "exp", "5"]
["matrix_ops", "exp", "6"]
["matrix_ops", "exp", "7"]
["matrix_ops", "exp", "8"]
["matrix_ops", "exp", "9"]
["matrix_ops", "inv", "1"]
["matrix_ops", "inv", "10"]
["matrix_ops", "inv", "11"]
["matrix_ops", "inv", "12"]
["matrix_ops", "inv", "13"]
["matrix_ops", "inv", "14"]
["matrix_ops", "inv", "15"]
["matrix_ops", "inv", "16"]
["matrix_ops", "inv", "17"]
["matrix_ops", "inv", "18"]
["matrix_ops", "inv", "19"]
["matrix_ops", "inv", "2"]
["matrix_ops", "inv", "20"]
["matrix_ops", "inv", "3"]
["matrix_ops", "inv", "4"]
["matrix_ops", "inv", "5"]
["matrix_ops", "inv", "6"]
["matrix_ops", "inv", "7"]
["matrix_ops", "inv", "8"]
["matrix_ops", "inv", "9"]
["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz     127407 s          0 s      12593 s      63552 s          0 s
       #2  2095 MHz      86713 s          0 s      16585 s     101170 s          0 s
       
  Memory: 6.782733917236328 GB (2398.703125 MB free)
  Uptime: 2063.0 sec
  Load Avg:  1.232421875  1.20751953125  1.10107421875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmark: 20 Feb 2020 - 3:20
Package commit: c3686c
Julia commit: 2d5741
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["qr", "S=1", "Matrix"]`	97.813 ns (5%)	320 bytes (1%)	4
`["qr", "S=1", "SMatrix"]`	1.600 ns (5%)
`["qr", "S=10", "Matrix"]`	9.801 μs (5%)	2.66 KiB (1%)	4
`["qr", "S=10", "SMatrix"]`	701.009 ns (5%)
`["qr", "S=11", "Matrix"]`	11.301 μs (5%)	3.22 KiB (1%)	4
`["qr", "S=11", "SMatrix"]`	986.733 ns (5%)
`["qr", "S=12", "Matrix"]`	12.701 μs (5%)	3.69 KiB (1%)	4
`["qr", "S=12", "SMatrix"]`	1.200 μs (5%)
`["qr", "S=13", "Matrix"]`	13.901 μs (5%)	4.39 KiB (1%)	4
`["qr", "S=13", "SMatrix"]`	1.667 μs (5%)
`["qr", "S=14", "Matrix"]`	15.302 μs (5%)	5.33 KiB (1%)	4
`["qr", "S=14", "SMatrix"]`	2.033 μs (5%)
`["qr", "S=15", "Matrix"]`	16.401 μs (5%)	5.98 KiB (1%)	4
`["qr", "S=15", "SMatrix"]`	2.788 μs (5%)
`["qr", "S=16", "Matrix"]`	25.302 μs (5%)	6.41 KiB (1%)	4
`["qr", "S=16", "SMatrix"]`	3.488 μs (5%)
`["qr", "S=17", "Matrix"]`	27.103 μs (5%)	7.34 KiB (1%)	4
`["qr", "S=17", "SMatrix"]`	37.203 μs (5%)	19.56 KiB (1%)	10
`["qr", "S=18", "Matrix"]`	28.402 μs (5%)	8.09 KiB (1%)	4
`["qr", "S=18", "SMatrix"]`	39.703 μs (5%)	21.56 KiB (1%)	10
`["qr", "S=19", "Matrix"]`	30.203 μs (5%)	9.03 KiB (1%)	4
`["qr", "S=19", "SMatrix"]`	41.704 μs (5%)	24.06 KiB (1%)	10
`["qr", "S=2", "Matrix"]`	1.140 μs (5%)	368 bytes (1%)	4
`["qr", "S=2", "SMatrix"]`	8.909 ns (5%)
`["qr", "S=20", "Matrix"]`	31.603 μs (5%)	9.78 KiB (1%)	4
`["qr", "S=20", "SMatrix"]`	43.804 μs (5%)	26.06 KiB (1%)	10
`["qr", "S=21", "Matrix"]`	33.603 μs (5%)	10.91 KiB (1%)	4
`["qr", "S=21", "SMatrix"]`	47.204 μs (5%)	29.06 KiB (1%)	10
`["qr", "S=22", "Matrix"]`	35.303 μs (5%)	11.84 KiB (1%)	4
`["qr", "S=22", "SMatrix"]`	48.904 μs (5%)	31.56 KiB (1%)	10
`["qr", "S=3", "Matrix"]`	2.056 μs (5%)	512 bytes (1%)	4
`["qr", "S=3", "SMatrix"]`	33.235 ns (5%)
`["qr", "S=4", "Matrix"]`	3.113 μs (5%)	656 bytes (1%)	4
`["qr", "S=4", "SMatrix"]`	57.367 ns (5%)
`["qr", "S=5", "Matrix"]`	4.057 μs (5%)	896 bytes (1%)	4
`["qr", "S=5", "SMatrix"]`	132.299 ns (5%)
`["qr", "S=6", "Matrix"]`	5.540 μs (5%)	1.11 KiB (1%)	4
`["qr", "S=6", "SMatrix"]`	237.789 ns (5%)
`["qr", "S=7", "Matrix"]`	6.176 μs (5%)	1.48 KiB (1%)	4
`["qr", "S=7", "SMatrix"]`	265.140 ns (5%)
`["qr", "S=8", "Matrix"]`	7.376 μs (5%)	1.86 KiB (1%)	4
`["qr", "S=8", "SMatrix"]`	317.437 ns (5%)
`["qr", "S=9", "Matrix"]`	9.900 μs (5%)	2.19 KiB (1%)	4
`["qr", "S=9", "SMatrix"]`	520.045 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz     143602 s          0 s      12818 s      64662 s          0 s
       #2  2095 MHz      88271 s          0 s      17175 s     116517 s          0 s
       
  Memory: 6.782733917236328 GB (3315.83984375 MB free)
  Uptime: 2239.0 sec
  Load Avg:  1.1337890625  1.1630859375  1.09228515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.209
BogoMIPS:            4190.41
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

tkf · 2020-02-20T03:24:02Z

benchmark/bench_matrix_ops.jl

+
+const suite = BenchmarkGroup()
+const matrix_sizes = if haskey(ENV, "GITHUB_EVENT_PATH")
+    (1, 2, 3, 4, 10, 20)


matrix_sizes = 1:20 => total CI time = 37 min https://github.com/JuliaArrays/StaticArrays.jl/runs/456805444

matrix_sizes = (1, 2, 3, 4, 10, 20) => total CI time = 15 min https://github.com/JuliaArrays/StaticArrays.jl/runs/456815324

Great 👍

If we're already at 15 min, I worry a bit about will happen for a comprehensive benchmark suite 😬

(I guess using the same treatment for QR would probably help with that 15 mins though)

Yeah, I have the same worry. I guess we can't do the "full sweep" in CI and be a bit less greedy about the parameters we try.

An option to reduce CI time is to tune benchmarks separately and store the JSON file somewhere. But I think it's easy to get it stale and it's cumbersome to add benchmarks...

BTW, a less ad-hoc way to do this kind of filtering is to use @tagged from BenchmarkToos.jl: https://github.com/JuliaCI/BenchmarkTools.jl/blob/master/doc/manual.md#indexing-into-a-benchmarkgroup-using-tagged I don't think PkgBenchmark.jl support this though.

I also wonder how much of this is compile time; some of the algorithms are probably quite terrible for N=20.

Yeah, one thing I can't copy easily from perf/*.jl is the compile-time benchmarks. It'd be great if BenchmarkTools reports compile-time while doing the tuning. I don't think it is difficult but just tedious...

c42f

Great thanks, this looks pretty straightforward (but very useful).

Browsing the results I noticed that ordering of benchmarks is quite confusing so some padding may help with that.

c42f · 2020-02-21T02:04:21Z

benchmark/bench_matrix_ops.jl

+
+const suite = BenchmarkGroup()
+const matrix_sizes = if haskey(ENV, "GITHUB_EVENT_PATH")
+    (1, 2, 3, 4, 10, 20)


Great 👍

If we're already at 15 min, I worry a bit about will happen for a comprehensive benchmark suite 😬

benchmark/bench_matrix_ops.jl

c42f · 2020-02-21T02:09:31Z

benchmark/bench_matrix_ops.jl

+
+const suite = BenchmarkGroup()
+const matrix_sizes = if haskey(ENV, "GITHUB_EVENT_PATH")
+    (1, 2, 3, 4, 10, 20)


(I guess using the same treatment for QR would probably help with that 15 mins though)

benchmark/bench_matrix_ops.jl

Co-Authored-By: Chris Foster <chris42f@gmail.com>

github-actions · 2020-02-21T03:34:26Z

Benchmark result

Judge result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmarks:
- Target: 21 Feb 2020 - 03:30
- Baseline: 21 Feb 2020 - 03:34
Package commits:
- Target: 2bbe35
- Baseline: c3686c
Julia commits:
- Target: 2d5741
- Baseline: 2d5741
Julia command flags:
- Target: None
- Baseline: None
Environment variables:
- Target: None
- Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["qr", "S=13", "SMatrix"]`	0.68 (5%) ✅	1.00 (1%)
`["qr", "S=15", "SMatrix"]`	0.91 (5%) ✅	1.00 (1%)
`["qr", "S=16", "SMatrix"]`	0.74 (5%) ✅	1.00 (1%)
`["qr", "S=21", "Matrix"]`	1.07 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      27498 s          0 s       9142 s      46450 s          0 s
       #2  2294 MHz      55494 s          0 s       4285 s      22679 s          0 s
       
  Memory: 6.782741546630859 GB (3152.82421875 MB free)
  Uptime: 846.0 sec
  Load Avg:  1.23681640625  1.25830078125  0.8212890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      29325 s          0 s       9873 s      63684 s          0 s
       #2  2294 MHz      73665 s          0 s       4524 s      24005 s          0 s
       
  Memory: 6.782741546630859 GB (3410.2109375 MB free)
  Uptime: 1045.0 sec
  Load Avg:  1.169921875  1.17431640625  0.87548828125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Target result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmark: 21 Feb 2020 - 3:30
Package commit: 2bbe35
Julia commit: 2d5741
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["matrix_ops", "*", "01", "Matrix"]`	155.755 ns (5%)	96 bytes (1%)	1
`["matrix_ops", "*", "01", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "02", "Matrix"]`	37.865 ns (5%)	112 bytes (1%)	1
`["matrix_ops", "*", "02", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "03", "Matrix"]`	45.555 ns (5%)	160 bytes (1%)	1
`["matrix_ops", "*", "03", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "04", "Matrix"]`	231.302 ns (5%)	208 bytes (1%)	1
`["matrix_ops", "*", "04", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "*", "10", "Matrix"]`	520.913 ns (5%)	896 bytes (1%)	1
`["matrix_ops", "*", "10", "SMatrix"]`	201.997 ns (5%)
`["matrix_ops", "*", "20", "Matrix"]`	1.667 μs (5%)	3.25 KiB (1%)	1
`["matrix_ops", "*", "20", "SMatrix"]`	1.640 μs (5%)
`["matrix_ops", "\\", "01", "Matrix"]`	89.665 ns (5%)	208 bytes (1%)	3
`["matrix_ops", "\\", "01", "SMatrix"]`	1.600 ns (5%)
`["matrix_ops", "\\", "02", "Matrix"]`	1.530 μs (5%)	352 bytes (1%)	4
`["matrix_ops", "\\", "02", "SMatrix"]`	5.699 ns (5%)
`["matrix_ops", "\\", "03", "Matrix"]`	2.011 μs (5%)	464 bytes (1%)	4
`["matrix_ops", "\\", "03", "SMatrix"]`	19.357 ns (5%)
`["matrix_ops", "\\", "04", "Matrix"]`	1.810 μs (5%)	560 bytes (1%)	4
`["matrix_ops", "\\", "04", "SMatrix"]`	185.352 ns (5%)
`["matrix_ops", "\\", "10", "Matrix"]`	4.014 μs (5%)	1.94 KiB (1%)	4
`["matrix_ops", "\\", "10", "SMatrix"]`	1.550 μs (5%)
`["matrix_ops", "\\", "20", "Matrix"]`	12.199 μs (5%)	6.77 KiB (1%)	4
`["matrix_ops", "\\", "20", "SMatrix"]`	13.600 μs (5%)	10.02 KiB (1%)	5
`["matrix_ops", "det", "01", "Matrix"]`	44.994 ns (5%)	112 bytes (1%)	2
`["matrix_ops", "det", "01", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "02", "Matrix"]`	188.522 ns (5%)	240 bytes (1%)	3
`["matrix_ops", "det", "02", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "03", "Matrix"]`	233.932 ns (5%)	304 bytes (1%)	3
`["matrix_ops", "det", "03", "SMatrix"]`	2.199 ns (5%)
`["matrix_ops", "det", "04", "Matrix"]`	292.332 ns (5%)	352 bytes (1%)	3
`["matrix_ops", "det", "04", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "det", "10", "Matrix"]`	1.120 μs (5%)	1.06 KiB (1%)	3
`["matrix_ops", "det", "10", "SMatrix"]`	643.599 ns (5%)
`["matrix_ops", "det", "20", "Matrix"]`	7.100 μs (5%)	3.52 KiB (1%)	3
`["matrix_ops", "det", "20", "SMatrix"]`	8.499 μs (5%)	6.77 KiB (1%)	4
`["matrix_ops", "exp", "01", "Matrix"]`	803.398 ns (5%)	1.69 KiB (1%)	20
`["matrix_ops", "exp", "01", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "exp", "02", "Matrix"]`	2.778 μs (5%)	3.52 KiB (1%)	32
`["matrix_ops", "exp", "02", "SMatrix"]`	61.952 ns (5%)
`["matrix_ops", "exp", "03", "Matrix"]`	3.871 μs (5%)	4.91 KiB (1%)	32
`["matrix_ops", "exp", "03", "SMatrix"]`	136.216 ns (5%)
`["matrix_ops", "exp", "04", "Matrix"]`	4.557 μs (5%)	3.25 KiB (1%)	17
`["matrix_ops", "exp", "04", "SMatrix"]`	408.035 ns (5%)
`["matrix_ops", "exp", "10", "Matrix"]`	10.700 μs (5%)	14.50 KiB (1%)	19
`["matrix_ops", "exp", "10", "SMatrix"]`	5.128 μs (5%)
`["matrix_ops", "exp", "20", "Matrix"]`	37.700 μs (5%)	55.91 KiB (1%)	20
`["matrix_ops", "exp", "20", "SMatrix"]`	427.895 μs (5%)	10.02 KiB (1%)	5
`["matrix_ops", "inv", "01", "Matrix"]`	162.840 ns (5%)	96 bytes (1%)	1
`["matrix_ops", "inv", "01", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "02", "Matrix"]`	448.218 ns (5%)	1.39 KiB (1%)	5
`["matrix_ops", "inv", "02", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "03", "Matrix"]`	562.898 ns (5%)	1.98 KiB (1%)	5
`["matrix_ops", "inv", "03", "SMatrix"]`	8.499 ns (5%)
`["matrix_ops", "inv", "04", "Matrix"]`	1.070 μs (5%)	2.50 KiB (1%)	5
`["matrix_ops", "inv", "04", "SMatrix"]`	0.001 ns (5%)
`["matrix_ops", "inv", "10", "Matrix"]`	2.711 μs (5%)	6.22 KiB (1%)	5
`["matrix_ops", "inv", "10", "SMatrix"]`	1.560 μs (5%)
`["matrix_ops", "inv", "20", "Matrix"]`	11.199 μs (5%)	13.67 KiB (1%)	5
`["matrix_ops", "inv", "20", "SMatrix"]`	12.600 μs (5%)	16.92 KiB (1%)	6
`["qr", "S=1", "Matrix"]`	104.978 ns (5%)	320 bytes (1%)	4
`["qr", "S=1", "SMatrix"]`	1.400 ns (5%)
`["qr", "S=10", "Matrix"]`	12.999 μs (5%)	2.66 KiB (1%)	4
`["qr", "S=10", "SMatrix"]`	778.422 ns (5%)
`["qr", "S=11", "Matrix"]`	14.600 μs (5%)	3.22 KiB (1%)	4
`["qr", "S=11", "SMatrix"]`	1.160 μs (5%)
`["qr", "S=12", "Matrix"]`	16.399 μs (5%)	3.69 KiB (1%)	4
`["qr", "S=12", "SMatrix"]`	1.260 μs (5%)
`["qr", "S=13", "Matrix"]`	17.900 μs (5%)	4.39 KiB (1%)	4
`["qr", "S=13", "SMatrix"]`	2.022 μs (5%)
`["qr", "S=14", "Matrix"]`	19.799 μs (5%)	5.33 KiB (1%)	4
`["qr", "S=14", "SMatrix"]`	2.644 μs (5%)
`["qr", "S=15", "Matrix"]`	21.499 μs (5%)	5.98 KiB (1%)	4
`["qr", "S=15", "SMatrix"]`	3.575 μs (5%)
`["qr", "S=16", "Matrix"]`	32.000 μs (5%)	6.41 KiB (1%)	4
`["qr", "S=16", "SMatrix"]`	4.600 μs (5%)
`["qr", "S=17", "Matrix"]`	33.799 μs (5%)	7.34 KiB (1%)	4
`["qr", "S=17", "SMatrix"]`	46.300 μs (5%)	19.56 KiB (1%)	10
`["qr", "S=18", "Matrix"]`	35.800 μs (5%)	8.09 KiB (1%)	4
`["qr", "S=18", "SMatrix"]`	50.199 μs (5%)	21.56 KiB (1%)	10
`["qr", "S=19", "Matrix"]`	38.100 μs (5%)	9.03 KiB (1%)	4
`["qr", "S=19", "SMatrix"]`	53.600 μs (5%)	24.06 KiB (1%)	10
`["qr", "S=2", "Matrix"]`	1.020 μs (5%)	368 bytes (1%)	4
`["qr", "S=2", "SMatrix"]`	12.624 ns (5%)
`["qr", "S=20", "Matrix"]`	40.199 μs (5%)	9.78 KiB (1%)	4
`["qr", "S=20", "SMatrix"]`	56.699 μs (5%)	26.06 KiB (1%)	10
`["qr", "S=21", "Matrix"]`	45.799 μs (5%)	10.91 KiB (1%)	4
`["qr", "S=21", "SMatrix"]`	61.199 μs (5%)	29.06 KiB (1%)	10
`["qr", "S=22", "Matrix"]`	44.500 μs (5%)	11.84 KiB (1%)	4
`["qr", "S=22", "SMatrix"]`	64.300 μs (5%)	31.56 KiB (1%)	10
`["qr", "S=3", "Matrix"]`	2.511 μs (5%)	512 bytes (1%)	4
`["qr", "S=3", "SMatrix"]`	41.371 ns (5%)
`["qr", "S=4", "Matrix"]`	3.938 μs (5%)	656 bytes (1%)	4
`["qr", "S=4", "SMatrix"]`	75.797 ns (5%)
`["qr", "S=5", "Matrix"]`	5.250 μs (5%)	896 bytes (1%)	4
`["qr", "S=5", "SMatrix"]`	145.934 ns (5%)
`["qr", "S=6", "Matrix"]`	6.720 μs (5%)	1.11 KiB (1%)	4
`["qr", "S=6", "SMatrix"]`	191.821 ns (5%)
`["qr", "S=7", "Matrix"]`	8.100 μs (5%)	1.48 KiB (1%)	4
`["qr", "S=7", "SMatrix"]`	290.033 ns (5%)
`["qr", "S=8", "Matrix"]`	9.700 μs (5%)	1.86 KiB (1%)	4
`["qr", "S=8", "SMatrix"]`	355.136 ns (5%)
`["qr", "S=9", "Matrix"]`	11.199 μs (5%)	2.19 KiB (1%)	4
`["qr", "S=9", "SMatrix"]`	610.393 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["matrix_ops", "*", "01"]
["matrix_ops", "*", "02"]
["matrix_ops", "*", "03"]
["matrix_ops", "*", "04"]
["matrix_ops", "*", "10"]
["matrix_ops", "*", "20"]
["matrix_ops", "\\", "01"]
["matrix_ops", "\\", "02"]
["matrix_ops", "\\", "03"]
["matrix_ops", "\\", "04"]
["matrix_ops", "\\", "10"]
["matrix_ops", "\\", "20"]
["matrix_ops", "det", "01"]
["matrix_ops", "det", "02"]
["matrix_ops", "det", "03"]
["matrix_ops", "det", "04"]
["matrix_ops", "det", "10"]
["matrix_ops", "det", "20"]
["matrix_ops", "exp", "01"]
["matrix_ops", "exp", "02"]
["matrix_ops", "exp", "03"]
["matrix_ops", "exp", "04"]
["matrix_ops", "exp", "10"]
["matrix_ops", "exp", "20"]
["matrix_ops", "inv", "01"]
["matrix_ops", "inv", "02"]
["matrix_ops", "inv", "03"]
["matrix_ops", "inv", "04"]
["matrix_ops", "inv", "10"]
["matrix_ops", "inv", "20"]
["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      27498 s          0 s       9142 s      46450 s          0 s
       #2  2294 MHz      55494 s          0 s       4285 s      22679 s          0 s
       
  Memory: 6.782741546630859 GB (3152.82421875 MB free)
  Uptime: 846.0 sec
  Load Avg:  1.23681640625  1.25830078125  0.8212890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Baseline result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Time of benchmark: 21 Feb 2020 - 3:34
Package commit: c3686c
Julia commit: 2d5741
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["qr", "S=1", "Matrix"]`	104.342 ns (5%)	320 bytes (1%)	4
`["qr", "S=1", "SMatrix"]`	1.399 ns (5%)
`["qr", "S=10", "Matrix"]`	12.899 μs (5%)	2.66 KiB (1%)	4
`["qr", "S=10", "SMatrix"]`	781.363 ns (5%)
`["qr", "S=11", "Matrix"]`	14.399 μs (5%)	3.22 KiB (1%)	4
`["qr", "S=11", "SMatrix"]`	1.220 μs (5%)
`["qr", "S=12", "Matrix"]`	16.299 μs (5%)	3.69 KiB (1%)	4
`["qr", "S=12", "SMatrix"]`	1.240 μs (5%)
`["qr", "S=13", "Matrix"]`	17.799 μs (5%)	4.39 KiB (1%)	4
`["qr", "S=13", "SMatrix"]`	2.955 μs (5%)
`["qr", "S=14", "Matrix"]`	19.699 μs (5%)	5.33 KiB (1%)	4
`["qr", "S=14", "SMatrix"]`	2.633 μs (5%)
`["qr", "S=15", "Matrix"]`	21.299 μs (5%)	5.98 KiB (1%)	4
`["qr", "S=15", "SMatrix"]`	3.937 μs (5%)
`["qr", "S=16", "Matrix"]`	31.199 μs (5%)	6.41 KiB (1%)	4
`["qr", "S=16", "SMatrix"]`	6.186 μs (5%)
`["qr", "S=17", "Matrix"]`	34.099 μs (5%)	7.34 KiB (1%)	4
`["qr", "S=17", "SMatrix"]`	46.799 μs (5%)	19.56 KiB (1%)	10
`["qr", "S=18", "Matrix"]`	36.399 μs (5%)	8.09 KiB (1%)	4
`["qr", "S=18", "SMatrix"]`	50.799 μs (5%)	21.56 KiB (1%)	10
`["qr", "S=19", "Matrix"]`	38.999 μs (5%)	9.03 KiB (1%)	4
`["qr", "S=19", "SMatrix"]`	52.899 μs (5%)	24.06 KiB (1%)	10
`["qr", "S=2", "Matrix"]`	1.020 μs (5%)	368 bytes (1%)	4
`["qr", "S=2", "SMatrix"]`	12.525 ns (5%)
`["qr", "S=20", "Matrix"]`	41.499 μs (5%)	9.78 KiB (1%)	4
`["qr", "S=20", "SMatrix"]`	57.198 μs (5%)	26.06 KiB (1%)	10
`["qr", "S=21", "Matrix"]`	42.899 μs (5%)	10.91 KiB (1%)	4
`["qr", "S=21", "SMatrix"]`	59.799 μs (5%)	29.06 KiB (1%)	10
`["qr", "S=22", "Matrix"]`	45.000 μs (5%)	11.84 KiB (1%)	4
`["qr", "S=22", "SMatrix"]`	64.000 μs (5%)	31.56 KiB (1%)	10
`["qr", "S=3", "Matrix"]`	2.511 μs (5%)	512 bytes (1%)	4
`["qr", "S=3", "SMatrix"]`	41.270 ns (5%)
`["qr", "S=4", "Matrix"]`	3.900 μs (5%)	656 bytes (1%)	4
`["qr", "S=4", "SMatrix"]`	75.797 ns (5%)
`["qr", "S=5", "Matrix"]`	5.216 μs (5%)	896 bytes (1%)	4
`["qr", "S=5", "SMatrix"]`	144.637 ns (5%)
`["qr", "S=6", "Matrix"]`	6.740 μs (5%)	1.11 KiB (1%)	4
`["qr", "S=6", "SMatrix"]`	191.505 ns (5%)
`["qr", "S=7", "Matrix"]`	8.133 μs (5%)	1.48 KiB (1%)	4
`["qr", "S=7", "SMatrix"]`	290.768 ns (5%)
`["qr", "S=8", "Matrix"]`	9.699 μs (5%)	1.86 KiB (1%)	4
`["qr", "S=8", "SMatrix"]`	345.790 ns (5%)
`["qr", "S=9", "Matrix"]`	11.100 μs (5%)	2.19 KiB (1%)	4
`["qr", "S=9", "SMatrix"]`	611.549 ns (5%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["qr", "S=1"]
["qr", "S=10"]
["qr", "S=11"]
["qr", "S=12"]
["qr", "S=13"]
["qr", "S=14"]
["qr", "S=15"]
["qr", "S=16"]
["qr", "S=17"]
["qr", "S=18"]
["qr", "S=19"]
["qr", "S=2"]
["qr", "S=20"]
["qr", "S=21"]
["qr", "S=22"]
["qr", "S=3"]
["qr", "S=4"]
["qr", "S=5"]
["qr", "S=6"]
["qr", "S=7"]
["qr", "S=8"]
["qr", "S=9"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.0.0-1031-azure #33-Ubuntu SMP Thu Feb 6 22:26:13 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      29325 s          0 s       9873 s      63684 s          0 s
       #2  2294 MHz      73665 s          0 s       4524 s      24005 s          0 s
       
  Memory: 6.782741546630859 GB (3410.2109375 MB free)
  Uptime: 1045.0 sec
  Load Avg:  1.169921875  1.17431640625  0.87548828125
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`openblas64`
`Sys.CPU_THREADS`	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               79
Model name:          Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Stepping:            1
CPU MHz:             2294.684
BogoMIPS:            4589.36
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            51200K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt

Cpu Property	Value
Brand	Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Vendor	:Intel
Architecture	:Broadwell
Model	Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 256, 51200) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

coveralls · 2020-02-21T04:02:35Z

Coverage remained the same at 82.459% when pulling 479b0ca on tkf/bench_matrix_ops into c3686c4 on master.

[ci skip] Port perf/benchmark_matrix_ops.jl to benchmark/*.jl

5ead6c8

tkf added the benchmarking label Feb 20, 2020

tkf commented Feb 20, 2020

View reviewed changes

benchmark/bench_matrix_ops.jl Show resolved Hide resolved

tkf added 3 commits February 19, 2020 18:40

[ci skip] Add Random to benchmark/Project.toml

d9ca659

[ci skip] Fix rand usage

2f69235

[ci skip] Reduce number of benchmarks to run in CI

298f375

tkf commented Feb 20, 2020

View reviewed changes

c42f approved these changes Feb 21, 2020

View reviewed changes

Pad benchmark names

479b0ca

Co-Authored-By: Chris Foster <chris42f@gmail.com>

c42f merged commit f330604 into master Feb 26, 2020

c42f deleted the tkf/bench_matrix_ops branch February 26, 2020 04:52

Port perf/benchmark_matrix_ops.jl to benchmark/*.jl #742

Port perf/benchmark_matrix_ops.jl to benchmark/*.jl #742

Conversation

tkf commented Feb 20, 2020 • edited Loading

github-actions bot commented Feb 20, 2020

Judge result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

github-actions bot commented Feb 20, 2020

Judge result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

tkf Feb 20, 2020

Choose a reason for hiding this comment

c42f Feb 21, 2020

Choose a reason for hiding this comment

c42f Feb 21, 2020

Choose a reason for hiding this comment

tkf Feb 21, 2020 • edited Loading

Choose a reason for hiding this comment

c42f Feb 21, 2020

Choose a reason for hiding this comment

tkf Feb 21, 2020

Choose a reason for hiding this comment

c42f left a comment

Choose a reason for hiding this comment

c42f Feb 21, 2020

Choose a reason for hiding this comment

c42f Feb 21, 2020

Choose a reason for hiding this comment

github-actions bot commented Feb 21, 2020

Judge result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/StaticArrays.jl/StaticArrays.jl

Job Properties

Results

Benchmark Group List

tkf commented Feb 20, 2020 •

edited

Loading

tkf Feb 21, 2020 •

edited

Loading