Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Perf] Linux/x64: 473 Improvements on 12/3/2022 7:24:45 AM #10468

Closed
performanceautofiler bot opened this issue Dec 6, 2022 · 20 comments
Closed

[Perf] Linux/x64: 473 Improvements on 12/3/2022 7:24:45 AM #10468

performanceautofiler bot opened this issue Dec 6, 2022 · 20 comments
Labels
arch-x64 branch-refs/heads/main kind-micro_mono mono-interpreter os-linux perf-improvement runtime-mono untriaged

Comments

@performanceautofiler
Copy link

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
AddOperatorBenchmark - Duration of single invocation 221.73 ns 176.94 ns 0.80 0.19 False
GreaterThanOrEqualBenchmark - Duration of single invocation 225.08 ns 185.29 ns 0.82 0.15 False
LessThanBenchmark - Duration of single invocation 224.48 ns 194.64 ns 0.87 0.08 False
SubtractionOperatorBenchmark - Duration of single invocation 216.64 ns 170.10 ns 0.79 0.14 False
BitwiseOrOperatorBenchmark - Duration of single invocation 71.68 ns 37.80 ns 0.53 0.09 False
GreaterThanBenchmark - Duration of single invocation 226.76 ns 182.66 ns 0.81 0.09 False
UnaryNegateOperatorBenchmark - Duration of single invocation 203.29 ns 161.21 ns 0.79 0.07 False
BitwiseAndBenchmark - Duration of single invocation 72.61 ns 37.27 ns 0.51 0.06 False
MultiplyBenchmark - Duration of single invocation 219.98 ns 181.60 ns 0.83 0.14 False
BitwiseOrBenchmark - Duration of single invocation 72.87 ns 37.49 ns 0.51 0.05 False
LessThanOrEqualBenchmark - Duration of single invocation 230.88 ns 202.72 ns 0.88 0.09 False
MinBenchmark - Duration of single invocation 249.90 ns 209.58 ns 0.84 0.18 False
DivisionOperatorBenchmark - Duration of single invocation 232.87 ns 189.10 ns 0.81 0.15 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.20 ns 37.86 ns 0.52 0.05 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 73.54 ns 37.31 ns 0.51 0.09 False
SubtractBenchmark - Duration of single invocation 218.91 ns 174.18 ns 0.80 0.05 False
EqualsStaticBenchmark - Duration of single invocation 226.14 ns 183.74 ns 0.81 0.11 False
AndNotBenchmark - Duration of single invocation 74.25 ns 39.28 ns 0.53 0.08 False
ConditionalSelectBenchmark - Duration of single invocation 101.68 ns 62.59 ns 0.62 0.06 False
NegateBenchmark - Duration of single invocation 206.86 ns 164.08 ns 0.79 0.13 False
MultiplyOperatorBenchmark - Duration of single invocation 218.80 ns 171.16 ns 0.78 0.07 False
OnesComplementBenchmark - Duration of single invocation 62.97 ns 29.42 ns 0.47 0.10 False
AbsBenchmark - Duration of single invocation 210.16 ns 160.04 ns 0.76 0.16 False
XorBenchmark - Duration of single invocation 76.53 ns 37.69 ns 0.49 0.10 False
AddBenchmark - Duration of single invocation 221.91 ns 191.88 ns 0.86 0.12 False
OnesComplementOperatorBenchmark - Duration of single invocation 63.04 ns 29.45 ns 0.47 0.11 False
AllBitsSetBenchmark - Duration of single invocation 50.98 ns 15.23 ns 0.30 0.08 False
MaxBenchmark - Duration of single invocation 276.19 ns 219.36 ns 0.79 0.16 False
DivideBenchmark - Duration of single invocation 235.43 ns 192.14 ns 0.82 0.12 False
SquareRootBenchmark - Duration of single invocation 209.06 ns 174.45 ns 0.83 0.10 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AddOperatorBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 176.93737653311808 < 206.67942607221926.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 14.774381508283724 (T) = (0 -171.4418255412703) / Math.Sqrt((291.64399016284807 / (89)) + (49.477351845757866 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.19816824656829413 = (213.8127167046303 - 171.4418255412703) / 213.8127167046303 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 185.29236657917758 < 214.21779670431965.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 50.040571105211754 (T) = (0 -186.56784252210826) / Math.Sqrt((54.02149941198945 / (89)) + (0.4436396793164596 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.17794728986034675 = (226.953625018052 - 186.56784252210826) / 226.953625018052 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 194.64366682395504 < 215.2817268406558.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 26.759898072976114 (T) = (0 -181.86639524127492) / Math.Sqrt((39.853283626711374 / (89)) + (20.836743436792336 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.18969872087835377 = (224.44293243423633 - 181.86639524127492) / 224.44293243423633 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 170.10397453777526 < 206.4758135274766.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 19.999111139159538 (T) = (0 -170.30972990824188) / Math.Sqrt((61.04782508507519 / (89)) + (38.48342758198709 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.20003134476482495 = (212.89550383467733 - 170.30972990824188) / 212.89550383467733 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.79571480264356 < 68.0125139278344.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 34.82387828539304 (T) = (0 -38.353968747954745) / Math.Sqrt((1.8706282146253421 / (89)) + (9.262434409779397 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.46912816543753977 = (72.24713433811334 - 38.353968747954745) / 72.24713433811334 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 182.66471859016923 < 214.71290313480046.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.550833993100504 (T) = (0 -180.82408015734774) / Math.Sqrt((32.91071609690451 / (89)) + (3.2465686843175083 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.194964595873341 = (224.61630784240398 - 180.82408015734774) / 224.61630784240398 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 161.2092073229908 < 194.25576192593374.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 66.43128127858961 (T) = (0 -160.15584627985515) / Math.Sqrt((35.07043510206456 / (89)) + (0.23458245447203133 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21136701390325593 = (203.08032900390035 - 160.15584627985515) / 203.08032900390035 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.27234566033826 < 68.68723521681844.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 143.94592327714508 (T) = (0 -37.16566555898245) / Math.Sqrt((2.4717176327507273 / (88)) + (0.31648967736705 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.4862903646441542 = (72.34761234960651 - 37.16566555898245) / 72.34761234960651 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 181.59919030206407 < 210.33259911900925.
IsChangePoint: Marked as a change because one of 11/22/2022 11:24:47 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 31.34482143684076 (T) = (0 -174.27267914247494) / Math.Sqrt((65.71175775722313 / (89)) + (8.387785836229316 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.18425604817988636 = (213.63649556166766 - 174.27267914247494) / 213.63649556166766 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.49428156641836 < 68.77705064189855.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 198.98321702272722 (T) = (0 -37.25726730447149) / Math.Sqrt((2.1558471904103707 / (89)) + (0.06265864010214822 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48255124098603425 = (72.00184879265684 - 37.25726730447149) / 72.00184879265684 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 202.72181146833776 < 219.2173726847666.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.338162200588428 (T) = (0 -192.21326013753344) / Math.Sqrt((25.654929963072917 / (89)) + (28.137081338387624 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1699063751314839 = (231.55612135676785 - 192.21326013753344) / 231.55612135676785 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 209.5837908221428 < 239.37626476235133.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 23.8879686288948 (T) = (0 -209.30089907917068) / Math.Sqrt((55.88919105892974 / (89)) + (23.974145285810625 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1656357226227523 = (250.85074319946924 - 209.30089907917068) / 250.85074319946924 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 189.0998367850287 < 221.6892360615665.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 39.44878831170172 (T) = (0 -189.12563089049684) / Math.Sqrt((53.561414974756765 / (89)) + (5.897000748714836 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.18545824833997734 = (232.18653986129246 - 189.12563089049684) / 232.18653986129246 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.86152202598767 < 68.5496265644559.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 157.28040276671175 (T) = (0 -37.07632962699542) / Math.Sqrt((2.1923030854997405 / (89)) + (0.2548121947048761 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48708347942054964 = (72.28530986896205 - 37.07632962699542) / 72.28530986896205 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.31340201469356 < 69.36679148036734.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 165.1837062038275 (T) = (0 -36.91632414162964) / Math.Sqrt((2.59354398344565 / (89)) + (0.17793171836685134 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49222541516464136 = (72.70218960170963 - 36.91632414162964) / 72.70218960170963 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 174.17603084463295 < 208.29513535713826.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 47.167836367215784 (T) = (0 -170.47201757525966) / Math.Sqrt((50.996288006321656 / (89)) + (3.058490665739164 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.20596283286034592 = (214.69022437494704 - 170.47201757525966) / 214.69022437494704 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 183.73795640602586 < 214.83948656698496.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 30.33308250998601 (T) = (0 -182.76840083796677) / Math.Sqrt((38.31198700272374 / (88)) + (15.010377378213885 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.1876176136368637 = (224.9782908959685 - 182.76840083796677) / 224.9782908959685 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.28251008527327 < 70.57302021186703.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 139.76188051307693 (T) = (0 -39.05856786780275) / Math.Sqrt((3.3247495930216076 / (89)) + (0.2451955855991549 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47092503844137523 = (73.82426065436631 - 39.05856786780275) / 73.82426065436631 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 62.59111245657753 < 96.39712330286396.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 88.38144123770562 (T) = (0 -64.35144025790814) / Math.Sqrt((5.020689871477001 / (89)) + (1.1353900099641716 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3615093462883716 = (100.78681635169588 - 64.35144025790814) / 100.78681635169588 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 164.08111457178737 < 196.33333061888789.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 30.035288497768196 (T) = (0 -164.00861928438854) / Math.Sqrt((53.64017470327967 / (89)) + (13.368359636707732 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.20321473312769092 = (205.83791656713976 - 164.00861928438854) / 205.83791656713976 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 171.16043029688836 < 207.89157166601655.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 30.672155593425472 (T) = (0 -171.13835923106765) / Math.Sqrt((73.79270641165304 / (89)) + (8.97463056704126 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.19061151884262137 = (211.44155521752634 - 171.13835923106765) / 211.44155521752634 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.421734027931212 < 59.84432391997971.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 149.82604019238187 (T) = (0 -28.815041376804892) / Math.Sqrt((3.739660957153782 / (89)) + (0.10989111215782442 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5448588095315847 = (63.31011558665887 - 28.815041376804892) / 63.31011558665887 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 160.0362070966209 < 190.16645080557245.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.165002851989506 (T) = (0 -160.5328516239501) / Math.Sqrt((31.237269884453266 / (89)) + (25.634617349454967 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.19074991578794043 = (198.37236319877027 - 160.5328516239501) / 198.37236319877027 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.694983746350005 < 68.59525889937687.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 115.51859759961525 (T) = (0 -36.73274532326307) / Math.Sqrt((3.026225553997216 / (89)) + (0.632583539212987 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4951460935039398 = (72.75915834385987 - 36.73274532326307) / 72.75915834385987 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 191.88145578954587 < 209.15224815264457.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.335848424185487 (T) = (0 -175.6431292392179) / Math.Sqrt((76.78524225799498 / (89)) + (53.75476180071173 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.17903300131550368 = (213.94663795337144 - 175.6431292392179) / 213.94663795337144 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.447088609327757 < 59.85283369630602.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 170.36969954062377 (T) = (0 -28.84169622999328) / Math.Sqrt((2.3768089623988726 / (89)) + (0.13997784768007232 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5437448944790294 = (63.21396929259709 - 28.84169622999328) / 63.21396929259709 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.2256287274441 < 48.544840483687295.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 215.51116726043662 (T) = (0 -15.38225793704847) / Math.Sqrt((1.1599271290166497 / (89)) + (0.14126305452834054 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6977862233266825 = (50.89859935034052 - 15.38225793704847) / 50.89859935034052 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 219.35543687759144 < 244.09746251738952.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.914742877468937 (T) = (0 -207.7392930887102) / Math.Sqrt((390.05527450279993 / (89)) + (41.169002621451035 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1825699800391813 = (254.1370979972911 - 207.7392930887102) / 254.1370979972911 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 192.13570680723302 < 225.90963681757572.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.601819997459923 (T) = (0 -193.4170656881578) / Math.Sqrt((49.364759740553744 / (89)) + (26.661126363908124 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1733587422743777 = (233.97944861875808 - 193.4170656881578) / 233.97944861875808 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 174.45066246456054 < 199.6807479293976.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.534214583942802 (T) = (0 -178.04080888027374) / Math.Sqrt((23.52898667456498 / (89)) + (40.03765561204677 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1609748797761172 = (212.19961666078115 - 178.04080888027374) / 212.19961666078115 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
LessThanOrEqualBenchmark - Duration of single invocation 127.78 ns 87.75 ns 0.69 0.13 False
DivideBenchmark - Duration of single invocation 137.09 ns 99.31 ns 0.72 0.05 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 71.27 ns 37.22 ns 0.52 0.06 False
XorBenchmark - Duration of single invocation 72.91 ns 37.63 ns 0.52 0.11 False
AddBenchmark - Duration of single invocation 125.39 ns 87.04 ns 0.69 0.11 False
GreaterThanBenchmark - Duration of single invocation 126.43 ns 89.88 ns 0.71 0.17 False
OnesComplementOperatorBenchmark - Duration of single invocation 63.03 ns 30.08 ns 0.48 0.10 False
SubtractBenchmark - Duration of single invocation 124.63 ns 84.30 ns 0.68 0.15 False
MultiplyBenchmark - Duration of single invocation 124.86 ns 86.28 ns 0.69 0.12 False
SquareRootBenchmark - Duration of single invocation 110.03 ns 74.73 ns 0.68 0.19 False
MultiplyOperatorBenchmark - Duration of single invocation 133.95 ns 83.40 ns 0.62 0.11 False
AllBitsSetBenchmark - Duration of single invocation 51.53 ns 15.51 ns 0.30 0.09 False
OnesComplementBenchmark - Duration of single invocation 63.20 ns 29.41 ns 0.47 0.03 False
ConditionalSelectBenchmark - Duration of single invocation 101.72 ns 65.42 ns 0.64 0.06 False
GreaterThanOrEqualBenchmark - Duration of single invocation 126.93 ns 101.65 ns 0.80 0.07 False
AddOperatorBenchmark - Duration of single invocation 122.97 ns 83.79 ns 0.68 0.13 False
BitwiseOrBenchmark - Duration of single invocation 71.17 ns 37.75 ns 0.53 0.10 False
UnaryNegateOperatorBenchmark - Duration of single invocation 115.30 ns 72.67 ns 0.63 0.10 False
MaxBenchmark - Duration of single invocation 132.87 ns 96.26 ns 0.72 0.06 False
MinBenchmark - Duration of single invocation 131.22 ns 96.48 ns 0.74 0.08 False
DivisionOperatorBenchmark - Duration of single invocation 131.31 ns 96.66 ns 0.74 0.06 False
SubtractionOperatorBenchmark - Duration of single invocation 120.80 ns 88.29 ns 0.73 0.06 False
AbsBenchmark - Duration of single invocation 111.57 ns 69.55 ns 0.62 0.13 False
NegateBenchmark - Duration of single invocation 116.49 ns 75.69 ns 0.65 0.10 False
AndNotBenchmark - Duration of single invocation 74.39 ns 40.02 ns 0.54 0.07 False
BitwiseAndBenchmark - Duration of single invocation 72.52 ns 37.76 ns 0.52 0.04 False
BitwiseOrOperatorBenchmark - Duration of single invocation 72.31 ns 37.75 ns 0.52 0.11 False
EqualsStaticBenchmark - Duration of single invocation 125.76 ns 90.86 ns 0.72 0.12 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.38 ns 36.95 ns 0.51 0.09 False
LessThanBenchmark - Duration of single invocation 126.51 ns 91.06 ns 0.72 0.13 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.74774976670456 < 121.24495884593928.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.76633693594626 (T) = (0 -87.8585551910942) / Math.Sqrt((12.273680220428679 / (89)) + (7.5049854838494285 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3094266220098304 = (127.22551721700583 - 87.8585551910942) / 127.22551721700583 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 99.30659411414776 < 128.5974768981899.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.7639787075167 (T) = (0 -96.38933622297165) / Math.Sqrt((6.598256550112516 / (89)) + (1.7093263352259565 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.28540183596008273 = (134.88606754605007 - 96.38933622297165) / 134.88606754605007 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.22413094364147 < 69.42642264673994.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 103.85470286972283 (T) = (0 -36.996431726771355) / Math.Sqrt((7.003351033943854 / (89)) + (0.4137841596785918 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49308089784050885 = (72.98291101906676 - 36.996431726771355) / 72.98291101906676 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.628406113024425 < 69.46547176350562.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 144.04605124351508 (T) = (0 -37.04730304422274) / Math.Sqrt((4.067640646836414 / (89)) + (0.1669912959274024 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49271706118110836 = (73.03084769710584 - 37.04730304422274) / 73.03084769710584 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.03854901723483 < 119.24380346351191.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 61.364906072896176 (T) = (0 -83.46552607186334) / Math.Sqrt((11.53013238177624 / (89)) + (3.319638281597209 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.33309608533709034 = (125.15375039304044 - 83.46552607186334) / 125.15375039304044 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.88117342086122 < 119.05581097771741.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 81.05565905470407 (T) = (0 -87.82037823866251) / Math.Sqrt((11.040515795813706 / (89)) + (0.9481340439526333 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3015748965533578 = (125.74058092310788 - 87.82037823866251) / 125.74058092310788 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 30.083483976701725 < 59.81286230537644.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 132.0575982709816 (T) = (0 -28.732400728595355) / Math.Sqrt((2.344953812160764 / (88)) + (0.40903390007032325 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.5443267029145502 = (63.05482658819776 - 28.732400728595355) / 63.05482658819776 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 84.30288036455146 < 118.81350575040396.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 67.4671764430991 (T) = (0 -85.9974506418002) / Math.Sqrt((12.72790892697127 / (89)) + (1.881720605737205 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.31104901223453635 = (124.82375694201909 - 85.9974506418002) / 124.82375694201909 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 86.28007468116509 < 119.20642712614072.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.59400595936944 (T) = (0 -85.7024138096702) / Math.Sqrt((11.059894489713061 / (89)) + (1.356422153078927 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3158090237871519 = (125.26095313921336 - 85.7024138096702) / 125.26095313921336 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 74.72619481584987 < 102.46751327221472.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.714722965458925 (T) = (0 -73.27273788574902) / Math.Sqrt((15.718275551043673 / (89)) + (8.06729745792246 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3319427963042431 = (109.68033497789885 - 73.27273788574902) / 109.68033497789885 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 83.39701196961367 < 117.24405478173173.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 68.83691184375321 (T) = (0 -83.15894993233199) / Math.Sqrt((7.985480377714987 / (89)) + (2.352512014243905 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.32059992504573226 = (122.40056043256935 - 83.15894993233199) / 122.40056043256935 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.507773699481982 < 48.725663754017866.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 191.36028090799826 (T) = (0 -15.09691748054161) / Math.Sqrt((1.4479706409908202 / (89)) + (0.1873359746075151 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.7033925560055472 = (50.898646632833504 - 15.09691748054161) / 50.898646632833504 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.414736672584752 < 60.059969087439235.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 204.86823768562232 (T) = (0 -28.899944579955125) / Math.Sqrt((1.9692522906021683 / (88)) + (0.05502734422217984 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.5420542323277359 = (63.10778834544839 - 28.899944579955125) / 63.10778834544839 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.42348165552586 < 96.59461867298343.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.699156864916404 (T) = (0 -65.51085122507642) / Math.Sqrt((4.768661463174529 / (89)) + (15.652168630582171 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3497878014568003 = (100.75303319724463 - 65.51085122507642) / 100.75303319724463 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 101.64718203591528 < 120.5556249045557.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.31282987776502 (T) = (0 -91.1683731525699) / Math.Sqrt((6.369135785604487 / (89)) + (15.65314783114995 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.27708725301047893 = (126.11255442960314 - 91.1683731525699) / 126.11255442960314 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 83.79028023714172 < 116.7964944808493.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 64.68367347975813 (T) = (0 -80.34688048936331) / Math.Sqrt((20.65245951227587 / (89)) + (2.021099667529503 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3466006097535326 = (122.96748617879156 - 80.34688048936331) / 122.96748617879156 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.752249330385204 < 68.47900457582472.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 173.24923868085577 (T) = (0 -37.386241724677966) / Math.Sqrt((2.1266426079431353 / (89)) + (0.1596829974661622 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48057905977960985 = (71.97677034124769 - 37.386241724677966) / 71.97677034124769 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 72.67388924716089 < 109.56022776435303.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 39.6473071088502 (T) = (0 -74.67566921255192) / Math.Sqrt((10.50448854889306 / (89)) + (8.647343923476926 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3448340515434398 = (113.97977777763458 - 74.67566921255192) / 113.97977777763458 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.25750998326484 < 127.21115976564583.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 50.927809275407206 (T) = (0 -93.90319062130213) / Math.Sqrt((9.854240526885981 / (89)) + (4.826562719926429 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2946684814992907 = (133.1334105427584 - 93.90319062130213) / 133.1334105427584 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.4802599383225 < 124.89977971610926.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.91762128147502 (T) = (0 -93.62552241614733) / Math.Sqrt((6.356488222299864 / (89)) + (1.612417834401096 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2864409058266593 = (131.20920633015356 - 93.62552241614733) / 131.20920633015356 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.65815507736272 < 124.88464834617554.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 76.1715889506848 (T) = (0 -93.91135371389277) / Math.Sqrt((8.245423144337245 / (89)) + (1.5870208491203195 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.28908695762996606 = (132.09963542209346 - 93.91135371389277) / 132.09963542209346 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 88.2872006823528 < 116.82595524136524.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 57.08856492183305 (T) = (0 -83.36460060758587) / Math.Sqrt((7.369229390091108 / (89)) + (3.7026732344525004 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.31551147184601386 = (121.79108513683042 - 83.36460060758587) / 121.79108513683042 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 69.54705516974914 < 105.84938169863642.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 83.75186550230653 (T) = (0 -69.60409364857063) / Math.Sqrt((13.301245323577875 / (89)) + (0.9034216038295756 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3707614145187239 = (110.61637867508333 - 69.60409364857063) / 110.61637867508333 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 75.68663493415042 < 112.03119342388653.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.5099758593666 (T) = (0 -76.42457989892043) / Math.Sqrt((7.514406585595501 / (89)) + (6.415473649907297 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3414689970760705 = (116.05312363364712 - 76.42457989892043) / 116.05312363364712 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 40.02124139765316 < 70.50909429752288.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 169.95094838025526 (T) = (0 -38.93875170320413) / Math.Sqrt((2.1734324822590643 / (88)) + (0.18201629390320206 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.4747901428849329 = (74.13941527505095 - 38.93875170320413) / 74.13941527505095 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.76148516964835 < 68.66182362871314.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 169.51608736209673 (T) = (0 -37.04265515090648) / Math.Sqrt((2.318226117522904 / (89)) + (0.17163267623436346 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48751379167668285 = (72.28029661929364 - 37.04265515090648) / 72.28029661929364 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.75035001219084 < 68.68823438129164.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 109.93888680270028 (T) = (0 -37.51654432917949) / Math.Sqrt((2.648005158097269 / (89)) + (0.7025797462753703 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4809852439986467 = (72.28415742592426 - 37.51654432917949) / 72.28415742592426 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 90.86160412041762 < 119.68927673065019.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 79.04582923176831 (T) = (0 -89.18497930894891) / Math.Sqrt((10.378069419045465 / (89)) + (1.01820462333562 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29290135821116164 = (126.12805913942388 - 89.18497930894891) / 126.12805913942388 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 36.950277993656194 < 68.92065349155672.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 113.03621091559422 (T) = (0 -37.156322232134556) / Math.Sqrt((4.533908626549387 / (89)) + (0.47267160186063123 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4880648742724104 = (72.58013831210742 - 37.156322232134556) / 72.58013831210742 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 91.0625497659021 < 120.29457168229774.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 75.45292165374372 (T) = (0 -88.76915498301581) / Math.Sqrt((12.834942803997592 / (89)) + (1.0607225116481733 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2983625100988402 = (126.51712067939926 - 88.76915498301581) / 126.51712067939926 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConvertFloatToIntBenchmark - Duration of single invocation 121.46 ns 87.14 ns 0.72 0.09 False
ConvertDoubleToLongBenchmark - Duration of single invocation 112.42 ns 64.36 ns 0.57 0.11 False
ConvertLongToDoubleBenchmark - Duration of single invocation 103.28 ns 83.76 ns 0.81 0.10 False
FloorFloatBenchmark - Duration of single invocation 125.88 ns 92.28 ns 0.73 0.14 False
ConvertIntToFloatBenchmark - Duration of single invocation 119.99 ns 86.66 ns 0.72 0.14 False
ConvertFloatToUIntBenchmark - Duration of single invocation 143.35 ns 100.01 ns 0.70 0.16 False
CeilingDoubleBenchmark - Duration of single invocation 101.20 ns 67.44 ns 0.67 0.13 False
FloorDoubleBenchmark - Duration of single invocation 104.27 ns 67.16 ns 0.64 0.20 False
ConvertDoubleToULongBenchmark - Duration of single invocation 102.94 ns 65.58 ns 0.64 0.10 False
ConvertULongToDoubleBenchmark - Duration of single invocation 102.64 ns 68.89 ns 0.67 0.09 False
CeilingFloatBenchmark - Duration of single invocation 125.57 ns 92.04 ns 0.73 0.12 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertFloatToIntBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.14081091106998 < 115.52057160299556.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 100.4037942317422 (T) = (0 -85.0447642371034) / Math.Sqrt((6.984934140965485 / (89)) + (0.6369282018660799 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3080342983128783 = (122.90314972223453 - 85.0447642371034) / 122.90314972223453 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertDoubleToLongBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 64.35551056026314 < 95.8073234242288.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 105.75384455956588 (T) = (0 -63.26187318763321) / Math.Sqrt((8.508750657351875 / (89)) + (0.32614820752209034 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.37444897434094376 = (101.12983688418217 - 63.26187318763321) / 101.12983688418217 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertLongToDoubleBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 83.76036857702381 < 97.92121269745188.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 17.848935672874426 (T) = (0 -71.79504323998873) / Math.Sqrt((6.484586761489241 / (89)) + (30.86729458455839 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3064751441144988 = (103.52194680653503 - 71.79504323998873) / 103.52194680653503 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.FloorFloatBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 92.27980655826454 < 119.66689643820918.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 29.766520471644043 (T) = (0 -93.05367092916298) / Math.Sqrt((10.941007178403295 / (89)) + (11.170327771598942 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.26264805166669264 = (126.19980341748504 - 93.05367092916298) / 126.19980341748504 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertIntToFloatBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 86.65878505469354 < 113.93350642922556.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 25.094270485512627 (T) = (0 -86.0530515358919) / Math.Sqrt((10.896837371403166 / (89)) + (18.51138405029491 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2906145572260766 = (121.30648071857382 - 86.0530515358919) / 121.30648071857382 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertFloatToUIntBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 100.00740564667122 < 126.86632230747077.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 57.75282223600575 (T) = (0 -98.37002881071098) / Math.Sqrt((15.61328245455137 / (89)) + (1.6688471155466749 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25567395958192196 = (132.15986472199447 - 98.37002881071098) / 132.15986472199447 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.CeilingDoubleBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 67.43583341409034 < 96.57244884022707.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 61.369157025136424 (T) = (0 -66.79515741174012) / Math.Sqrt((7.1908110883765195 / (89)) + (2.705127990454426 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.35256838595241263 = (103.16944054392525 - 66.79515741174012) / 103.16944054392525 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.FloorDoubleBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 67.1598869698169 < 98.97744430985016.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 83.06525715870687 (T) = (0 -66.41844179628102) / Math.Sqrt((11.071301609039848 / (89)) + (0.6478076237511358 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.35231398793520413 = (102.54728457781852 - 66.41844179628102) / 102.54728457781852 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertDoubleToULongBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.58397832128331 < 97.37340586387549.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 25.44222357138457 (T) = (0 -65.74610373935715) / Math.Sqrt((5.094214007971422 / (89)) + (20.029262712429606 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.35709449330135806 = (102.2640233351979 - 65.74610373935715) / 102.2640233351979 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertULongToDoubleBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 68.89037867969897 < 98.00232838039447.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 91.371200261373 (T) = (0 -68.94455343415758) / Math.Sqrt((9.419199584761099 / (89)) + (0.2409681340257609 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.32327754381607643 = (101.88010284591388 - 68.94455343415758) / 101.88010284591388 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128.CeilingFloatBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 92.04499903397199 < 119.16224578241808.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 55.749302544756496 (T) = (0 -92.78585815130674) / Math.Sqrt((12.22525423132865 / (89)) + (2.262975928392999 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2659639644206767 = (126.40504505760042 - 92.78585815130674) / 126.40504505760042 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
LessThanBenchmark - Duration of single invocation 128.49 ns 96.26 ns 0.75 0.13 False
DivideBenchmark - Duration of single invocation 136.37 ns 95.54 ns 0.70 0.09 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.36 ns 37.50 ns 0.52 0.16 False
MultiplyOperatorBenchmark - Duration of single invocation 123.00 ns 83.62 ns 0.68 0.10 False
ConditionalSelectBenchmark - Duration of single invocation 102.14 ns 61.91 ns 0.61 0.12 False
GreaterThanBenchmark - Duration of single invocation 126.19 ns 89.21 ns 0.71 0.13 False
XorBenchmark - Duration of single invocation 73.30 ns 37.28 ns 0.51 0.09 False
GreaterThanOrEqualBenchmark - Duration of single invocation 126.98 ns 89.30 ns 0.70 0.13 False
AddBenchmark - Duration of single invocation 125.28 ns 86.12 ns 0.69 0.10 False
AndNotBenchmark - Duration of single invocation 74.86 ns 39.24 ns 0.52 0.13 False
BitwiseOrBenchmark - Duration of single invocation 72.07 ns 37.59 ns 0.52 0.03 False
AllBitsSetBenchmark - Duration of single invocation 50.72 ns 15.48 ns 0.31 0.13 False
OnesComplementOperatorBenchmark - Duration of single invocation 62.90 ns 29.27 ns 0.47 0.09 False
BitwiseOrOperatorBenchmark - Duration of single invocation 73.12 ns 37.02 ns 0.51 0.09 False
MinBenchmark - Duration of single invocation 130.64 ns 98.75 ns 0.76 0.13 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 76.82 ns 37.19 ns 0.48 0.14 False
NegateBenchmark - Duration of single invocation 117.65 ns 75.20 ns 0.64 0.17 False
OnesComplementBenchmark - Duration of single invocation 63.57 ns 30.23 ns 0.48 0.08 False
SubtractBenchmark - Duration of single invocation 124.41 ns 88.28 ns 0.71 0.22 False
DivisionOperatorBenchmark - Duration of single invocation 129.61 ns 93.02 ns 0.72 0.05 False
MultiplyBenchmark - Duration of single invocation 125.58 ns 89.09 ns 0.71 0.07 False
AddOperatorBenchmark - Duration of single invocation 122.92 ns 84.04 ns 0.68 0.03 False
BitwiseAndBenchmark - Duration of single invocation 72.39 ns 37.09 ns 0.51 0.07 False
AbsBenchmark - Duration of single invocation 52.41 ns 19.09 ns 0.36 0.09 False
SquareRootBenchmark - Duration of single invocation 104.21 ns 69.75 ns 0.67 0.09 False
EqualsStaticBenchmark - Duration of single invocation 125.28 ns 90.93 ns 0.73 0.06 False
UnaryNegateOperatorBenchmark - Duration of single invocation 115.68 ns 73.19 ns 0.63 0.14 False
MaxBenchmark - Duration of single invocation 133.26 ns 95.92 ns 0.72 0.15 False
LessThanOrEqualBenchmark - Duration of single invocation 127.10 ns 88.90 ns 0.70 0.08 False
SubtractionOperatorBenchmark - Duration of single invocation 121.78 ns 84.60 ns 0.69 0.08 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.25661001223894 < 120.99476169232878.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 40.596471730800005 (T) = (0 -89.56964808020165) / Math.Sqrt((10.520989475941322 / (89)) + (7.244512476223014 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29381467764350194 = (126.83589596752465 - 89.56964808020165) / 126.83589596752465 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 95.54460684734262 < 124.83425177078801.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 87.55646088841489 (T) = (0 -95.04147835073641) / Math.Sqrt((14.441892599165975 / (89)) + (0.13970317203655064 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.27888737078588044 = (131.79838280507468 - 95.04147835073641) / 131.79838280507468 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.497712754918474 < 68.60229259747129.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 11.833907554442547 (T) = (0 -40.25331291017481) / Math.Sqrt((2.866680704154244 / (89)) + (72.92196963856281 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.44309331875788127 = (72.28017595406514 - 40.25331291017481) / 72.28017595406514 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 83.62209162640806 < 116.83244191829728.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 107.58930929194469 (T) = (0 -82.44364776543348) / Math.Sqrt((7.537462103610583 / (89)) + (0.5448577015973924 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.32743693372607197 = (122.58128924946799 - 82.44364776543348) / 122.58128924946799 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 61.91327561614234 < 96.86283976466531.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 45.18843526886488 (T) = (0 -64.99823590084384) / Math.Sqrt((6.295572291581035 / (89)) + (5.718267029753654 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3578601671415874 = (101.22131127033744 - 64.99823590084384) / 101.22131127033744 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.2069573462827 < 120.33939022416172.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 90.30791850544641 (T) = (0 -88.24775763092865) / Math.Sqrt((9.263307839941463 / (89)) + (0.7752417001443125 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3036703906632117 = (126.73273755366985 - 88.24775763092865) / 126.73273755366985 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.28425870927319 < 69.490247979091.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 183.60425984848712 (T) = (0 -36.76056305631116) / Math.Sqrt((2.5970772349946083 / (89)) + (0.09077005568188182 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4941630597613468 = (72.67275307921872 - 36.76056305631116) / 72.67275307921872 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.30298498050662 < 122.17424865567564.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 76.28372573205041 (T) = (0 -89.23319167905909) / Math.Sqrt((15.977853462938896 / (89)) + (0.6201429251181806 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29584725219217606 = (126.72419720985374 - 89.23319167905909) / 126.72419720985374 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 86.11747201929309 < 119.56043005322962.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 69.90959090088272 (T) = (0 -83.54335994841247) / Math.Sqrt((8.31870762069607 / (89)) + (2.566388094593307 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.33116502549007504 = (124.90877889516341 - 83.54335994841247) / 124.90877889516341 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.24433703331385 < 70.46976495460547.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 91.91721279440327 (T) = (0 -39.29409421449023) / Math.Sqrt((3.4207449877399805 / (88)) + (1.0060347020975984 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.4662715938737359 = (73.62189039118601 - 39.29409421449023) / 73.62189039118601 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.58550836651313 < 68.50698517983504.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 186.32471337693195 (T) = (0 -37.336545950656514) / Math.Sqrt((1.5933233189588938 / (89)) + (0.17154220842585943 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.483037625681778 = (72.22294659238311 - 37.336545950656514) / 72.22294659238311 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.476259815232524 < 48.34469196523705.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 76.19913902165756 (T) = (0 -14.591976493502717) / Math.Sqrt((0.9606744147663243 / (89)) + (2.133460110228627 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.7120038825830372 = (50.66726810200828 - 14.591976493502717) / 50.66726810200828 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.265132257773683 < 59.70374461052732.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 188.87751071613582 (T) = (0 -28.81621459407602) / Math.Sqrt((2.2351020319257913 / (88)) + (0.07775562039842099 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.5441777032968463 = (63.21808915995628 - 28.81621459407602) / 63.21808915995628 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.01867620651805 < 69.09260217165782.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 110.46280254212546 (T) = (0 -37.175398563832005) / Math.Sqrt((2.9879349614854958 / (89)) + (0.6790717683294029 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4862740212690104 = (72.3642566328123 - 37.175398563832005) / 72.3642566328123 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 98.74962485377355 < 124.32647307867789.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 47.36865299978713 (T) = (0 -93.93117348474996) / Math.Sqrt((15.010251925645166 / (89)) + (4.693024757828823 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.287134126490722 = (131.76556344652602 - 93.93117348474996) / 131.76556344652602 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.18880485538762 < 69.28288190400218.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 132.09402614246025 (T) = (0 -37.001943210936744) / Math.Sqrt((3.658399597994771 / (89)) + (0.3177423224953033 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4907690455435987 = (72.66239981510144 - 37.001943210936744) / 72.66239981510144 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 75.19606203838143 < 111.58735756375529.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 35.11292969197112 (T) = (0 -76.47227843249007) / Math.Sqrt((14.370484233274988 / (89)) + (11.382123419493489 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3435981379153583 = (116.50222653181494 - 76.47227843249007) / 116.50222653181494 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 30.23400845008414 < 60.20180049312098.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 138.94175381068297 (T) = (0 -28.94142900220906) / Math.Sqrt((2.4756333637070047 / (88)) + (0.32387932898229643 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.5415020646526152 = (63.12226679991775 - 28.94142900220906) / 63.12226679991775 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 88.28199267265582 < 118.14897656648817.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 30.143117435671197 (T) = (0 -87.56996738315692) / Math.Sqrt((12.481146851369198 / (89)) + (13.605736876312578 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29661308551095716 = (124.4975781882008 - 87.56996738315692) / 124.4975781882008 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 93.01636281109502 < 122.1420818097595.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 128.08507297127085 (T) = (0 -92.35883875050048) / Math.Sqrt((5.601943037306281 / (89)) + (0.1846506330583016 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2835081289807615 = (128.9042381166395 - 92.35883875050048) / 128.9042381166395 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.09323099369739 < 119.69460669814974.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.74803866344297 (T) = (0 -86.28467537780132) / Math.Sqrt((9.744084858919186 / (89)) + (1.4211827855114878 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.311282280751932 = (125.28307747331617 - 86.28467537780132) / 125.28307747331617 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 84.0401399614118 < 117.01536967067214.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 59.704671868153994 (T) = (0 -81.56120801164732) / Math.Sqrt((6.575470905768366 / (89)) + (3.873819208783999 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3320702932347487 = (122.11046639420186 - 81.56120801164732) / 122.11046639420186 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.09094059903848 < 68.64318631369927.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 209.41453347987178 (T) = (0 -36.85364462227794) / Math.Sqrt((1.936732798519891 / (89)) + (0.06711162254477347 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4894884782076364 = (72.18964322859522 - 36.85364462227794) / 72.18964322859522 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 19.089415971463577 < 50.423511983730705.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 180.54332383649765 (T) = (0 -18.564184577967968) / Math.Sqrt((0.7989095667583853 / (89)) + (0.2730360616058706 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6494207231910507 = (52.952886282792605 - 18.564184577967968) / 52.952886282792605 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 69.75312820434854 < 99.26893252350108.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 111.28981356954526 (T) = (0 -69.5486332497294) / Math.Sqrt((7.914514070010136 / (89)) + (0.13324737078370336 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3384863896404641 = (105.13560440869747 - 69.5486332497294) / 105.13560440869747 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 90.93230347433418 < 119.4771784944521.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 76.45245654721548 (T) = (0 -89.39540810657842) / Math.Sqrt((8.819265111431664 / (89)) + (1.2741548997399512 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2892792783772454 = (125.78134474884334 - 89.39540810657842) / 125.78134474884334 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 73.19438820457837 < 109.63573314572463.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 18.70231695132073 (T) = (0 -74.95167171616812) / Math.Sqrt((12.483678147734635 / (89)) + (42.98205245040915 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3445594174347255 = (114.35311408826868 - 74.95167171616812) / 114.35311408826868 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 95.91704826103192 < 127.33334125906306.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 68.5181338954964 (T) = (0 -95.19904466913098) / Math.Sqrt((23.453931868190658 / (89)) + (0.5896294670121593 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29013826563141587 = (134.1092779903254 - 95.19904466913098) / 134.1092779903254 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 88.9024029186882 < 121.26208007982956.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 72.24957486799481 (T) = (0 -89.07361706280403) / Math.Sqrt((9.704931115176187 / (89)) + (1.7792071364342534 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3028982469070281 = (127.7770665008274 - 89.07361706280403) / 127.7770665008274 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 84.6015996325385 < 116.27289180210985.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 79.92251558775989 (T) = (0 -82.89260166430981) / Math.Sqrt((6.245341125311688 / (89)) + (1.6669470790950645 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3193813603115622 = (121.79008453582023 - 82.89260166430981) / 121.79008453582023 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SquareRootBenchmark - Duration of single invocation 129.89 ns 92.06 ns 0.71 0.17 False
DivisionOperatorBenchmark - Duration of single invocation 166.53 ns 118.80 ns 0.71 0.18 False
SubtractionOperatorBenchmark - Duration of single invocation 153.59 ns 119.62 ns 0.78 0.14 False
BitwiseAndOperatorBenchmark - Duration of single invocation 73.40 ns 37.16 ns 0.51 0.16 False
AllBitsSetBenchmark - Duration of single invocation 51.14 ns 15.17 ns 0.30 0.03 False
EqualsBenchmark - Duration of single invocation 220.59 ns 204.23 ns 0.93 0.19 False
MultiplyBenchmark - Duration of single invocation 159.60 ns 126.58 ns 0.79 0.18 False
LessThanBenchmark - Duration of single invocation 163.91 ns 126.50 ns 0.77 0.17 False
LessThanOrEqualBenchmark - Duration of single invocation 167.85 ns 137.44 ns 0.82 0.08 False
MultiplyOperatorBenchmark - Duration of single invocation 155.41 ns 119.97 ns 0.77 0.20 False
GreaterThanOrEqualBenchmark - Duration of single invocation 168.12 ns 130.07 ns 0.77 0.13 False
XorBenchmark - Duration of single invocation 72.87 ns 36.69 ns 0.50 0.12 False
UnaryNegateOperatorBenchmark - Duration of single invocation 149.73 ns 112.32 ns 0.75 0.22 False
NegateBenchmark - Duration of single invocation 152.87 ns 120.40 ns 0.79 0.13 False
AddOperatorBenchmark - Duration of single invocation 175.56 ns 134.03 ns 0.76 0.16 False
AddBenchmark - Duration of single invocation 158.02 ns 127.29 ns 0.81 0.18 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 72.42 ns 37.25 ns 0.51 0.11 False
DivideBenchmark - Duration of single invocation 157.40 ns 120.80 ns 0.77 0.17 False
OnesComplementOperatorBenchmark - Duration of single invocation 63.02 ns 29.04 ns 0.46 0.09 False
AndNotBenchmark - Duration of single invocation 74.33 ns 39.30 ns 0.53 0.06 False
OnesComplementBenchmark - Duration of single invocation 63.08 ns 29.53 ns 0.47 0.16 False
BitwiseOrBenchmark - Duration of single invocation 69.27 ns 38.48 ns 0.56 0.13 False
MaxBenchmark - Duration of single invocation 181.92 ns 140.16 ns 0.77 0.15 False
SubtractBenchmark - Duration of single invocation 157.21 ns 122.32 ns 0.78 0.17 False
BitwiseAndBenchmark - Duration of single invocation 72.35 ns 37.06 ns 0.51 0.10 False
ConditionalSelectBenchmark - Duration of single invocation 102.60 ns 65.78 ns 0.64 0.12 False
AbsBenchmark - Duration of single invocation 127.27 ns 93.33 ns 0.73 0.19 False
MinBenchmark - Duration of single invocation 180.29 ns 140.87 ns 0.78 0.22 False
BitwiseOrOperatorBenchmark - Duration of single invocation 69.79 ns 37.88 ns 0.54 0.12 False
EqualsStaticBenchmark - Duration of single invocation 164.72 ns 133.65 ns 0.81 0.14 False
GreaterThanBenchmark - Duration of single invocation 173.52 ns 125.83 ns 0.73 0.14 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SquareRootBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 92.06266591609389 < 122.97258437808266.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 24.492472264162412 (T) = (0 -94.59831245005172) / Math.Sqrt((19.011442483934285 / (89)) + (20.00070349586561 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.27809210076735946 = (131.0393092395941 - 94.59831245005172) / 131.0393092395941 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 118.79737284545841 < 146.06920866699178.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 72.92437688438042 (T) = (0 -119.27580889473009) / Math.Sqrt((19.76100056018469 / (89)) + (0.36664014142902807 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23720527596738067 = (156.36685091915962 - 119.27580889473009) / 156.36685091915962 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.61986221789638 < 146.55032282780272.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 54.315983551908054 (T) = (0 -120.24196766569919) / Math.Sqrt((28.753842665028834 / (89)) + (1.2723458167863602 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23261650657731844 = (156.6908445338019 - 120.24196766569919) / 156.6908445338019 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.1644419843127 < 68.93508725967942.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 87.69302347725305 (T) = (0 -37.32679865349361) / Math.Sqrt((3.9585447553189685 / (89)) + (1.145846315549306 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48373131722100765 = (72.30110967136217 - 37.32679865349361) / 72.30110967136217 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.165249716926443 < 48.59946974064498.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 262.18721763806064 (T) = (0 -15.217270498335044) / Math.Sqrt((0.5949278811439487 / (89)) + (0.11707036674994023 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.7002938908771659 = (50.77397502130419 - 15.217270498335044) / 50.77397502130419 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.EqualsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 204.22776090303995 < 209.89247991946985.
IsChangePoint: Marked as a change because one of 12/2/2022 10:04:21 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 8.810914736292382 (T) = (0 -207.4891897573958) / Math.Sqrt((37.52539932667157 / (84)) + (31.480174535401414 / (15))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (84) + (15) - 2, .975) and 0.06345050275013027 = (221.54642158975827 - 207.4891897573958) / 221.54642158975827 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 126.58420816345279 < 150.2268285065256.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 51.47225400269973 (T) = (0 -123.33822593283006) / Math.Sqrt((25.399214670747657 / (89)) + (2.180785286040788 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.228463055119355 = (159.86042761945794 - 123.33822593283006) / 159.86042761945794 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 126.50124870886823 < 156.95300609845484.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.35624842776375 (T) = (0 -127.45225256402338) / Math.Sqrt((15.085156077722319 / (89)) + (15.471277940894055 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22570665508707277 = (164.60460806150408 - 127.45225256402338) / 164.60460806150408 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 137.43734061973856 < 160.26779360561255.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.78178574695906 (T) = (0 -131.34240763521893) / Math.Sqrt((11.260230293417242 / (89)) + (8.862735735317019 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21986573001635482 = (168.3587206571151 - 131.34240763521893) / 168.3587206571151 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.97217156428313 < 148.51632962938172.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.064937434002545 (T) = (0 -120.46518105011357) / Math.Sqrt((15.385900803533682 / (88)) + (3.1799013692772293 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.23278271306053536 = (157.0157282699739 - 120.46518105011357) / 157.0157282699739 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 130.06909302870528 < 159.68396826475862.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 38.44419496406567 (T) = (0 -131.04817474170505) / Math.Sqrt((19.760360381488972 / (89)) + (7.555544958908099 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22483757285223926 = (169.05898706146237 - 131.04817474170505) / 169.05898706146237 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 36.68839659557817 < 69.53292479275413.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 116.37842579444046 (T) = (0 -36.83169619112657) / Math.Sqrt((7.64023395387728 / (88)) + (0.08901614975602244 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.4943345440598014 = (72.83807062249153 - 36.83169619112657) / 72.83807062249153 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 112.32175552483253 < 142.67594848577747.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 45.56726902411883 (T) = (0 -112.56770541351901) / Math.Sqrt((21.375935314295223 / (89)) + (3.9209158613431896 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.24350027996471027 = (148.8007231625517 - 112.56770541351901) / 148.8007231625517 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 120.40216493282361 < 144.70452434982786.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.38386249704785 (T) = (0 -115.11167920015657) / Math.Sqrt((12.995373578546717 / (88)) + (4.376769166706868 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.23564201971997012 = (150.5991723380507 - 115.11167920015657) / 150.5991723380507 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 134.03134172974578 < 147.7395944251955.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.77577328039761 (T) = (0 -121.02204164653287) / Math.Sqrt((27.681697185557486 / (89)) + (21.58532807801976 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2282437426192754 = (156.81381328513154 - 121.02204164653287) / 156.81381328513154 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 127.28622373293396 < 150.09745295422937.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.85205363166125 (T) = (0 -122.67602429315289) / Math.Sqrt((18.16439803956318 / (88)) + (2.8210141575326415 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.2314320118530613 = (159.61635949596572 - 122.67602429315289) / 159.61635949596572 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.245025748184325 < 69.40849087437529.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 130.78668618637641 (T) = (0 -37.19208376282278) / Math.Sqrt((4.724918230001537 / (89)) + (0.21746853240947084 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49031181474276775 = (72.97026856538272 - 37.19208376282278) / 72.97026856538272 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 120.79722177555799 < 149.78775672259405.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.07958126970003 (T) = (0 -122.33443527145717) / Math.Sqrt((42.34659865088923 / (89)) + (2.3627398112750058 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23316138955027405 = (159.53087599450944 - 122.33443527145717) / 159.53087599450944 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.037712043306332 < 59.82464553687068.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 205.95195662034155 (T) = (0 -28.891599266402135) / Math.Sqrt((2.0713601041027516 / (89)) + (0.044710837745896445 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5428294087132306 = (63.19653935981044 - 28.891599266402135) / 63.19653935981044 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.29533566577553 < 70.5188448151033.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 226.61537568514137 (T) = (0 -38.96396049245645) / Math.Sqrt((1.5727245940980799 / (89)) + (0.06025305594833662 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47237823443662014 = (73.84828116567901 - 38.96396049245645) / 73.84828116567901 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.528203523225486 < 59.81761927373873.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 125.21909087207665 (T) = (0 -28.752846462452077) / Math.Sqrt((4.370496161785722 / (89)) + (0.2656096137389261 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.545034114246842 = (63.19780749023444 - 28.752846462452077) / 63.19780749023444 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.48249878920821 < 68.38795741718253.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 104.7381994655565 (T) = (0 -37.56881727846332) / Math.Sqrt((6.293387071800112 / (89)) + (0.39130758535236787 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48024473778710536 = (72.28174490915481 - 37.56881727846332) / 72.28174490915481 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 140.15668095662824 < 171.94957425066883.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.525382770301125 (T) = (0 -144.28690534737305) / Math.Sqrt((24.463701190292678 / (89)) + (52.741678289663604 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2022138329205101 = (180.85912153074042 - 144.28690534737305) / 180.85912153074042 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 122.32320929057535 < 149.50505275040038.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 23.652399910542925 (T) = (0 -125.23799838850975) / Math.Sqrt((17.516566688701214 / (89)) + (18.128239783286084 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21118893140728517 = (158.76805406894414 - 125.23799838850975) / 158.76805406894414 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.057289104333684 < 68.6075945668807.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 108.11455775667713 (T) = (0 -37.42136991466722) / Math.Sqrt((2.652068926195332 / (89)) + (0.7250587671975781 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4802722907156766 = (72.00187568639986 - 37.42136991466722) / 72.00187568639986 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.77963249843155 < 97.17343053268878.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 32.9765524572884 (T) = (0 -66.14043450563959) / Math.Sqrt((7.463227199272165 / (89)) + (10.440592775705218 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3461970774053599 = (101.1626473665167 - 66.14043450563959) / 101.1626473665167 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 93.32868286543496 < 120.94455994927772.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 26.51220935584902 (T) = (0 -97.33254707052888) / Math.Sqrt((17.054648262747676 / (89)) + (11.817661138936886 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2419741639659775 = (128.40267764456553 - 97.33254707052888) / 128.40267764456553 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 140.8656318668835 < 172.30339473229108.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.802236559288225 (T) = (0 -141.99309304826744) / Math.Sqrt((30.880326461632237 / (89)) + (51.386063759918514 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2170050997869914 = (181.34612755413752 - 141.99309304826744) / 181.34612755413752 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.88344307636042 < 68.65075326746874.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 158.65879973647637 (T) = (0 -37.2501610462325) / Math.Sqrt((2.5980570828196576 / (88)) + (0.18592521768596773 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.48301363775693584 = (72.05250228383997 - 37.2501610462325) / 72.05250228383997 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 133.65179179287466 < 156.2962593292567.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 31.347124286312045 (T) = (0 -126.53609100437356) / Math.Sqrt((18.103706539496912 / (89)) + (11.80216546673089 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22564802111308835 = (163.4090109594118 - 126.53609100437356) / 163.4090109594118 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 125.82523588246859 < 156.17453270875973.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 37.130187210581994 (T) = (0 -127.44549202270593) / Math.Sqrt((21.290052376590307 / (89)) + (7.783274183343325 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22713431401433137 = (164.8999228891489 - 127.44549202270593) / 164.8999228891489 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Collections.Sort<BigStruct>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
List - Duration of single invocation 307.31 μs 248.66 μs 0.81 0.02 False
Array_ComparerClass - Duration of single invocation 248.08 μs 186.40 μs 0.75 0.04 False
Array - Duration of single invocation 309.88 μs 254.15 μs 0.82 0.02 False
Array_ComparerStruct - Duration of single invocation 251.65 μs 188.31 μs 0.75 0.02 False
Array_Comparison - Duration of single invocation 247.26 μs 188.58 μs 0.76 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;BigStruct&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Sort<BigStruct>.List(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 248.65723020000001 < 289.07895360285715.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 38.5302867410353 (T) = (0 -249405.487118381) / Math.Sqrt((87111412.21989433 / (299)) + (18006183.593890738 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.18263673377363912 = (305134.20094084647 - 249405.487118381) / 305134.20094084647 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;BigStruct&gt;.Array_ComparerClass(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 186.39702101333336 < 235.77492302183336.
IsChangePoint: Marked as a change because one of 10/22/2022 11:54:51 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 119.47857201511214 (T) = (0 -187772.70053085714) / Math.Sqrt((28646503.171216857 / (299)) + (1547007.926748422 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.24154523926177626 = (247572.7100032876 - 187772.70053085714) / 247572.7100032876 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;BigStruct&gt;.Array(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 254.14980934285714 < 291.46651195821426.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 75.79045553741946 (T) = (0 -252977.92045473628) / Math.Sqrt((98509306.39799337 / (299)) + (2400615.590486651 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.184401475676578 = (310174.5686268787 - 252977.92045473628) / 310174.5686268787 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;BigStruct&gt;.Array_ComparerStruct(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 188.3057339333333 < 238.16402105666666.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 143.78600235823356 (T) = (0 -189495.57259708425) / Math.Sqrt((23611392.247803915 / (299)) + (927849.151169619 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.23923300487598143 = (249084.90222580318 - 189495.57259708425) / 249084.90222580318 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;BigStruct&gt;.Array_Comparison(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 188.57831015384613 < 236.58519211033334.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 51.29076924280911 (T) = (0 -189756.1694577656) / Math.Sqrt((26476246.923973817 / (299)) + (11925614.701105375 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.23426819791197928 = (247810.22407627932 - 189756.1694577656) / 247810.22407627932 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Collections.Sort<IntStruct>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Array_ComparerStruct - Duration of single invocation 245.12 μs 185.09 μs 0.76 0.06 False
Array - Duration of single invocation 292.62 μs 236.89 μs 0.81 0.01 False
Array_ComparerClass - Duration of single invocation 242.26 μs 184.91 μs 0.76 0.02 False
List - Duration of single invocation 294.43 μs 239.21 μs 0.81 0.02 False
Array_Comparison - Duration of single invocation 242.20 μs 196.79 μs 0.81 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;IntStruct&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Sort<IntStruct>.Array_ComparerStruct(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 185.0929415285714 < 232.17732184769227.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 30.152124148799366 (T) = (0 -188069.55931709887) / Math.Sqrt((28616619.945315007 / (299)) + (26984281.44179731 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.21135200500015688 = (238470.85202712813 - 188069.55931709887) / 238470.85202712813 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;IntStruct&gt;.Array(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 236.88925439999997 < 278.80899875538455.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 79.28414240961362 (T) = (0 -238113.10016789744) / Math.Sqrt((86889032.9125666 / (299)) + (1690594.4341928673 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.18417046364021808 = (291866.24111496896 - 238113.10016789744) / 291866.24111496896 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;IntStruct&gt;.Array_ComparerClass(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 184.90749105714283 < 231.14457043254757.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 48.54327540167673 (T) = (0 -186142.14540738094) / Math.Sqrt((22199965.233499393 / (299)) + (10249684.009346562 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.2147114104750227 = (237036.6103498062 - 186142.14540738094) / 237036.6103498062 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;IntStruct&gt;.List(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 239.2055054933334 < 280.0901182611795.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 84.92259739083977 (T) = (0 -238362.67220658608) / Math.Sqrt((94689380.62047437 / (299)) + (838507.5155208118 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.18399274970438365 = (292108.5224674585 - 238362.67220658608) / 292108.5224674585 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;IntStruct&gt;.Array_Comparison(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 196.79233436923076 < 230.9771407483333.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 37.98217326242963 (T) = (0 -185305.4949006374) / Math.Sqrt((41446925.38212954 / (299)) + (17597199.973726325 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.22021749780777364 = (237637.41091866308 - 185305.4949006374) / 237637.41091866308 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConditionalSelectBenchmark - Duration of single invocation 101.74 ns 65.41 ns 0.64 0.11 False
MultiplyBenchmark - Duration of single invocation 128.95 ns 89.87 ns 0.70 0.09 False
AddBenchmark - Duration of single invocation 129.01 ns 89.67 ns 0.70 0.09 False
LessThanOrEqualBenchmark - Duration of single invocation 135.01 ns 93.00 ns 0.69 0.08 False
NegateBenchmark - Duration of single invocation 120.08 ns 81.11 ns 0.68 0.09 False
DivideBenchmark - Duration of single invocation 132.17 ns 91.03 ns 0.69 0.09 False
MaxBenchmark - Duration of single invocation 137.99 ns 99.46 ns 0.72 0.12 False
MultiplyOperatorBenchmark - Duration of single invocation 124.96 ns 87.62 ns 0.70 0.22 False
OnesComplementOperatorBenchmark - Duration of single invocation 62.85 ns 29.50 ns 0.47 0.10 False
AllBitsSetBenchmark - Duration of single invocation 51.15 ns 15.43 ns 0.30 0.13 False
GreaterThanOrEqualBenchmark - Duration of single invocation 135.79 ns 94.29 ns 0.69 0.05 False
BitwiseAndOperatorBenchmark - Duration of single invocation 70.62 ns 37.49 ns 0.53 0.08 False
SubtractBenchmark - Duration of single invocation 128.47 ns 90.93 ns 0.71 0.11 False
XorBenchmark - Duration of single invocation 73.41 ns 37.74 ns 0.51 0.08 False
AddOperatorBenchmark - Duration of single invocation 126.56 ns 87.78 ns 0.69 0.11 False
EqualsStaticBenchmark - Duration of single invocation 139.78 ns 95.34 ns 0.68 0.20 False
OnesComplementBenchmark - Duration of single invocation 63.94 ns 29.54 ns 0.46 0.13 False
AndNotBenchmark - Duration of single invocation 72.20 ns 39.32 ns 0.54 0.06 False
SquareRootBenchmark - Duration of single invocation 102.00 ns 66.23 ns 0.65 0.10 False
BitwiseOrBenchmark - Duration of single invocation 72.74 ns 37.49 ns 0.52 0.11 False
GreaterThanBenchmark - Duration of single invocation 129.05 ns 90.95 ns 0.70 0.12 False
UnaryNegateOperatorBenchmark - Duration of single invocation 117.86 ns 90.63 ns 0.77 0.19 False
SubtractionOperatorBenchmark - Duration of single invocation 126.45 ns 87.78 ns 0.69 0.11 False
LessThanBenchmark - Duration of single invocation 131.99 ns 90.45 ns 0.69 0.06 False
AbsBenchmark - Duration of single invocation 105.55 ns 68.34 ns 0.65 0.13 False
DivisionOperatorBenchmark - Duration of single invocation 125.95 ns 88.82 ns 0.71 0.10 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 72.77 ns 37.49 ns 0.52 0.07 False
BitwiseAndBenchmark - Duration of single invocation 72.77 ns 37.29 ns 0.51 0.11 False
MinBenchmark - Duration of single invocation 138.35 ns 96.65 ns 0.70 0.10 False
BitwiseOrOperatorBenchmark - Duration of single invocation 71.89 ns 37.57 ns 0.52 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ConditionalSelectBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.41372434900488 < 96.8267463639855.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 64.17723928329615 (T) = (0 -63.892633466100754) / Math.Sqrt((5.949035810343353 / (89)) + (2.599472184404696 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.36475757904290973 = (100.57992249610265 - 63.892633466100754) / 100.57992249610265 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.87212662981031 < 122.23165537561863.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.35007272394434 (T) = (0 -88.83647719056188) / Math.Sqrt((14.794232834491675 / (89)) + (0.9963982503710521 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.30984691682290344 = (128.71995989876064 - 88.83647719056188) / 128.71995989876064 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 89.67244884699366 < 120.72793071463127.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.79506578711666 (T) = (0 -89.7960813779001) / Math.Sqrt((9.185261455884039 / (88)) + (6.339247155495074 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.3000323033906776 = (128.2860363597873 - 89.7960813779001) / 128.2860363597873 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 92.99794795296643 < 126.57892108677451.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 55.334001252087155 (T) = (0 -92.16790867615111) / Math.Sqrt((8.081902298214418 / (89)) + (4.292493303482592 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3021390237154 = (132.07201979805706 - 92.16790867615111) / 132.07201979805706 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 81.10793255723593 < 114.89634037350672.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 57.67537259576794 (T) = (0 -81.69460339090871) / Math.Sqrt((5.82510257177142 / (88)) + (3.737022656369637 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.3189143589704481 = (119.9476225448189 - 81.69460339090871) / 119.9476225448189 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 91.03030221517521 < 124.54498763190212.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 93.90797730116005 (T) = (0 -89.13826629671956) / Math.Sqrt((6.3231481206731965 / (89)) + (0.9563031541412363 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.30075139470338585 = (127.47721714640821 - 89.13826629671956) / 127.47721714640821 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 99.45768866477579 < 130.94455462653238.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 23.06351268726898 (T) = (0 -98.88949389639897) / Math.Sqrt((16.96540271102622 / (89)) + (25.68786317723958 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2792383178927533 = (137.20137508875587 - 98.88949389639897) / 137.20137508875587 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.62304071665622 < 119.46635249176705.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 33.60423001147901 (T) = (0 -87.25609953004417) / Math.Sqrt((20.064458683253427 / (88)) + (11.37552484068796 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.31036486940203867 = (126.52502121576535 - 87.25609953004417) / 126.52502121576535 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.499367785753623 < 59.85442197282565.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 159.7607270291748 (T) = (0 -28.85756461761241) / Math.Sqrt((2.954836833142806 / (89)) + (0.1280134751462398 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5428365509264926 = (63.123079231499105 - 28.85756461761241) / 63.123079231499105 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.43366248910664 < 48.493529465252536.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 192.95576598609455 (T) = (0 -15.224711543603899) / Math.Sqrt((2.247391861146756 / (89)) + (0.09148742101460458 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.7015514389504509 = (51.01284955123726 - 15.224711543603899) / 51.01284955123726 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 94.28975580833458 < 127.01953012845681.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 68.16504807345109 (T) = (0 -92.9324954269425) / Math.Sqrt((8.387416810990464 / (89)) + (2.349756813618719 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2961995355721903 = (132.04381088679258 - 92.9324954269425) / 132.04381088679258 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.48665905556107 < 67.72122979940293.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 140.90399983664682 (T) = (0 -37.04756255977422) / Math.Sqrt((3.6056205279389575 / (89)) + (0.218160054424674 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4870550846313021 = (72.22522623729476 - 37.04756255977422) / 72.22522623729476 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 90.9298707017701 < 121.71629124756386.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 75.2552430259648 (T) = (0 -88.8687068496371) / Math.Sqrt((15.826419286619391 / (89)) + (1.0500432611326296 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.31051120902037693 = (128.89072021515068 - 88.8687068496371) / 128.89072021515068 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.73928197734728 < 69.32013045491426.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 127.8164748828159 (T) = (0 -37.28673473900956) / Math.Sqrt((3.224771643928659 / (88)) + (0.3979582064195841 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.4865880861543109 = (72.62537883025529 - 37.28673473900956) / 72.62537883025529 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.78431141512301 < 119.87869822444338.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 32.99007687342181 (T) = (0 -88.10052177992091) / Math.Sqrt((7.743977028053394 / (89)) + (12.089227156704505 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29887601402499414 = (125.65612294294205 - 88.10052177992091) / 125.65612294294205 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 95.34322407726883 < 123.178562717661.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 24.03972302287927 (T) = (0 -92.45236258914242) / Math.Sqrt((12.058269420131666 / (89)) + (22.852149946016013 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.28803283571384064 = (129.85481245028774 - 92.45236258914242) / 129.85481245028774 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.540582733809718 < 60.14762393932759.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 178.67319195362765 (T) = (0 -28.817518486226867) / Math.Sqrt((2.2778605955504805 / (89)) + (0.1117050324068179 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5431332325178607 = (63.07641644640625 - 28.817518486226867) / 63.07641644640625 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.31732677806014 < 70.64583434611406.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 84.83193896159842 (T) = (0 -38.57915082389575) / Math.Sqrt((1.3186056195148343 / (89)) + (1.5903615183884992 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47830974611508914 = (73.95030008056587 - 38.57915082389575) / 73.95030008056587 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 66.22532150593429 < 97.46777993044164.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 78.3963905477381 (T) = (0 -65.92584152319448) / Math.Sqrt((7.181357870496452 / (89)) + (1.34735062472014 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3556431027962765 = (102.31261868894218 - 65.92584152319448) / 102.31261868894218 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.492112688265145 < 68.59972344406431.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.907604176218754 (T) = (0 -37.984144983377554) / Math.Sqrt((4.917269032551162 / (89)) + (3.645738796707508 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47437708994148764 = (72.26501025069314 - 37.984144983377554) / 72.26501025069314 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 90.94552476741858 < 123.75240683526158.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 20.295339869787576 (T) = (0 -92.89248393986028) / Math.Sqrt((12.195149167152225 / (89)) + (33.42362479315338 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.28953912793477843 = (130.74961281095378 - 92.89248393986028) / 130.74961281095378 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 90.6262744737208 < 113.15068067932435.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 24.56714672430929 (T) = (0 -81.7710384476849) / Math.Sqrt((13.75364415749679 / (89)) + (21.045110768781825 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.31108714799644355 = (118.69576566886687 - 81.7710384476849) / 118.69576566886687 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 87.78349021088269 < 119.46705413944233.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 26.931877097763344 (T) = (0 -88.10942402989772) / Math.Sqrt((5.288423024769749 / (89)) + (18.84390219228074 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29881570850939254 = (125.65801187957442 - 88.10942402989772) / 125.65801187957442 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 90.44878087598674 < 123.52344770350734.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 117.95707594389813 (T) = (0 -89.53324302781402) / Math.Sqrt((8.335241808806433 / (89)) + (0.24107012946127268 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3113454938530284 = (130.01184516856407 - 89.53324302781402) / 130.01184516856407 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 68.3353604049971 < 98.10747931691851.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 54.91555463688034 (T) = (0 -69.09087926445802) / Math.Sqrt((6.20741016917726 / (89)) + (3.602563239123711 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3426272212360948 = (105.1015215360354 - 69.09087926445802) / 105.1015215360354 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 88.81703314489002 < 118.73794103187035.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 56.36834584306862 (T) = (0 -87.21406106426917) / Math.Sqrt((5.299861856069293 / (89)) + (3.8997475270677935 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.302327043380066 = (125.00708281255642 - 87.21406106426917) / 125.00708281255642 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.48898261074434 < 69.67206718901005.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 154.84516235565556 (T) = (0 -36.80931422189297) / Math.Sqrt((3.4683744921360553 / (89)) + (0.1480204678469101 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4937949772804889 = (72.71621688805142 - 36.80931422189297) / 72.71621688805142 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.29292655612153 < 68.9269272693309.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 117.71779215155944 (T) = (0 -36.83853370949032) / Math.Sqrt((5.521582788546288 / (89)) + (0.29890616877667087 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49209730223610065 = (72.53069115733436 - 36.83853370949032) / 72.53069115733436 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.64653111778594 < 131.52207649397587.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 66.00570856426427 (T) = (0 -97.29281567920432) / Math.Sqrt((11.102449529674919 / (89)) + (2.3904788624293776 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29037427896373014 = (137.10440982484 - 97.29281567920432) / 137.10440982484 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.57312826736169 < 68.7269652794734.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 138.8412450877273 (T) = (0 -37.2994993193032) / Math.Sqrt((1.433059950613041 / (88)) + (0.472240293749734 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.48402115987635635 = (72.28881577850198 - 37.2994993193032) / 72.28881577850198 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SubtractionOperatorBenchmark - Duration of single invocation 148.59 ns 110.95 ns 0.75 0.19 False
MaxBenchmark - Duration of single invocation 182.98 ns 136.49 ns 0.75 0.12 False
AddOperatorBenchmark - Duration of single invocation 157.36 ns 111.40 ns 0.71 0.13 False
SubtractBenchmark - Duration of single invocation 151.30 ns 113.40 ns 0.75 0.09 False
LessThanBenchmark - Duration of single invocation 165.09 ns 126.87 ns 0.77 0.13 False
ConditionalSelectBenchmark - Duration of single invocation 101.72 ns 63.69 ns 0.63 0.08 False
EqualsStaticBenchmark - Duration of single invocation 157.67 ns 121.96 ns 0.77 0.11 False
NegateBenchmark - Duration of single invocation 144.51 ns 105.33 ns 0.73 0.09 False
MinBenchmark - Duration of single invocation 169.59 ns 135.01 ns 0.80 0.12 False
XorBenchmark - Duration of single invocation 74.16 ns 37.28 ns 0.50 0.08 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 72.99 ns 37.14 ns 0.51 0.09 False
AddBenchmark - Duration of single invocation 152.70 ns 114.22 ns 0.75 0.06 False
LessThanOrEqualBenchmark - Duration of single invocation 160.87 ns 123.81 ns 0.77 0.15 False
DivideBenchmark - Duration of single invocation 158.29 ns 123.45 ns 0.78 0.10 False
AbsBenchmark - Duration of single invocation 137.59 ns 97.99 ns 0.71 0.06 False
AndNotBenchmark - Duration of single invocation 73.67 ns 42.23 ns 0.57 0.15 False
SquareRootBenchmark - Duration of single invocation 140.49 ns 104.47 ns 0.74 0.09 False
OnesComplementBenchmark - Duration of single invocation 63.52 ns 29.33 ns 0.46 0.07 False
DivisionOperatorBenchmark - Duration of single invocation 157.37 ns 120.67 ns 0.77 0.14 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.94 ns 38.12 ns 0.52 0.15 False
MultiplyOperatorBenchmark - Duration of single invocation 152.74 ns 117.61 ns 0.77 0.16 False
UnaryNegateOperatorBenchmark - Duration of single invocation 144.10 ns 102.74 ns 0.71 0.13 False
MultiplyBenchmark - Duration of single invocation 153.50 ns 114.91 ns 0.75 0.10 False
GreaterThanBenchmark - Duration of single invocation 159.33 ns 121.40 ns 0.76 0.11 False
GreaterThanOrEqualBenchmark - Duration of single invocation 159.36 ns 122.36 ns 0.77 0.22 False
BitwiseOrBenchmark - Duration of single invocation 72.23 ns 37.63 ns 0.52 0.08 False
AllBitsSetBenchmark - Duration of single invocation 51.31 ns 15.10 ns 0.29 0.08 False
OnesComplementOperatorBenchmark - Duration of single invocation 63.51 ns 29.29 ns 0.46 0.16 False
BitwiseAndBenchmark - Duration of single invocation 72.27 ns 37.20 ns 0.51 0.16 False
BitwiseOrOperatorBenchmark - Duration of single invocation 69.42 ns 37.74 ns 0.54 0.11 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SubtractionOperatorBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 110.95425756484522 < 142.932615630967.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 53.60578861971758 (T) = (0 -109.92165099466233) / Math.Sqrt((22.31549907021308 / (89)) + (2.8986098463566203 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.26392802898414364 = (149.3354662628424 - 109.92165099466233) / 149.3354662628424 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 136.49133754254868 < 163.9779228701371.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 68.3177241482217 (T) = (0 -132.70467650615134) / Math.Sqrt((13.737883454531065 / (89)) + (1.9342541152961692 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23289351643569248 = (172.99381422191635 - 132.70467650615134) / 172.99381422191635 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 111.39796995445475 < 144.03467197164844.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 42.01944096745125 (T) = (0 -110.81464532155015) / Math.Sqrt((13.408124310071008 / (89)) + (7.117536428569737 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2604288698876803 = (149.83635895132977 - 110.81464532155015) / 149.83635895132977 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 113.40332483053541 < 144.2825331290542.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 60.67828460542789 (T) = (0 -112.18824754912525) / Math.Sqrt((10.032383231087689 / (89)) + (2.983460093765477 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25748359629321316 = (151.09194489045578 - 112.18824754912525) / 151.09194489045578 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 126.8737624445466 < 149.42225604449575.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 20.139034662838338 (T) = (0 -121.4295254847431) / Math.Sqrt((12.411472698341585 / (89)) + (29.6529309216704 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2261450488914828 = (156.91509799194282 - 121.4295254847431) / 156.91509799194282 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 63.68990769796104 < 96.64269850813149.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 64.26834565534067 (T) = (0 -64.9881451326643) / Math.Sqrt((5.755057818732076 / (89)) + (2.5122293760076135 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.35724913597760194 = (101.10938587614197 - 64.9881451326643) / 101.10938587614197 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 121.96266864744888 < 150.16997851326468.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.14218527385102 (T) = (0 -120.4311847233254) / Math.Sqrt((10.174862498865984 / (89)) + (9.39563124722248 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23552451703740265 = (157.5343976455784 - 120.4311847233254) / 157.5343976455784 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 105.32811254606649 < 136.787296181743.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 54.257264168378285 (T) = (0 -106.81317139876589) / Math.Sqrt((25.995802947278378 / (89)) + (1.7333749956290196 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2573579340383773 = (143.82860370353117 - 106.81317139876589) / 143.82860370353117 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 135.0061571995685 < 160.80595405385546.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 24.42234712482012 (T) = (0 -135.8391458511442) / Math.Sqrt((14.208109583320596 / (89)) + (17.452772193974546 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.19880926565526785 = (169.5465761498635 - 135.8391458511442) / 169.5465761498635 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.28007075269182 < 69.40955748362724.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 155.2971623724869 (T) = (0 -36.86129807334722) / Math.Sqrt((3.612096543821784 / (89)) + (0.13035919249539912 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49381871337450123 = (72.82232482177729 - 36.86129807334722) / 72.82232482177729 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.13775330062574 < 69.32797741849623.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 105.6243372466834 (T) = (0 -36.83392754054315) / Math.Sqrt((2.711683025203698 / (89)) + (0.8491099003363415 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.493426492634209 = (72.7119105222883 - 36.83392754054315) / 72.7119105222883 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 114.21767908732558 < 146.56741531253166.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 99.6414333868088 (T) = (0 -112.66959769379294) / Math.Sqrt((9.421087874799928 / (89)) + (0.5349399297086916 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2609163836579345 = (152.44499431799983 - 112.66959769379294) / 152.44499431799983 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 123.81316174048774 < 154.00705077239905.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.435407752642554 (T) = (0 -124.22709567770978) / Math.Sqrt((24.584801075101055 / (89)) + (3.9996435487468847 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23510907997349656 = (162.41151832918257 - 124.22709567770978) / 162.41151832918257 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 123.45349798798499 < 151.34049565250157.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 56.26240308620657 (T) = (0 -123.09563991300493) / Math.Sqrt((15.827157147597445 / (89)) + (2.3484229773360132 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22697317306718462 = (159.23850974411695 - 123.09563991300493) / 159.23850974411695 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 97.98543470020677 < 130.8361617699409.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 58.11376263982829 (T) = (0 -98.10717410130047) / Math.Sqrt((7.303540926256483 / (89)) + (3.5959855964305385 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2824655190753379 = (136.72816667273344 - 98.10717410130047) / 136.72816667273344 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 42.225791342064774 < 70.03322783687479.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 83.94967910933478 (T) = (0 -39.33804579432646) / Math.Sqrt((3.5529219979627387 / (88)) + (1.2936000706863124 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.46786047298599387 = (73.92430706108976 - 39.33804579432646) / 73.92430706108976 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 104.46630615939384 < 133.8427870230073.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.08784392400474 (T) = (0 -104.89102765122625) / Math.Sqrt((9.05325355573484 / (89)) + (6.719217334054921 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2562537778533523 = (141.0306695050942 - 104.89102765122625) / 141.0306695050942 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.329296993148407 < 59.96066676068415.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 194.60359491984596 (T) = (0 -28.941050746630843) / Math.Sqrt((2.2013035279404964 / (88)) + (0.055306285514125406 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.5402710057071707 = (62.95241567512823 - 28.941050746630843) / 62.95241567512823 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 120.66711763941603 < 149.0324975568226.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 43.57125050519229 (T) = (0 -120.29285767832138) / Math.Sqrt((21.270164217286137 / (89)) + (4.399700385007795 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.229855419410854 = (156.19516219447993 - 120.29285767832138) / 156.19516219447993 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.1209077367427 < 68.70243651949889.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 104.54078313293549 (T) = (0 -37.14439401113296) / Math.Sqrt((2.786941092630071 / (89)) + (0.8002279601604132 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4842967715804288 = (72.02668504706865 - 37.14439401113296) / 72.02668504706865 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 117.60948153187573 < 143.73657248614302.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.037191487900266 (T) = (0 -111.389261974015) / Math.Sqrt((23.080861169115067 / (89)) + (5.54829694142359 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2629305140200721 = (151.12450602391155 - 111.389261974015) / 151.12450602391155 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 102.7419137441583 < 136.19265658457778.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.07020387348483 (T) = (0 -102.85006858017023) / Math.Sqrt((17.222549536992815 / (89)) + (0.6432334159494523 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.27562399642226604 = (141.98436733435113 - 102.85006858017023) / 141.98436733435113 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 114.914766676803 < 146.24735260200396.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 87.7599080682495 (T) = (0 -112.95388327122164) / Math.Sqrt((13.505206766389191 / (89)) + (0.5677450031614245 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.26187636034361333 = (153.02840500245222 - 112.95388327122164) / 153.02840500245222 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 121.39627333868167 < 151.4674331991264.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 67.70004367679046 (T) = (0 -118.01650341298114) / Math.Sqrt((18.269389437427527 / (89)) + (1.552236563030438 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2561888112981002 = (158.66459822813863 - 118.01650341298114) / 158.66459822813863 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 122.36165301631809 < 151.0830680431094.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 14.729869597972156 (T) = (0 -124.53601701470409) / Math.Sqrt((34.96851868083303 / (89)) + (51.77566344497535 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.218235672185904 = (159.3012274721223 - 124.53601701470409) / 159.3012274721223 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.63142520924238 < 68.60001125806598.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 26.81136924775324 (T) = (0 -38.81782298538646) / Math.Sqrt((2.678955056109388 / (89)) + (15.455337771839977 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.46437932586230796 = (72.47260021820509 - 38.81782298538646) / 72.47260021820509 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.100376220857092 < 48.41370882165071.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 157.06352747448125 (T) = (0 -15.051051961443212) / Math.Sqrt((0.9155958546807649 / (89)) + (0.41189251863120374 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.7030555631073481 = (50.68642510680981 - 15.051051961443212) / 50.68642510680981 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.289580205742798 < 60.34258098467229.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 94.4866523220772 (T) = (0 -28.905807205440198) / Math.Sqrt((2.4679098508345403 / (88)) + (1.0321393250999413 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.5421800682544531 = (63.13793961575671 - 28.905807205440198) / 63.13793961575671 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.19558291656761 < 68.62409006297281.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 32.27096058636516 (T) = (0 -37.77109846356668) / Math.Sqrt((4.4306052290877425 / (89)) + (11.123714957342681 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47945182009979165 = (72.56023538648735 - 37.77109846356668) / 72.56023538648735 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.74031850163866 < 68.42535688817495.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 115.64330921745163 (T) = (0 -37.22623725018622) / Math.Sqrt((3.9559214751519307 / (89)) + (0.4568307048516258 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.482570724034026 = (71.94459026441753 - 37.22623725018622) / 71.94459026441753 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.IO.Tests.Perf_FileStream

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ReadAsync - Duration of single invocation 8.27 ms 6.29 ms 0.76 0.08 False
Read - Duration of single invocation 1.81 ms 1.09 ms 0.61 0.02 False
ReadAsync - Duration of single invocation 7.72 ms 6.49 ms 0.84 0.09 False
Read - Duration of single invocation 1.78 ms 1.07 ms 0.60 0.02 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_FileStream*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.Perf_FileStream.ReadAsync(fileSize: 1048576, userBufferSize: 512, options: Asynchronous)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.286772017094018 < 7.372424115624999.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 11/23/2022 5:21:28 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.425412893655384 (T) = (0 -6400017.91274628) / Math.Sqrt((61520495201.08415 / (299)) + (9044557311.237572 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.2144154790457246 = (8146822.833235013 - 6400017.91274628) / 8146822.833235013 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_FileStream.Read(fileSize: 1048576, userBufferSize: 512, options: Asynchronous)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0931660663690477 < 1.6852558287698411.
IsChangePoint: Marked as a change because one of 11/16/2022 11:42:33 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 63.661955224115744 (T) = (0 -1064199.3799927502) / Math.Sqrt((1977615857.8684664 / (299)) + (986859141.4003792 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.38036857029153637 = (1717471.5951601353 - 1064199.3799927502) / 1717471.5951601353 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_FileStream.ReadAsync(fileSize: 1048576, userBufferSize: 512, options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.492399173684211 < 7.363245474014665.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.188203044241934 (T) = (0 -6543652.628864888) / Math.Sqrt((59068802208.045235 / (299)) + (109860728503.63533 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.19708263223917802 = (8149845.664833286 - 6543652.628864888) / 8149845.664833286 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_FileStream.Read(fileSize: 1048576, userBufferSize: 512, options: None)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0700572314102565 < 1.6860144577256948.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 131.86774872335505 (T) = (0 -1089038.1769843996) / Math.Sqrt((2010825931.124624 / (299)) + (160352996.72030246 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.36615724459687826 = (1718151.967031279 - 1089038.1769843996) / 1718151.967031279 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Text.Tests.Perf_StringBuilder

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ctor_string - Duration of single invocation 319.96 ns 268.99 ns 0.84 0.03 False
ToString_SingleSegment - Duration of single invocation 285.76 ns 245.60 ns 0.86 0.06 False
Append_Strings - Duration of single invocation 2.10 ms 1.08 ms 0.51 0.01 False
Append_Strings - Duration of single invocation 2.45 μs 2.11 μs 0.86 0.03 False
Append_Memory - Duration of single invocation 4.41 μs 3.72 μs 0.84 0.03 False
AppendLine_Strings - Duration of single invocation 3.01 μs 2.73 μs 0.91 0.04 False
ToString_MultipleSegments - Duration of single invocation 513.59 ns 404.58 ns 0.79 0.04 False
Insert_Strings - Duration of single invocation 7.30 μs 6.73 μs 0.92 0.01 False
Append_NonEmptySpan - Duration of single invocation 3.80 μs 3.05 μs 0.80 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

Payloads

Baseline
Compare

Histogram

System.Text.Tests.Perf_StringBuilder.ctor_string(length: 100)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 268.9851030425251 < 298.71236110822497.
IsChangePoint: Marked as a change because one of 11/9/2022 12:33:05 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.461887413518895 (T) = (0 -268.91027209096035) / Math.Sqrt((57.96740862866403 / (299)) + (14.835785187183568 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.11681518579837048 = (304.4779164755528 - 268.91027209096035) / 304.4779164755528 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 245.5983551058316 < 268.03259034976395.
IsChangePoint: Marked as a change because one of 10/14/2022 11:50:37 PM, 11/19/2022 1:29:52 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 5.363727431073493 (T) = (0 -255.64648303969406) / Math.Sqrt((47.33827255079434 / (299)) + (119.8983293807753 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.06814447105848721 = (274.3413277056808 - 255.64648303969406) / 274.3413277056808 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1000)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0795868154761903 < 1.97648111385109.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 123.03963131392825 (T) = (0 -1035014.3350685382) / Math.Sqrt((1840602206.9783933 / (299)) + (573817285.874476 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.4865412003814373 = (2015769.0078296985 - 1035014.3350685382) / 2015769.0078296985 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.1078414465942523 < 2.309999678502334.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.66831772941572 (T) = (0 -2093.585711594712) / Math.Sqrt((3979.6546376078904 / (299)) + (69.33259531228593 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1016785667467438 = (2330.553000403014 - 2093.585711594712) / 2330.553000403014 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Memory

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.716756286616936 < 4.219627856140107.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 29.04631323020125 (T) = (0 -3715.4828507263082) / Math.Sqrt((9442.607709290833 / (299)) + (4320.014952176116 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.14407107546558712 = (4340.877781116423 - 3715.4828507263082) / 4340.877781116423 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.AppendLine_Strings

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.7327893961560528 < 2.8217431361809346.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 17.71979278929789 (T) = (0 -2681.439414295776) / Math.Sqrt((5240.405258904043 / (299)) + (1029.1307147722227 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.06761897274044718 = (2875.905167415345 - 2681.439414295776) / 2875.905167415345 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 404.5791509857487 < 480.21408496806436.
IsChangePoint: Marked as a change because one of 10/17/2022 12:47:34 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 39.69927697604528 (T) = (0 -407.39410608664923) / Math.Sqrt((174.69870412431465 / (299)) + (36.65977056647473 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1672897047542866 = (489.2387045202038 - 407.39410608664923) / 489.2387045202038 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Insert_Strings

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.7317436076041215 < 6.928625763929202.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 11.324889223169592 (T) = (0 -6655.82590591748) / Math.Sqrt((16875.866116189252 / (299)) + (19031.156987140857 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.07004435845618202 = (7157.143425538183 - 6655.82590591748) / 7157.143425538183 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_NonEmptySpan

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.052036336585505 < 3.591080055648297.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 57.7675202616762 (T) = (0 -3070.0258256078114) / Math.Sqrt((6627.860861630607 / (299)) + (846.2721306402508 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.16279682559235437 = (3667.002132164604 - 3070.0258256078114) / 3667.002132164604 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Tests.Perf_DateTime

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToString - Duration of single invocation 739.04 ns 673.40 ns 0.91 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_DateTime.ToString(format: "o")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 673.404623732922 < 709.4107820514827.
IsChangePoint: Marked as a change because one of 10/22/2022 11:54:51 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 25.32564265058974 (T) = (0 -681.576789432322) / Math.Sqrt((857.163057432307 / (299)) + (80.34876170017338 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.10927824346512965 = (765.1960720975601 - 681.576789432322) / 765.1960720975601 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToStringWithFormat - Duration of single invocation 1.71 μs 1.61 μs 0.94 0.02 False
IsNaN - Duration of single invocation 7.99 ms 7.02 ms 0.88 0.09 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "G")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.610602883746091 < 1.6257927580220328.
IsChangePoint: Marked as a change because one of 9/28/2022 6:40:13 PM, 11/15/2022 8:48:03 PM, 11/22/2022 2:57:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.68158630306082 (T) = (0 -1613.7033871132526) / Math.Sqrt((1910.0915903993948 / (299)) + (107.87326777572673 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.0663737259942813 = (1728.4254225083732 - 1613.7033871132526) / 1728.4254225083732 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.IsNaN(value: 0)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.023488113095238 < 7.5893088796093755.
IsChangePoint: Marked as a change because one of 9/28/2022 6:40:13 PM, 11/15/2022 8:48:03 PM, 12/2/2022 5:21:30 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 17.128963347977464 (T) = (0 -7036762.659878902) / Math.Sqrt((149721402058.93198 / (299)) + (4359619789.453824 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.06339640257111027 = (7513063.882303909 - 7036762.659878902) / 7513063.882303909 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Collections.Tests.Perf_Dictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Clone - Duration of single invocation 149.55 μs 119.90 μs 0.80 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_Dictionary*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_Dictionary.Clone(Items: 3000)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.90275413486003 < 141.85542164214849.
IsChangePoint: Marked as a change because one of 11/23/2022 8:02:34 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 38.41520915020386 (T) = (0 -119982.69751190367) / Math.Sqrt((17340713.406237908 / (299)) + (3767667.3814558038 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1743117592757971 = (145312.34864949516 - 119982.69751190367) / 145312.34864949516 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Tests.Perf_Double

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToStringWithFormat - Duration of single invocation 1.75 μs 1.60 μs 0.92 0.02 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Double*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "G")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.6023953669628557 < 1.63965633493061.
IsChangePoint: Marked as a change because one of 9/28/2022 6:40:13 PM, 11/15/2022 8:48:03 PM, 11/22/2022 11:24:47 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.421492342703159 (T) = (0 -1614.943881563134) / Math.Sqrt((1744.2635183330754 / (299)) + (397.12550593019677 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.060544054095683315 = (1719.0203421498336 - 1614.943881563134) / 1719.0203421498336 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in PerfLabTests.BlockCopyPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
CallBlockCopy - Duration of single invocation 246.29 ns 128.42 ns 0.52 0.06 False
CallBlockCopy - Duration of single invocation 829.69 ns 245.86 ns 0.30 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.BlockCopyPerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 100)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 128.41616067114222 < 234.0355882976604.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 63.761877227959324 (T) = (0 -132.4530143972521) / Math.Sqrt((73.96645286681678 / (299)) + (25.38214612176818 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.44550682776552025 = (238.87221886519714 - 132.4530143972521) / 238.87221886519714 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 1000)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 245.856885132981 < 791.1118546055296.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 502.30946289638933 (T) = (0 -246.91856376982122) / Math.Sqrt((230.8641767475318 / (299)) + (6.769261837814465 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.7100467107256506 = (851.5804886634367 - 246.91856376982122) / 851.5804886634367 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.IO.Tests.Perf_StreamWriter

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteFormat - Duration of single invocation 1.23 μs 915.73 ns 0.75 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_StreamWriter*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.Perf_StreamWriter.WriteFormat

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 915.7323063188425 < 1.1832816686193315.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/21/2022 9:54:19 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.95758775824888 (T) = (0 -933.3242791902088) / Math.Sqrt((1451.9908531588471 / (299)) + (350.2680313583642 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.22112561744755635 = (1198.2988529313527 - 933.3242791902088) / 1198.2988529313527 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in Benchstone.MDBenchI.MDNDhrystone

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 4.26 secs 3.81 secs 0.89 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchI.MDNDhrystone*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchI.MDNDhrystone.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.811008111733333 < 4.119092731478332.
IsChangePoint: Marked as a change because one of 10/14/2022 1:19:37 PM, 11/9/2022 12:33:05 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 19.579905206420843 (T) = (0 -3847181432.4214835) / Math.Sqrt((20115751493835540 / (299)) + (4159288801668764.5 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.10061850542486886 = (4277585713.7675447 - 3847181432.4214835) / 4277585713.7675447 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Collections.CtorFromCollection<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Dictionary - Duration of single invocation 26.22 μs 20.73 μs 0.79 0.06 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CtorFromCollection<Int32>.Dictionary(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.73483033251609 < 24.899009448766158.
IsChangePoint: Marked as a change because one of 11/15/2022 5:29:43 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 14.43653041693966 (T) = (0 -21560.20670481563) / Math.Sqrt((609395.6371212665 / (299)) + (708985.1167969411 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.15314170708877115 = (25459.04891678927 - 21560.20670481563) / 25459.04891678927 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Memory.Memory<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToArray - Duration of single invocation 298.19 ns 215.02 ns 0.72 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Memory&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Memory<Byte>.ToArray(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 215.01864219206166 < 282.1710179677832.
IsChangePoint: Marked as a change because one of 10/22/2022 11:45:45 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 54.92573742308444 (T) = (0 -216.01269330841077) / Math.Sqrt((52.235173215895664 / (299)) + (17.451196398393325 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.26052539177084244 = (292.1164444384412 - 216.01269330841077) / 292.1164444384412 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Memory.Memory<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToArray - Duration of single invocation 489.70 ns 347.79 ns 0.71 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Memory&lt;Char&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Memory<Char>.ToArray(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 347.7895867645159 < 460.96955427589006.
IsChangePoint: Marked as a change because one of 10/19/2022 4:55:41 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 105.80036206322748 (T) = (0 -351.5211771772997) / Math.Sqrt((163.68321805522336 / (299)) + (8.017300597390724 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.2590383282305033 = (474.4120925146224 - 351.5211771772997) / 474.4120925146224 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Diagnostics.Tracing.Perf_EventListener

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteEvent_MixedParams - Duration of single invocation 970.56 ns 870.06 ns 0.90 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Diagnostics.Tracing.Perf_EventListener*'

Payloads

Baseline
Compare

Histogram

System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_MixedParams

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 870.0565205905873 < 916.105419978991.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 11/16/2022 9:45:14 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 17.632859438435812 (T) = (0 -896.7908667441782) / Math.Sqrt((492.5957927094482 / (299)) + (141.6937775432609 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.07252594705546374 = (966.9174721352631 - 896.7908667441782) / 966.9174721352631 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Memory.Span<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToArray - Duration of single invocation 282.35 ns 199.17 ns 0.71 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Byte>.ToArray(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 199.16877615150045 < 269.94818933143404.
IsChangePoint: Marked as a change because one of 10/14/2022 1:19:37 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 48.31401214404218 (T) = (0 -200.16279101655564) / Math.Sqrt((58.08206616642065 / (299)) + (24.64407491232949 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.2824182214354308 = (278.9407381789373 - 200.16279101655564) / 278.9407381789373 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Memory.ReadOnlyMemory<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToArray - Duration of single invocation 499.18 ns 363.95 ns 0.73 0.02 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlyMemory&lt;Char&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.ReadOnlyMemory<Char>.ToArray(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 363.946210653654 < 477.27756610227993.
IsChangePoint: Marked as a change because one of 10/17/2022 12:47:34 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.97259546428191 (T) = (0 -368.35771785872447) / Math.Sqrt((287.82408996948584 / (299)) + (58.56247547598744 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.24174169265704323 = (485.7945033922562 - 368.35771785872447) / 485.7945033922562 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Tests.Perf_Array

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ArrayResize - Duration of single invocation 197.76 ns 160.50 ns 0.81 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Array*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Array.ArrayResize

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 160.49515158333332 < 182.78661451523806.
IsChangePoint: Marked as a change because one of 8/3/2022 1:54:17 PM, 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.84878632991008 (T) = (0 -162.7306565387546) / Math.Sqrt((27.429562483346185 / (299)) + (4.617059477468845 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.11651789222758209 = (184.19236236606784 - 162.7306565387546) / 184.19236236606784 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Strings

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteStringsUtf8 - Duration of single invocation 422.91 ms 357.50 ms 0.85 0.16 False
WriteStringsUtf8 - Duration of single invocation 428.74 ms 359.15 ms 0.84 0.14 False
WriteStringsUtf8 - Duration of single invocation 429.84 ms 361.63 ms 0.84 0.19 False
WriteStringsUtf8 - Duration of single invocation 389.07 ms 337.42 ms 0.87 0.10 False
WriteStringsUtf8 - Duration of single invocation 389.87 ms 324.50 ms 0.83 0.08 False
WriteStringsUtf8 - Duration of single invocation 422.87 ms 354.76 ms 0.84 0.12 False
WriteStringsUtf8 - Duration of single invocation 393.30 ms 330.20 ms 0.84 0.10 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: NoneEscaped)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 357.501808 < 404.79465434249994.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 58.522965986727705 (T) = (0 -360958805.1414286) / Math.Sqrt((390579861791895.3 / (299)) + (3306773928287.612 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.171800128663775 = (435835379.39827794 - 360958805.1414286) / 435835379.39827794 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 359.1508877692308 < 408.51623055095234.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.49491427654818 (T) = (0 -365713481.4673993) / Math.Sqrt((503468204301403.7 / (299)) + (12204558096434.387 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.17173510962192967 = (441541692.4173443 - 365713481.4673993) / 441541692.4173443 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: NoneEscaped)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 361.62741521428575 < 408.62420124023805.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 31.698424754944156 (T) = (0 -371201107.7907692) / Math.Sqrt((466724104231307.8 / (299)) + (35704620361730.914 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1620862535853677 = (443006346.8693644 - 371201107.7907692) / 443006346.8693644 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: OneEscaped)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 337.4247144666666 < 369.69151830958333.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 47.14196147445635 (T) = (0 -339205318.08029306) / Math.Sqrt((361489027334433.3 / (299)) + (5358908495636.495 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1551065840516082 = (401477052.2262095 - 339205318.08029306) / 401477052.2262095 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 324.4972287142857 < 372.49522244128207.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.466919624583475 (T) = (0 -331895022.51895607) / Math.Sqrt((317424831684756.06 / (299)) + (120657547349537.88 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.15237221390479086 = (391557506.6833359 - 331895022.51895607) / 391557506.6833359 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 354.7607787333333 < 401.4472749414286.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 9.839734523400091 (T) = (0 -366344878.9840659) / Math.Sqrt((422399937234471.3 / (299)) + (451840892099023.2 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1549385791632825 = (433512724.5796385 - 366344878.9840659) / 433512724.5796385 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 330.1999865714286 < 371.30950789285714.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.82543009346744 (T) = (0 -335541723.5261172) / Math.Sqrt((436421744987069.56 / (299)) + (5135036868535.1875 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.16389683297971724 = (401316173.3640191 - 335541723.5261172) / 401316173.3640191 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Numerics.Tests.Perf_Matrix4x4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DecomposeBenchmark - Duration of single invocation 616.10 ns 523.82 ns 0.85 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Matrix4x4.DecomposeBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 523.8233715620067 < 584.8486960161721.
IsChangePoint: Marked as a change because one of 10/10/2022 9:53:50 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 34.04053419421631 (T) = (0 -507.28670002228444) / Math.Sqrt((2013.5285536954088 / (299)) + (83.97181846661816 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.20699439101044229 = (639.7012760964776 - 507.28670002228444) / 639.7012760964776 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Memory.ReadOnlyMemory<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToArray - Duration of single invocation 316.34 ns 225.50 ns 0.71 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlyMemory&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.ReadOnlyMemory<Byte>.ToArray(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 225.49761345002923 < 300.0337285648755.
IsChangePoint: Marked as a change because one of 10/17/2022 12:47:34 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 67.50434691763627 (T) = (0 -229.82994606534416) / Math.Sqrt((109.90367091018288 / (299)) + (8.623741179578385 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.24570294804954138 = (304.6942122749263 - 229.82994606534416) / 304.6942122749263 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.IO.Tests.StreamReaderReadLineTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ReadLine - Duration of single invocation 396.55 μs 362.93 μs 0.92 0.01 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 9, 32])

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 362.925201467803 < 377.4823943728537.
IsChangePoint: Marked as a change because one of 9/28/2022 6:40:13 PM, 11/15/2022 5:29:43 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 24.903038987149404 (T) = (0 -363266.3077489571) / Math.Sqrt((123890492.73240224 / (299)) + (8777748.37607192 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.0722920678676924 = (391574.00208274694 - 363266.3077489571) / 391574.00208274694 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
JsonNet_ - Duration of single invocation 737.39 μs 678.79 μs 0.92 0.00 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Json_ToStream<IndexViewModel>.JsonNet_

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 678.7873742150707 < 700.0878470106995.
IsChangePoint: Marked as a change because one of 9/28/2022 6:40:13 PM, 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 25.92370164905805 (T) = (0 -678579.8184606028) / Math.Sqrt((166200581.68001574 / (299)) + (29015830.051621944 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.0663238214399778 = (726782.8333235983 - 678579.8184606028) / 726782.8333235983 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Memory.Span<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToArray - Duration of single invocation 769.20 ns 517.06 ns 0.67 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Int32>.ToArray(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 517.0556421347823 < 727.6222490957294.
IsChangePoint: Marked as a change because one of 10/15/2022 9:29:34 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 125.4154012671675 (T) = (0 -522.541897948134) / Math.Sqrt((429.8227396109016 / (299)) + (20.195862160424785 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.30856092559080817 = (755.7309346374819 - 522.541897948134) / 755.7309346374819 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Text.Json.Tests.Perf_Base64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteByteArrayAsBase64_HeavyEscaping - Duration of single invocation 12.45 μs 11.69 μs 0.94 0.08 False
WriteByteArrayAsBase64_NoEscaping - Duration of single invocation 12.48 μs 11.63 μs 0.93 0.04 False
WriteByteArrayAsBase64_NoEscaping - Duration of single invocation 2.02 μs 1.88 μs 0.93 0.05 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Base64*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_HeavyEscaping(NumberOfBytes: 1000)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.690489197184855 < 11.832184777356517.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 9.532520687348878 (T) = (0 -11748.73935949964) / Math.Sqrt((61484.29664474259 / (299)) + (63961.10969178723 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.061847115238175814 = (12523.267316373896 - 11748.73935949964) / 12523.267316373896 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes: 1000)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.62854081594635 < 11.849096488238597.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 17.71471080668742 (T) = (0 -11703.099405405545) / Math.Sqrt((39127.85428552719 / (299)) + (19207.849149503763 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.0641630103797302 = (12505.489241405447 - 11703.099405405545) / 12505.489241405447 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes: 100)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.8818123932796678 < 1.919796581841439.
IsChangePoint: Marked as a change because one of 10/10/2022 9:53:50 PM, 10/14/2022 11:50:37 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 19.897799682259095 (T) = (0 -1862.3793321149938) / Math.Sqrt((1684.9111616391751 / (299)) + (417.7624893896863 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.06852506983234342 = (1999.3875001872389 - 1862.3793321149938) / 1999.3875001872389 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Memory.Span<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToArray - Duration of single invocation 465.80 ns 333.41 ns 0.72 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Char&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Char>.ToArray(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 333.41469765540404 < 443.2774991830993.
IsChangePoint: Marked as a change because one of 10/22/2022 11:45:45 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 110.13756350927531 (T) = (0 -331.84375977855933) / Math.Sqrt((158.39414822342104 / (299)) + (6.838955855834409 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.26773961294062204 = (453.17726541399077 - 331.84375977855933) / 453.17726541399077 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Text.Json.Tests.Perf_DateTimes

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
WriteDateTimes - Duration of single invocation 75.98 ms 70.05 ms 0.92 0.03 False
WriteDateTimes - Duration of single invocation 72.32 ms 66.97 ms 0.93 0.05 False
WriteDateTimes - Duration of single invocation 83.77 ms 75.68 ms 0.90 0.04 False
WriteDateTimes - Duration of single invocation 81.02 ms 74.18 ms 0.92 0.03 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_DateTimes*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: False)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 70.05247191666668 < 71.43947295583334.
IsChangePoint: Marked as a change because one of 10/21/2022 10:18:15 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.30293400636544 (T) = (0 -68387373.15773807) / Math.Sqrt((14839179070020.209 / (299)) + (978985954306.0999 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.13295699737119857 = (78874257.6208946 - 68387373.15773807) / 78874257.6208946 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: True)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 66.97046485714286 < 69.68991037491072.
IsChangePoint: Marked as a change because one of 10/5/2022 8:25:09 AM, 10/23/2022 1:14:54 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.49518924466978 (T) = (0 -66225157.24009857) / Math.Sqrt((14405937997943.586 / (299)) + (1150799279543.0117 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.14365558353965005 = (77334721.83287704 - 66225157.24009857) / 77334721.83287704 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: False)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 75.68115466666667 < 78.10601719791667.
IsChangePoint: Marked as a change because one of 10/17/2022 12:47:34 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.162622732141745 (T) = (0 -76053489.3885348) / Math.Sqrt((19745623576462.992 / (299)) + (1036764545396.0924 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.12826227364150136 = (87243544.80588134 - 76053489.3885348) / 87243544.80588134 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: True)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 74.18279764285715 < 76.59977944755951.
IsChangePoint: Marked as a change because one of 10/11/2022 10:51:47 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 19.240790754797484 (T) = (0 -73850120.575) / Math.Sqrt((20030262779436.867 / (299)) + (3134087421853.184 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1384443018965769 = (85717175.03298883 - 73850120.575) / 85717175.03298883 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Diagnostics.Perf_Activity

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ActivityAllocations - Duration of single invocation 1.87 μs 1.63 μs 0.87 0.02 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Diagnostics.Perf_Activity*'

Payloads

Baseline
Compare

Histogram

System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat: Hierarchical)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.630861866047232 < 1.7460530741793243.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 23.50300082820912 (T) = (0 -1638.3204204714402) / Math.Sqrt((3232.8551009592666 / (299)) + (554.5833628118013 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.10457201085924048 = (1829.6506702270387 - 1638.3204204714402) / 1829.6506702270387 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
AbsBenchmark - Duration of single invocation 53.06 ns 18.72 ns 0.35 0.15 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 73.00 ns 37.42 ns 0.51 0.07 False
SquareRootBenchmark - Duration of single invocation 260.02 ns 222.19 ns 0.85 0.13 False
UnaryNegateOperatorBenchmark - Duration of single invocation 277.98 ns 230.58 ns 0.83 0.08 False
BitwiseAndBenchmark - Duration of single invocation 72.17 ns 37.30 ns 0.52 0.10 False
ConditionalSelectBenchmark - Duration of single invocation 101.49 ns 62.45 ns 0.62 0.07 False
NegateBenchmark - Duration of single invocation 276.23 ns 245.32 ns 0.89 0.14 False
OnesComplementOperatorBenchmark - Duration of single invocation 62.85 ns 29.80 ns 0.47 0.12 False
AndNotBenchmark - Duration of single invocation 74.31 ns 39.47 ns 0.53 0.08 False
DivisionOperatorBenchmark - Duration of single invocation 356.01 ns 290.56 ns 0.82 0.09 False
BitwiseOrOperatorBenchmark - Duration of single invocation 69.79 ns 37.58 ns 0.54 0.05 False
MultiplyBenchmark - Duration of single invocation 288.21 ns 237.15 ns 0.82 0.10 False
XorBenchmark - Duration of single invocation 72.91 ns 37.23 ns 0.51 0.10 False
SubtractionOperatorBenchmark - Duration of single invocation 285.22 ns 238.60 ns 0.84 0.12 False
AllBitsSetBenchmark - Duration of single invocation 51.16 ns 15.05 ns 0.29 0.16 False
GreaterThanOrEqualBenchmark - Duration of single invocation 332.39 ns 289.34 ns 0.87 0.09 False
DivideBenchmark - Duration of single invocation 335.42 ns 302.74 ns 0.90 0.07 False
SubtractBenchmark - Duration of single invocation 286.38 ns 256.46 ns 0.90 0.10 False
LessThanBenchmark - Duration of single invocation 324.91 ns 285.16 ns 0.88 0.13 False
MinBenchmark - Duration of single invocation 366.64 ns 318.63 ns 0.87 0.08 False
MaxBenchmark - Duration of single invocation 380.38 ns 333.57 ns 0.88 0.06 False
AddBenchmark - Duration of single invocation 285.98 ns 241.26 ns 0.84 0.09 False
AddOperatorBenchmark - Duration of single invocation 282.90 ns 234.93 ns 0.83 0.14 False
OnesComplementBenchmark - Duration of single invocation 63.01 ns 29.51 ns 0.47 0.07 False
BitwiseOrBenchmark - Duration of single invocation 71.73 ns 37.67 ns 0.53 0.05 False
EqualsBenchmark - Duration of single invocation 47.07 ns 39.44 ns 0.84 0.21 False
MultiplyOperatorBenchmark - Duration of single invocation 282.81 ns 235.07 ns 0.83 0.09 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.22 ns 37.88 ns 0.52 0.14 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AbsBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.71733990642377 < 50.42680399882604.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 147.63158681622193 (T) = (0 -18.607605192806158) / Math.Sqrt((2.0012167048699894 / (89)) + (0.32136796587547184 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6496483144783277 = (53.11121927414024 - 18.607605192806158) / 53.11121927414024 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.421067409174555 < 69.34359315777338.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 135.04286593626335 (T) = (0 -37.20549981833496) / Math.Sqrt((2.913597583346799 / (89)) + (0.366399154401284 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4887607638265201 = (72.77512597978676 - 37.20549981833496) / 72.77512597978676 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 222.19095873228505 < 247.2267288181221.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.940540398127604 (T) = (0 -226.01218633726404) / Math.Sqrt((55.48809903270388 / (89)) + (51.429295828104955 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.14483489603744945 = (264.2907028011302 - 226.01218633726404) / 264.2907028011302 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 230.58346785389253 < 261.460867355559.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 13.214262067135238 (T) = (0 -232.83403814577332) / Math.Sqrt((39.885149535373486 / (89)) + (93.59675589398648 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.15091544937785525 = (274.2177301131792 - 232.83403814577332) / 274.2177301131792 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.29746151308057 < 68.64540451531754.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 141.95273588929416 (T) = (0 -37.3043462558659) / Math.Sqrt((2.331764778797961 / (89)) + (0.3364802135307364 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48210952948612806 = (72.0313432661756 - 37.3043462558659) / 72.0313432661756 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 62.44922140956036 < 96.47287523172443.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 73.01250310799766 (T) = (0 -64.37002719419579) / Math.Sqrt((6.150610278359116 / (89)) + (1.8225961730788285 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3625214821449606 = (100.97599431395008 - 64.37002719419579) / 100.97599431395008 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 245.32038389974278 < 263.2959355261432.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.630214540125525 (T) = (0 -234.84924164603618) / Math.Sqrt((44.185352281673254 / (89)) + (17.033379298821757 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1485713898843879 = (275.8296336954744 - 234.84924164603618) / 275.8296336954744 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.804588738348972 < 59.792278085855486.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 140.41619626183515 (T) = (0 -28.743616696247535) / Math.Sqrt((2.77912364954469 / (89)) + (0.2817583083232145 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5435099041669748 = (62.966572459353785 - 28.743616696247535) / 62.966572459353785 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.468888541610895 < 70.77391302853106.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 114.87680014065808 (T) = (0 -39.128285149229086) / Math.Sqrt((2.994288335531468 / (89)) + (0.5891057679191413 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47178863610530686 = (74.07694688868885 - 39.128285149229086) / 74.07694688868885 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 290.56355425046013 < 316.75416082046536.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.928775109405414 (T) = (0 -290.0654677389849) / Math.Sqrt((49.00017469589036 / (89)) + (8.159067005190092 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.12954361519255933 = (333.2337757544879 - 290.0654677389849) / 333.2337757544879 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.57989659044621 < 67.7289603131604.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 78.28694935844626 (T) = (0 -36.83086590791318) / Math.Sqrt((1.9688233668818365 / (89)) + (1.8151573963438206 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48958585452676867 = (72.15878759348524 - 36.83086590791318) / 72.15878759348524 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 237.15056993490984 < 271.2409508932683.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 59.47685178781352 (T) = (0 -237.34823053319718) / Math.Sqrt((46.93073153057562 / (89)) + (0.5895649802200169 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1609832630792715 = (282.8885528604445 - 237.34823053319718) / 282.8885528604445 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.23346753729817 < 69.26551124430705.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 109.46573691391781 (T) = (0 -37.28993271436245) / Math.Sqrt((4.4134424468459725 / (89)) + (0.563166805879374 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4885735272856442 = (72.91357546755268 - 37.28993271436245) / 72.91357546755268 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 238.59514969194709 < 269.79392938054445.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 19.07799155865489 (T) = (0 -241.31802935084752) / Math.Sqrt((30.680557809644597 / (89)) + (42.40986605624667 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1447844320584149 = (282.17216617288074 - 241.31802935084752) / 282.17216617288074 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.049871752720396 < 48.6211241023689.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 43.44716546560827 (T) = (0 -15.886419679053876) / Math.Sqrt((3.8840413357852297 / (89)) + (6.1274487135727975 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6890277120695713 = (51.08628741416347 - 15.886419679053876) / 51.08628741416347 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 289.3375473039162 < 313.93957360180224.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 43.10170675128009 (T) = (0 -288.86061160759834) / Math.Sqrt((80.30427529300411 / (88)) + (0.7239000131334528 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.12898426091902376 = (331.6365005210815 - 288.86061160759834) / 331.6365005210815 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 302.7447124140434 < 318.86590354999663.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 13.23669551008683 (T) = (0 -298.77718185182215) / Math.Sqrt((37.7215651437196 / (89)) + (72.0367096660004 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.10901670953052035 = (335.33421451079016 - 298.77718185182215) / 335.33421451079016 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 256.460912532385 < 272.05018430916545.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 20.68165784726139 (T) = (0 -243.5326413923487) / Math.Sqrt((87.0244137539642 / (89)) + (32.76123959435746 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.14904860281059784 = (286.18866153426615 - 243.5326413923487) / 286.18866153426615 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 285.1552941621438 < 308.65967879533827.
IsChangePoint: Marked as a change because one of 12/3/2022 7:24:45 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 13.981837194835448 (T) = (0 -289.58278092642377) / Math.Sqrt((138.63742463148634 / (90)) + (40.017831720277954 / (9))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (90) + (9) - 2, .975) and 0.10565617892332599 = (323.7935725634059 - 289.58278092642377) / 323.7935725634059 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 318.633638776542 < 345.4105815769839.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 47.76553442633656 (T) = (0 -317.9774149989082) / Math.Sqrt((68.54580141720477 / (89)) + (0.4607572018402717 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.11949813140989211 = (361.13201611720075 - 317.9774149989082) / 361.13201611720075 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 333.5726099073225 < 349.84072644485155.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.035654033165642 (T) = (0 -334.12027919525497) / Math.Sqrt((62.96912355137654 / (89)) + (5.689994954328743 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.08659351593692018 = (365.79582587261405 - 334.12027919525497) / 365.79582587261405 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 241.25716139975688 < 271.56269037217.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.539864053099105 (T) = (0 -241.09967609656024) / Math.Sqrt((40.92529869676278 / (89)) + (30.20904762276313 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1485141594571921 = (283.15171505713266 - 241.09967609656024) / 283.15171505713266 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 234.93398405696885 < 272.76536285741025.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 14.697252677839467 (T) = (0 -238.8122353141619) / Math.Sqrt((280.58193485692595 / (88)) + (55.150342320030965 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.15366291264221177 = (282.171535291829 - 238.8122353141619) / 282.171535291829 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.511031516457113 < 60.11351214557482.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 143.79731537848537 (T) = (0 -29.048430744965515) / Math.Sqrt((2.0093000739338054 / (89)) + (0.3352903800804149 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5397109588090031 = (63.10910785493125 - 29.048430744965515) / 63.10910785493125 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.674890678092424 < 68.64832013827147.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 185.39047194081985 (T) = (0 -37.484908606697985) / Math.Sqrt((1.4990227724954261 / (89)) + (0.1825028309308766 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48092236660704474 = (72.21445540174322 - 37.484908606697985) / 72.21445540174322 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.EqualsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.44295771950388 < 41.091393590306204.
IsChangePoint: Marked as a change because one of 12/2/2022 5:21:30 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 9.622454360900937 (T) = (0 -39.91422637360862) / Math.Sqrt((2.252745044615355 / (83)) + (1.0115729915513887 / (16))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (83) + (16) - 2, .975) and 0.06757292376249172 = (42.80680751428721 - 39.91422637360862) / 42.80680751428721 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 235.0741447656764 < 269.23189898291344.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 50.23340433387646 (T) = (0 -235.09888128525222) / Math.Sqrt((53.618754057824965 / (89)) + (2.040894489840793 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.16099784475869625 = (280.2124879138551 - 235.09888128525222) / 280.2124879138551 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.879280958384605 < 68.48519399028476.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 85.31171462461768 (T) = (0 -37.21204635056223) / Math.Sqrt((3.7987482365587324 / (89)) + (1.2834913444490548 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4866846643027107 = (72.49354103168038 - 37.21204635056223) / 72.49354103168038 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EqualsStaticBenchmark - Duration of single invocation 221.68 ns 182.15 ns 0.82 0.13 False
GreaterThanBenchmark - Duration of single invocation 220.41 ns 178.72 ns 0.81 0.18 False
MultiplyBenchmark - Duration of single invocation 220.03 ns 171.62 ns 0.78 0.16 False
AddBenchmark - Duration of single invocation 218.41 ns 178.70 ns 0.82 0.21 False
MaxBenchmark - Duration of single invocation 254.70 ns 223.15 ns 0.88 0.14 False
BitwiseOrOperatorBenchmark - Duration of single invocation 72.20 ns 37.83 ns 0.52 0.19 False
DivisionOperatorBenchmark - Duration of single invocation 227.30 ns 191.80 ns 0.84 0.03 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 81.37 ns 37.45 ns 0.46 0.12 False
AndNotBenchmark - Duration of single invocation 74.22 ns 39.17 ns 0.53 0.05 False
MultiplyOperatorBenchmark - Duration of single invocation 215.43 ns 175.18 ns 0.81 0.15 False
GreaterThanOrEqualBenchmark - Duration of single invocation 223.37 ns 186.07 ns 0.83 0.08 False
MinBenchmark - Duration of single invocation 245.63 ns 208.08 ns 0.85 0.17 False
OnesComplementBenchmark - Duration of single invocation 64.44 ns 29.42 ns 0.46 0.07 False
AllBitsSetBenchmark - Duration of single invocation 50.80 ns 15.34 ns 0.30 0.16 False
ConditionalSelectBenchmark - Duration of single invocation 101.98 ns 65.35 ns 0.64 0.13 False
SubtractionOperatorBenchmark - Duration of single invocation 234.88 ns 166.65 ns 0.71 0.15 False
LessThanOrEqualBenchmark - Duration of single invocation 228.74 ns 187.68 ns 0.82 0.16 False
XorBenchmark - Duration of single invocation 73.42 ns 35.25 ns 0.48 0.08 False
SubtractBenchmark - Duration of single invocation 220.84 ns 170.33 ns 0.77 0.12 False
BitwiseAndBenchmark - Duration of single invocation 72.46 ns 37.29 ns 0.51 0.11 False
BitwiseOrBenchmark - Duration of single invocation 72.44 ns 37.65 ns 0.52 0.11 False
LessThanBenchmark - Duration of single invocation 226.65 ns 183.04 ns 0.81 0.15 False
OnesComplementOperatorBenchmark - Duration of single invocation 62.89 ns 29.41 ns 0.47 0.07 False
AddOperatorBenchmark - Duration of single invocation 217.46 ns 169.90 ns 0.78 0.17 False
SquareRootBenchmark - Duration of single invocation 199.18 ns 160.74 ns 0.81 0.13 False
SumBenchmark - Duration of single invocation 73.40 ns 69.02 ns 0.94 0.17 False
NegateBenchmark - Duration of single invocation 208.90 ns 161.38 ns 0.77 0.19 False
AbsBenchmark - Duration of single invocation 52.70 ns 18.66 ns 0.35 0.06 False
DivideBenchmark - Duration of single invocation 229.96 ns 190.51 ns 0.83 0.14 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.31 ns 37.69 ns 0.52 0.08 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsStaticBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 182.14981537030653 < 211.05513136749113.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 18.20285160184817 (T) = (0 -182.77594360749677) / Math.Sqrt((32.097360788516085 / (88)) + (48.297845817802646 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.18499281067714446 = (224.26298320062085 - 182.77594360749677) / 224.26298320062085 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 178.71540968173719 < 209.42775721233411.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.706408466897532 (T) = (0 -182.58186759616086) / Math.Sqrt((136.1193665538885 / (89)) + (56.43917103258464 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.18725537915299037 = (224.64850940001475 - 182.58186759616086) / 224.64850940001475 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 171.62284659646548 < 207.4819419974078.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.120491033928573 (T) = (0 -175.95478007667322) / Math.Sqrt((84.23234894569025 / (89)) + (46.887042304791066 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.17863466288822485 = (214.22231025160548 - 175.95478007667322) / 214.22231025160548 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 178.70398372816823 < 210.86610387922158.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.23094262189289 (T) = (0 -174.7217943226736) / Math.Sqrt((117.65143973251101 / (89)) + (51.50577229529502 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.19115943309589978 = (216.0151227224356 - 174.7217943226736) / 216.0151227224356 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 223.15154561122932 < 237.16601787990157.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 18.548305409506096 (T) = (0 -208.98277116646992) / Math.Sqrt((109.93752141240276 / (89)) + (42.68553966632641 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.17233712004465376 = (252.49745545885165 - 208.98277116646992) / 252.49745545885165 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.828094684173074 < 68.71548561249757.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 118.32398598851279 (T) = (0 -37.64255042652786) / Math.Sqrt((5.09919659554426 / (89)) + (0.276088336105371 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47805649317573207 = (72.11997071399847 - 37.64255042652786) / 72.11997071399847 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 191.80350002733203 < 216.9780345274221.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.286016778083646 (T) = (0 -187.63534803585532) / Math.Sqrt((34.50706147763894 / (89)) + (16.481108494543022 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.17701829108450065 = (227.9945544392664 - 187.63534803585532) / 227.9945544392664 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.449501209374795 < 69.30305617555186.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 141.15252147238192 (T) = (0 -36.84062574447345) / Math.Sqrt((5.083521349931782 / (89)) + (0.0802528237515366 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49441484354656423 = (72.86730093680363 - 36.84062574447345) / 72.86730093680363 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.17206710520398 < 70.5151770690002.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 91.42883326659636 (T) = (0 -38.61839954265056) / Math.Sqrt((1.6816343679964996 / (89)) + (1.2923025406069073 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4767624391925099 = (73.80662711417818 - 38.61839954265056) / 73.80662711417818 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 175.18022633744857 < 204.56845081364176.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 13.04316005373435 (T) = (0 -173.92911209168827) / Math.Sqrt((48.502929490977685 / (89)) + (76.63226867782261 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.17685285667292253 = (211.29771694120737 - 173.92911209168827) / 211.29771694120737 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 186.06555611255274 < 211.33028585331212.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 33.74315455931313 (T) = (0 -187.5298507544111) / Math.Sqrt((24.03218821903063 / (89)) + (9.145658882888746 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.16376709458351055 = (224.25552682719538 - 187.5298507544111) / 224.25552682719538 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 208.0753118868865 < 234.0507165327882.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.69735669923465 (T) = (0 -208.87719440973768) / Math.Sqrt((35.75990358911915 / (89)) + (27.39710743060313 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.16149496182494455 = (249.10666591144584 - 208.87719440973768) / 249.10666591144584 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.424463004147288 < 60.474725688707885.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 101.30951068416246 (T) = (0 -29.075197626159174) / Math.Sqrt((2.2392193051948053 / (89)) + (0.8755751378804344 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5391344253479002 = (63.08823922921035 - 29.075197626159174) / 63.08823922921035 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.337865545908754 < 48.627342470744274.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 94.55979916456968 (T) = (0 -15.805867230084024) / Math.Sqrt((1.6354850138225527 / (89)) + (1.1917731456420353 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6893281518630318 = (50.87640648764408 - 15.805867230084024) / 50.87640648764408 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.34821067214126 < 96.65015300236806.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 43.85790422251835 (T) = (0 -65.26582140554402) / Math.Sqrt((5.140371177013639 / (89)) + (6.105318836767995 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.3545654361008588 = (101.11919171366654 - 65.26582140554402) / 101.11919171366654 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 166.6502014197983 < 207.4869609643557.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 42.758400337629766 (T) = (0 -168.89473015216538) / Math.Sqrt((75.84493664969881 / (89)) + (3.0232984857155865 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21385087973069325 = (214.8380323752166 - 168.89473015216538) / 214.8380323752166 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 187.67661266302483 < 217.83841416747717.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 29.527079752489676 (T) = (0 -188.76444384043512) / Math.Sqrt((176.69371019989745 / (89)) + (2.728951614725695 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.19032432720428066 = (233.13587178512188 - 188.76444384043512) / 233.13587178512188 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 35.25112430806032 < 69.51211994458781.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 165.61670620898215 (T) = (0 -36.552184205126906) / Math.Sqrt((2.0701196360166776 / (89)) + (0.23944499040321865 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49607500968635304 = (72.5349702986084 - 36.552184205126906) / 72.5349702986084 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 170.326237771183 < 210.5205919782235.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.997996179394704 (T) = (0 -172.23744567364642) / Math.Sqrt((77.18564622448197 / (89)) + (3.010069335338943 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.20858203834506744 = (217.63145899984508 - 172.23744567364642) / 217.63145899984508 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.2889716346708 < 68.79161846307875.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 132.17303178515317 (T) = (0 -37.06523420621543) / Math.Sqrt((4.6106418696550575 / (88)) + (0.20073247144322098 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.48978137566575736 = (72.64578837077909 - 37.06523420621543) / 72.64578837077909 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.65093791606774 < 68.80014496734347.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 88.28343330996918 (T) = (0 -37.75893183809537) / Math.Sqrt((2.8446254341244863 / (89)) + (1.2018571555027098 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47698601920307543 = (72.19488048973662 - 37.75893183809537) / 72.19488048973662 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 183.03565522926326 < 210.39994688535566.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 42.21577343518103 (T) = (0 -181.53922843771076) / Math.Sqrt((51.7655389967586 / (89)) + (4.165027415008354 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.18852702815033295 = (223.71568091037122 - 181.53922843771076) / 223.71568091037122 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.408579689381334 < 59.934011609013766.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 157.48390849636797 (T) = (0 -28.979219382755605) / Math.Sqrt((3.2640447804707553 / (89)) + (0.10206490459205506 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5405791754363475 = (63.07772271811885 - 28.979219382755605) / 63.07772271811885 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 169.90450781563803 < 206.1741206704686.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.40703184136325 (T) = (0 -168.8513496778993) / Math.Sqrt((73.25829836054946 / (89)) + (5.677376941422277 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.20273393489169345 = (211.78795519781877 - 168.8513496778993) / 211.78795519781877 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 160.74358131570096 < 187.24978261070447.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.40118560108333 (T) = (0 -155.52275951626996) / Math.Sqrt((19.827199159586073 / (89)) + (21.40532800548671 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.18128783753112102 = (189.96024078508998 - 155.52275951626996) / 189.96024078508998 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.SumBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 69.02311524847595 < 72.49345377275976.
IsChangePoint: Marked as a change because one of 12/1/2022 11:48:13 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 8.600784575533853 (T) = (0 -69.10652102921613) / Math.Sqrt((12.408440638860245 / (81)) + (1.3293485187028542 / (18))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (81) + (18) - 2, .975) and 0.055982641311266804 = (73.20471429170226 - 69.10652102921613) / 73.20471429170226 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 161.37752129248483 < 198.6430124154842.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.911883106272843 (T) = (0 -163.97400695642096) / Math.Sqrt((43.64041819199265 / (89)) + (19.02835720315358 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21430907512831648 = (208.7003957481126 - 163.97400695642096) / 208.7003957481126 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.66237575878405 < 50.1816628703324.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 246.53208621671678 (T) = (0 -18.367686887577907) / Math.Sqrt((1.0244167281253918 / (89)) + (0.08155628248606234 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6530482627616104 = (52.94017846337377 - 18.367686887577907) / 52.94017846337377 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 190.51044994127207 < 219.21357835567073.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.398254640487483 (T) = (0 -190.7283858122213) / Math.Sqrt((49.69037690167738 / (89)) + (16.504144418439214 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.17593113623215675 = (231.4471450118437 - 190.7283858122213) / 231.4471450118437 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.68637351983908 < 68.78102444146089.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 146.6528616526759 (T) = (0 -36.83147604933093) / Math.Sqrt((3.9051990342946796 / (89)) + (0.14809419908622865 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4909899799494982 = (72.3590393086499 - 36.83147604933093) / 72.3590393086499 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in Benchstone.BenchI.NDhrystone

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Test - Duration of single invocation 4.22 secs 3.75 secs 0.89 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.NDhrystone*'

Payloads

Baseline
Compare

Histogram

Benchstone.BenchI.NDhrystone.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.7548416804 < 3.991572804648626.
IsChangePoint: Marked as a change because one of 10/11/2022 8:42:28 PM, 11/15/2022 8:48:03 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.457931929479475 (T) = (0 -3744522474.7766294) / Math.Sqrt((17227865466408946 / (299)) + (1821934319749896 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1052980812063447 = (4185217887.7915506 - 3744522474.7766294) / 4185217887.7915506 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Numerics.Tests.Constructor

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ConstructorBenchmark_UInt64 - Duration of single invocation 43.36 ns 29.07 ns 0.67 0.16 False
ConstructorBenchmark_UInt16 - Duration of single invocation 42.50 ns 29.38 ns 0.69 0.15 False
ConstructorBenchmark_Byte - Duration of single invocation 40.20 ns 29.01 ns 0.72 0.13 False
ConstructorBenchmark_Double - Duration of single invocation 40.59 ns 29.70 ns 0.73 0.17 False
ConstructorBenchmark_SByte - Duration of single invocation 40.64 ns 29.35 ns 0.72 0.14 False
ConstructorBenchmark_UInt32 - Duration of single invocation 44.39 ns 29.20 ns 0.66 0.18 False
ConstructorBenchmark_Int32 - Duration of single invocation 40.77 ns 31.60 ns 0.77 0.17 False
ConstructorBenchmark_Int64 - Duration of single invocation 41.87 ns 28.95 ns 0.69 0.15 False
ConstructorBenchmark_Int16 - Duration of single invocation 40.18 ns 31.20 ns 0.78 0.14 False
ConstructorBenchmark_Single - Duration of single invocation 40.57 ns 28.96 ns 0.71 0.11 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Constructor*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Constructor.ConstructorBenchmark_UInt64

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.067194258776404 < 38.87756759543105.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.62490608609587 (T) = (0 -29.597259988675205) / Math.Sqrt((29.32313309253522 / (299)) + (6.026090434528785 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.31981284066266036 = (43.5134059536052 - 29.597259988675205) / 43.5134059536052 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_UInt16

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.377136152925637 < 39.35728112947707.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 24.094292561768913 (T) = (0 -29.822329619295054) / Math.Sqrt((30.73028774865268 / (299)) + (2.4066961363695336 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.32133478848441 = (43.942623127382724 - 29.822329619295054) / 43.942623127382724 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_Byte

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.009650391174493 < 38.68263475499445.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 40.4182493924022 (T) = (0 -29.161983968463726) / Math.Sqrt((32.577984261559145 / (299)) + (0.232391144641431 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.33507476467042013 = (43.85753829001416 - 29.161983968463726) / 43.85753829001416 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_Double

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.697779423819053 < 38.51031898823239.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 29.11815875076909 (T) = (0 -29.42272495758756) / Math.Sqrt((27.329005631032413 / (299)) + (1.4555451875799255 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3251188026318853 = (43.59689538296457 - 29.42272495758756) / 43.59689538296457 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_SByte

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.345504503216283 < 38.60101697369294.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.35457670272919 (T) = (0 -29.1979567325453) / Math.Sqrt((27.74030342498776 / (299)) + (0.3012956991146977 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3317942019162042 = (43.696054144211054 - 29.1979567325453) / 43.696054144211054 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_UInt32

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.1994753883086 < 39.733012617621455.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 33.79814691053325 (T) = (0 -28.866239308366733) / Math.Sqrt((26.74373468162629 / (299)) + (1.0019610442985927 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3376955645490995 = (43.584547774792476 - 28.866239308366733) / 43.584547774792476 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_Int32

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.595291812657944 < 38.67610452503729.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 34.30317212149879 (T) = (0 -29.2424668836152) / Math.Sqrt((29.766298001282372 / (299)) + (0.7693635741269982 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.33012229659448356 = (43.65344112059961 - 29.2424668836152) / 43.65344112059961 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_Int64

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 28.953778255111803 < 38.71763518435621.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.676851048383096 (T) = (0 -29.280605065827) / Math.Sqrt((26.61975216995882 / (299)) + (1.5874772822408842 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3277347900066476 = (43.555139594560515 - 29.280605065827) / 43.555139594560515 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_Int16

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 31.203209421855565 < 38.66113510473279.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 37.215110395572125 (T) = (0 -29.315201346413897) / Math.Sqrt((28.16904119017659 / (299)) + (0.5395537150791816 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.32825201005484467 = (43.64017724683825 - 29.315201346413897) / 43.64017724683825 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Constructor.ConstructorBenchmark_Single

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 28.961635572509127 < 38.60667925336492.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.43284056789841 (T) = (0 -28.852736187906356) / Math.Sqrt((26.210143712780965 / (299)) + (0.11345006419489395 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.33615114596659595 = (43.4628093618047 - 28.852736187906356) / 43.4628093618047 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Text.Json.Serialization.Tests.WriteJson<BinaryData>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SerializeToStream - Duration of single invocation 22.50 μs 21.08 μs 0.94 0.02 False
SerializeToUtf8Bytes - Duration of single invocation 15.78 μs 14.63 μs 0.93 0.02 False
SerializeToStream - Duration of single invocation 23.07 μs 17.68 μs 0.77 0.09 False
SerializeToUtf8Bytes - Duration of single invocation 18.05 μs 16.93 μs 0.94 0.02 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;BinaryData&gt;*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<BinaryData>.SerializeToStream(Mode: Reflection)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 31.974567807098495 (T) = (0 -20976.89944303822) / Math.Sqrt((24992.05276621524 / (35)) + (19409.564105246467 / (10))) is greater than 2.0166921992262345 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (10) - 2, .975) and 0.07282159531199509 = (22624.447826841842 - 20976.89944303822) / 22624.447826841842 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Serialization.Tests.WriteJson&lt;BinaryData&gt;.SerializeToUtf8Bytes(Mode: SourceGen)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 32.35319547030099 (T) = (0 -14547.65758092677) / Math.Sqrt((22104.210162910607 / (35)) + (5224.060935318628 / (10))) is greater than 2.0166921992262345 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (10) - 2, .975) and 0.07024073606422625 = (15646.692800182413 - 14547.65758092677) / 15646.692800182413 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Serialization.Tests.WriteJson&lt;BinaryData&gt;.SerializeToStream(Mode: SourceGen)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/5/2022 3:14:07 PM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.40412657913439 (T) = (0 -17680.2237901695) / Math.Sqrt((598911.5590477793 / (43)) + (45.955731088760096 / (2))) is greater than 2.0166921992262345 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (2) - 2, .975) and 0.21667269927492305 = (22570.672276842677 - 17680.2237901695) / 22570.672276842677 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Serialization.Tests.WriteJson&lt;BinaryData&gt;.SerializeToUtf8Bytes(Mode: Reflection)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 25.96892259569863 (T) = (0 -16997.568655010367) / Math.Sqrt((39138.409058140525 / (35)) + (10074.306162203051 / (10))) is greater than 2.0166921992262345 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (10) - 2, .975) and 0.06580412012481196 = (18194.865789047693 - 16997.568655010367) / 18194.865789047693 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.IO.Tests.StreamReaderReadToEndTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ReadToEnd - Duration of single invocation 225.96 ms 142.97 ms 0.63 0.05 False
ReadToEnd - Duration of single invocation 225.54 ms 133.55 ms 0.59 0.03 False
ReadToEnd - Duration of single invocation 215.13 ms 145.38 ms 0.68 0.06 False
ReadToEnd - Duration of single invocation 224.21 ms 142.75 ms 0.64 0.07 False
ReadToEndAsync - Duration of single invocation 247.39 ms 169.93 ms 0.69 0.04 False
ReadToEndAsync - Duration of single invocation 262.20 ms 171.24 ms 0.65 0.02 False
ReadToEnd - Duration of single invocation 224.03 ms 143.60 ms 0.64 0.06 False
ReadToEnd - Duration of single invocation 224.16 ms 142.54 ms 0.64 0.03 False
ReadToEndAsync - Duration of single invocation 257.29 ms 171.12 ms 0.67 0.03 False
ReadToEndAsync - Duration of single invocation 256.87 ms 169.44 ms 0.66 0.04 False
ReadToEndAsync - Duration of single invocation 257.80 ms 170.52 ms 0.66 0.03 False
ReadToEndAsync - Duration of single invocation 260.99 ms 171.91 ms 0.66 0.03 False
ReadToEndAsync - Duration of single invocation 262.13 ms 164.11 ms 0.63 0.03 False
ReadToEndAsync - Duration of single invocation 266.45 ms 169.28 ms 0.64 0.03 False
ReadToEnd - Duration of single invocation 228.60 ms 141.22 ms 0.62 0.06 False
ReadToEnd - Duration of single invocation 223.99 ms 145.09 ms 0.65 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StreamReaderReadToEndTests*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 0])

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 142.97346442307693 < 214.34111625166665.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 66.94619324548079 (T) = (0 -143836424.95234433) / Math.Sqrt((33802038565319.85 / (299)) + (10785732242295.477 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.33690234408692277 = (216915900.19916955 - 143836424.95234433) / 216915900.19916955 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [   9,   32])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 133.54717673333334 < 213.67878155583333.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 62.15758846483921 (T) = (0 -143501882.02976188) / Math.Sqrt((28436663573602.605 / (299)) + (13012536814405.166 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.33855484532821667 = (216952049.63889888 - 143501882.02976188) / 216952049.63889888 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 129, 1024])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 145.38013417857144 < 211.54576126499998.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.725754236406964 (T) = (0 -143025909.24048534) / Math.Sqrt((31729857504653.633 / (299)) + (18358857928501.547 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3393793846805582 = (216502340.25973508 - 143025909.24048534) / 216502340.25973508 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [   1,    1])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 142.7529181 < 213.32385154916665.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 43.64385319257568 (T) = (0 -141817770.46761903) / Math.Sqrt((29237151955370.9 / (299)) + (28583988379549.15 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.34603108740685207 = (216857051.9740405 - 141817770.46761903) / 216857051.9740405 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [   1,    1])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 169.92610692307693 < 245.49159067857144.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 104.78665641591707 (T) = (0 -174945302.93474358) / Math.Sqrt((29231665705810.543 / (299)) + (4613401578471.261 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3093294619858644 = (253297763.99288523 - 174945302.93474358) / 253297763.99288523 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [1025, 2048])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 171.2377922 < 248.75435107119048.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 152.8416504183674 (T) = (0 -173788591.5123077) / Math.Sqrt((28537328701212.93 / (299)) + (1720698598240.5679 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.31265590971707835 = (252840744.49636075 - 173788591.5123077) / 252840744.49636075 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [  33,  128])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 143.5971156 < 214.35980118303573.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 68.63517598512449 (T) = (0 -143433973.48023808) / Math.Sqrt((32690866415319.176 / (299)) + (10234710895067.885 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.33744049871837634 = (216484667.72084048 - 143433973.48023808) / 216484667.72084048 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [1025, 2048])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 142.53616326923077 < 214.30557568178568.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 135.27350690401335 (T) = (0 -145067788.06120878) / Math.Sqrt((33083285212777.59 / (299)) + (1728507014292.8105 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.33177253075757446 = (217093422.1331446 - 145067788.06120878) / 217093422.1331446 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [ 129, 1024])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 171.1192426 < 245.75366201359893.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 140.17538203292912 (T) = (0 -173642064.20490843) / Math.Sqrt((32053512228634.01 / (299)) + (2121503630544.6194 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3132795844206468 = (252857000.12051472 - 173642064.20490843) / 252857000.12051472 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [   1,    8])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 169.4395596 < 245.658542525.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 75.16537638670829 (T) = (0 -172483848.1543956) / Math.Sqrt((28632663141786.59 / (299)) + (10450555386350.191 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.31761792149925205 = (252767259.8514859 - 172483848.1543956) / 252767259.8514859 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [   9,   32])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 170.51507192857144 < 246.39445981464283.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 87.44810806246926 (T) = (0 -171469271.17880952) / Math.Sqrt((32142749946222.33 / (299)) + (7688891603792.193 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3231505513983166 = (253334432.83887026 - 171469271.17880952) / 253334432.83887026 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [  33,  128])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 171.9089968 < 248.36106604500003.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 127.66031476975108 (T) = (0 -173694933.32904762) / Math.Sqrt((30745712094964.168 / (299)) + (2808521734001.2715 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.31283470287715 = (252770234.55099595 - 173694933.32904762) / 252770234.55099595 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [   0,    0])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 164.11250142307694 < 248.69958628999998.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 66.0563231646529 (T) = (0 -172182078.56897435) / Math.Sqrt((30598264006368.85 / (299)) + (13898252628343.836 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3190953789459941 = (252872536.39495823 - 172182078.56897435) / 252872536.39495823 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEndAsync(LineLengthRange: [   0, 1024])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 169.2849302857143 < 246.95710911499998.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 84.20751972907841 (T) = (0 -173461818.18970695) / Math.Sqrt((29576768031690.723 / (299)) + (7816941310772.236 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.31297620903996687 = (252482985.99283573 - 173461818.18970695) / 252482985.99283573 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [   0, 1024])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 141.22139280000002 < 215.39973791035715.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 57.874368458279825 (T) = (0 -143676747.4035714) / Math.Sqrt((34220202754147.637 / (299)) + (14733419285626.8 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3366811245381774 = (216602832.69270653 - 143676747.4035714) / 216602832.69270653 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [   1,    8])

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 145.08850496666668 < 212.93697753690475.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 63.14427434435815 (T) = (0 -143416959.14443225) / Math.Sqrt((31262232420980.188 / (299)) + (12402044601714.451 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.3379985652216346 = (216641462.70687085 - 143416959.14443225) / 216641462.70687085 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Globalization.Tests.Perf_NumberCultureInfo

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ToString - Duration of single invocation 1.98 μs 1.85 μs 0.94 0.04 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.Perf_NumberCultureInfo*'

Payloads

Baseline
Compare

Histogram

System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: ja)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.8480865934788548 < 1.8625381309272135.
IsChangePoint: Marked as a change because one of 9/28/2022 6:40:13 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 14.128286344587904 (T) = (0 -1844.638632371421) / Math.Sqrt((3176.858905916891 / (299)) + (649.6273964967552 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.06243189777326556 = (1967.4716193846443 - 1844.638632371421) / 1967.4716193846443 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Tests.Perf_Guid

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
TryWriteBytes - Duration of single invocation 33.78 ns 22.05 ns 0.65 0.22 False
ctor_bytes - Duration of single invocation 54.60 ns 43.23 ns 0.79 0.17 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Guid*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Guid.TryWriteBytes

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 22.05420136359438 < 32.490720517827704.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 67.2291470925338 (T) = (0 -22.12183377732135) / Math.Sqrt((10.16694743497724 / (299)) + (0.06202742844801152 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.37863904321800357 = (35.602226911535354 - 22.12183377732135) / 35.602226911535354 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Guid.ctor_bytes

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.23374851148047 < 53.622357535262516.
IsChangePoint: Marked as a change because one of 10/11/2022 1:45:10 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.69076391846453 (T) = (0 -41.39470989830376) / Math.Sqrt((11.83510852615213 / (299)) + (0.6743455165561637 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.26100131316446096 = (56.01459195490556 - 41.39470989830376) / 56.01459195490556 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Text.Encodings.Web.Tests.Perf_Encoders

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
EncodeUtf8 - Duration of single invocation 2.94 μs 2.43 μs 0.83 0.15 False
EncodeUtf8 - Duration of single invocation 39.53 μs 33.50 μs 0.85 0.14 False
EncodeUtf8 - Duration of single invocation 38.80 μs 32.88 μs 0.85 0.14 False
EncodeUtf8 - Duration of single invocation 39.32 μs 33.40 μs 0.85 0.14 False
EncodeUtf8 - Duration of single invocation 39.90 μs 33.52 μs 0.84 0.19 False
EncodeUtf8 - Duration of single invocation 3.53 μs 2.70 μs 0.77 0.19 False
EncodeUtf8 - Duration of single invocation 39.09 μs 34.11 μs 0.87 0.12 False
EncodeUtf8 - Duration of single invocation 2.34 μs 1.99 μs 0.85 0.10 False
EncodeUtf8 - Duration of single invocation 38.80 μs 32.91 μs 0.85 0.16 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'

Payloads

Baseline
Compare

Histogram

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,16)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.4291690401785715 < 2.815107722010063.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.91331312333726 (T) = (0 -2478.9430762722127) / Math.Sqrt((22441.984017709547 / (299)) + (2694.7816136394217 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.17796623496029615 = (3015.6219631105796 - 2478.9430762722127) / 3015.6219631105796 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 33.4981939429267 < 37.841267988782285.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 25.54448638835309 (T) = (0 -34067.89882655421) / Math.Sqrt((5075060.225288263 / (299)) + (726304.3859021332 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.18330528592314999 = (41714.36185314707 - 34067.89882655421) / 41714.36185314707 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+&lt;World&gt;!,512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 32.87581132624398 < 36.877292302183676.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.492542525140575 (T) = (0 -33589.589796242166) / Math.Sqrt((5160335.464417437 / (299)) + (488294.18425351783 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.17902644662411224 = (40914.338419453285 - 33589.589796242166) / 40914.338419453285 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 33.40101120689655 < 37.329354961302045.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 7:24:45 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 42.412189118232966 (T) = (0 -33793.860978786935) / Math.Sqrt((5539795.45876737 / (299)) + (92455.38970920039 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.17558895101639896 = (40991.51875808879 - 33793.860978786935) / 40991.51875808879 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no &lt;escaping /&gt; required,512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 33.523454217121404 < 37.88488914726828.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.624775552960767 (T) = (0 -34795.36024542809) / Math.Sqrt((6655445.787808938 / (299)) + (1730361.5794921361 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1743348337155115 = (42142.21656220279 - 34795.36024542809) / 42142.21656220279 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no &lt;escaping /&gt; required,16)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.7025581032896246 < 3.082755093038565.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 39.6696440474762 (T) = (0 -2720.8832783952616) / Math.Sqrt((37146.54655100927 / (299)) + (1430.2932039471496 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.1924754643533179 = (3369.4125172510367 - 2720.8832783952616) / 3369.4125172510367 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 34.11165483796296 < 36.96565657736301.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.40348903750077 (T) = (0 -33291.42041503935) / Math.Sqrt((5599170.353405677 / (299)) + (87036.05740117292 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.18755358545787068 = (40976.75836725971 - 33291.42041503935) / 40976.75836725971 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",16)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.9914578430740122 < 2.1853734323299383.
IsChangePoint: Marked as a change because one of 10/11/2022 8:42:28 PM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 40.90123611408074 (T) = (0 -2002.5965318143512) / Math.Sqrt((15025.983810161006 / (299)) + (363.814532740412 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.15973725751163217 = (2383.298021620986 - 2002.5965318143512) / 2383.298021620986 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 32.908473336466166 < 36.93562686512804.
IsChangePoint: Marked as a change because one of 10/11/2022 6:23:40 AM, 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.665230747691986 (T) = (0 -33340.55552172829) / Math.Sqrt((4380315.402721774 / (299)) + (108587.31922415132 / (10))) is greater than 1.9677212881555053 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (10) - 2, .975) and 0.17625217363925394 = (40474.2257943481 - 33340.55552172829) / 40474.2257943481 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
AndNotBenchmark - Duration of single invocation 74.00 ns 40.11 ns 0.54 0.04 False
BitwiseAndBenchmark - Duration of single invocation 71.42 ns 37.77 ns 0.53 0.15 False
MultiplyBenchmark - Duration of single invocation 153.34 ns 114.66 ns 0.75 0.08 False
MaxBenchmark - Duration of single invocation 170.79 ns 135.97 ns 0.80 0.11 False
MinBenchmark - Duration of single invocation 169.36 ns 134.86 ns 0.80 0.11 False
UnaryNegateOperatorBenchmark - Duration of single invocation 141.21 ns 102.94 ns 0.73 0.13 False
SubtractionOperatorBenchmark - Duration of single invocation 147.67 ns 110.87 ns 0.75 0.09 False
OnesComplementBenchmark - Duration of single invocation 64.26 ns 29.44 ns 0.46 0.08 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 74.27 ns 37.34 ns 0.50 0.11 False
NegateBenchmark - Duration of single invocation 144.04 ns 109.93 ns 0.76 0.07 False
DivisionOperatorBenchmark - Duration of single invocation 150.12 ns 119.48 ns 0.80 0.13 False
GreaterThanOrEqualBenchmark - Duration of single invocation 165.86 ns 126.76 ns 0.76 0.06 False
EqualsStaticBenchmark - Duration of single invocation 157.54 ns 121.79 ns 0.77 0.08 False
DivideBenchmark - Duration of single invocation 154.11 ns 122.25 ns 0.79 0.13 False
BitwiseOrBenchmark - Duration of single invocation 72.32 ns 37.13 ns 0.51 0.05 False
LessThanBenchmark - Duration of single invocation 157.05 ns 121.68 ns 0.77 0.06 False
OnesComplementOperatorBenchmark - Duration of single invocation 65.15 ns 28.95 ns 0.44 0.05 False
GreaterThanBenchmark - Duration of single invocation 158.54 ns 119.77 ns 0.76 0.08 False
SquareRootBenchmark - Duration of single invocation 147.49 ns 112.09 ns 0.76 0.14 False
XorBenchmark - Duration of single invocation 72.82 ns 37.24 ns 0.51 0.11 False
BitwiseOrOperatorBenchmark - Duration of single invocation 72.48 ns 38.08 ns 0.53 0.18 False
AddOperatorBenchmark - Duration of single invocation 155.02 ns 111.53 ns 0.72 0.12 False
AbsBenchmark - Duration of single invocation 52.34 ns 20.26 ns 0.39 0.09 False
ConditionalSelectBenchmark - Duration of single invocation 101.60 ns 64.91 ns 0.64 0.08 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.67 ns 37.78 ns 0.52 0.18 False
SubtractBenchmark - Duration of single invocation 157.99 ns 113.28 ns 0.72 0.10 False
LessThanOrEqualBenchmark - Duration of single invocation 160.22 ns 125.04 ns 0.78 0.06 False
AllBitsSetBenchmark - Duration of single invocation 51.24 ns 14.92 ns 0.29 0.15 False
MultiplyOperatorBenchmark - Duration of single invocation 150.83 ns 117.19 ns 0.78 0.15 False
AddBenchmark - Duration of single invocation 153.41 ns 119.77 ns 0.78 0.16 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AndNotBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 40.10897850890732 < 70.40927136272404.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 124.60516557919254 (T) = (0 -39.33812771611544) / Math.Sqrt((1.7234756781117555 / (89)) + (0.5748540771089432 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4675476627848413 = (73.88103115832374 - 39.33812771611544) / 73.88103115832374 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.77403710117769 < 68.54844818097506.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 90.88737654507322 (T) = (0 -36.992363627794774) / Math.Sqrt((11.98150167551841 / (89)) + (0.1819431201306652 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48991526077163444 = (72.52199641133205 - 36.992363627794774) / 72.52199641133205 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 114.65830378520124 < 146.1405872348746.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.92946938581007 (T) = (0 -113.32160804895724) / Math.Sqrt((14.174966891421143 / (88)) + (1.0180278583153743 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.26067739113395805 = (153.2776174974111 - 113.32160804895724) / 153.2776174974111 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 135.968054192831 < 162.1809546136961.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 14.764903924827435 (T) = (0 -136.3467690391895) / Math.Sqrt((19.025430831285394 / (89)) + (56.679698373480264 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.20800018402801723 = (172.1550514148261 - 136.3467690391895) / 172.1550514148261 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 134.856507545253 < 160.38613936458162.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 38.054705636909546 (T) = (0 -135.04981032841914) / Math.Sqrt((13.099179173021009 / (89)) + (6.5930306121603115 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.20194953219788833 = (169.22464903799383 - 135.04981032841914) / 169.22464903799383 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 102.94092204941997 < 135.01684235269582.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 55.608862234521375 (T) = (0 -103.60233507409775) / Math.Sqrt((16.371280876223153 / (89)) + (2.7863866796925523 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.26743430627143505 = (141.42395140944885 - 103.60233507409775) / 141.42395140944885 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 110.87013464865662 < 141.75516730588154.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 63.71892064572989 (T) = (0 -109.75932100755881) / Math.Sqrt((30.542073139072162 / (89)) + (0.34131998154386384 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2628585091324578 = (148.89857967211017 - 109.75932100755881) / 148.89857967211017 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.435901919551664 < 59.936688129258734.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 178.2617161779924 (T) = (0 -28.96704678530038) / Math.Sqrt((2.6562982876337426 / (89)) + (0.0715945583090432 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5420875744619071 = (63.25892281970992 - 28.96704678530038) / 63.25892281970992 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.33803789563292 < 69.41594913473013.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 134.7536801985324 (T) = (0 -36.98986511859068) / Math.Sqrt((2.8011006231844138 / (89)) + (0.3824141445169794 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4902839146181302 = (72.56954641892175 - 36.98986511859068) / 72.56954641892175 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 109.93347302189085 < 137.3589435873084.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 70.48907932342571 (T) = (0 -106.9096101565871) / Math.Sqrt((9.74020170273934 / (89)) + (1.5795310834131362 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2542556224464502 = (143.35959260907768 - 106.9096101565871) / 143.35959260907768 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.4760649586688 < 143.65262586777135.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 50.65954234746676 (T) = (0 -119.97399104196806) / Math.Sqrt((16.17406601952169 / (89)) + (2.460543785682364 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21640950180679175 = (153.10802175192575 - 119.97399104196806) / 153.10802175192575 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 126.758929303264 < 151.86281174828895.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 49.59337342381531 (T) = (0 -122.20049411804189) / Math.Sqrt((13.4705269981075 / (89)) + (4.000016696758468 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23156537827081147 = (159.02523215710568 - 122.20049411804189) / 159.02523215710568 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 121.78534059318733 < 150.35553682500083.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 45.720442515649545 (T) = (0 -120.81473192449441) / Math.Sqrt((11.338844190325846 / (89)) + (5.205319032380719 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23349233755344728 = (157.6171222331631 - 120.81473192449441) / 157.6171222331631 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 122.25287511044839 < 146.65288727943792.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.24900338599547 (T) = (0 -122.43508995500277) / Math.Sqrt((13.475831737261442 / (89)) + (0.39759147465349437 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21621943727195173 = (156.21092915197056 - 122.43508995500277) / 156.21092915197056 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.133946781476794 < 68.95907382167172.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 143.96674907592632 (T) = (0 -37.36603533981901) / Math.Sqrt((1.5964481949663645 / (89)) + (0.4070673607838246 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48267899624357713 = (72.22988254583329 - 37.36603533981901) / 72.22988254583329 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 121.6783921601345 < 149.4010076613014.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 79.00722892559385 (T) = (0 -118.65760035978208) / Math.Sqrt((9.965426889213338 / (89)) + (1.2086145931879513 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2431621425975454 = (156.78074134270605 - 118.65760035978208) / 156.78074134270605 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 28.94579340569447 < 60.535468775162435.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 79.46466644419344 (T) = (0 -28.430843724250547) / Math.Sqrt((3.469555547666999 / (89)) + (1.5305405337213 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.550528532423328 = (63.25394552302864 - 28.430843724250547) / 63.25394552302864 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.77029849534041 < 150.9563453196841.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 53.091516204274726 (T) = (0 -117.4772497543843) / Math.Sqrt((19.724799727154522 / (89)) + (3.5858590997233555 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25608684789933733 = (157.91796316902307 - 117.4772497543843) / 157.91796316902307 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 112.09174391758452 < 140.1448679125674.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 50.66285978387925 (T) = (0 -112.70560414997303) / Math.Sqrt((9.2538373136977 / (89)) + (3.711489504354004 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23655233625431946 = (147.62715180371222 - 112.70560414997303) / 147.62715180371222 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.23571024237137 < 69.23387349431704.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 111.28794575821874 (T) = (0 -36.87792861430179) / Math.Sqrt((5.3016797848436035 / (89)) + (0.4554119357074954 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49453441308947255 = (72.95833696553818 - 36.87792861430179) / 72.95833696553818 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.08264177676521 < 68.23525729284074.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 47.357245250413825 (T) = (0 -38.3792462655582) / Math.Sqrt((4.316808350225959 / (89)) + (4.6021252725710005 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4681109126761146 = (72.15648371102559 - 38.3792462655582) / 72.15648371102559 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 111.52956471132289 < 143.8164440699664.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 24.355656914200225 (T) = (0 -111.5991397121692) / Math.Sqrt((13.72968505948412 / (89)) + (22.32248086300429 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25213981331834096 = (149.22460334109684 - 111.5991397121692) / 149.22460334109684 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.25533546914995 < 50.16365062310949.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 145.16656645944894 (T) = (0 -18.52818161146704) / Math.Sqrt((1.0365783805207736 / (89)) + (0.448253226507349 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6505792057347716 = (53.02541209783639 - 18.52818161146704) / 53.02541209783639 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 64.91359098336775 < 96.47738668318007.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 75.59156268441237 (T) = (0 -64.04288308617575) / Math.Sqrt((5.676180387186396 / (89)) + (1.7387193969922237 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.36524100772900703 = (100.89322698217782 - 64.04288308617575) / 100.89322698217782 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.78433531676707 < 68.70438435534862.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 104.5008471319255 (T) = (0 -36.820707971443724) / Math.Sqrt((8.334575357619379 / (88)) + (0.20586699846429626 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.49075511282636475 = (72.30452165323186 - 36.820707971443724) / 72.30452165323186 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 113.28028189223852 < 143.77022180022396.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 87.13872398479528 (T) = (0 -112.5784238785764) / Math.Sqrt((15.207758134014512 / (89)) + (0.3034955215288746 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25772649106630696 = (151.66703718188734 - 112.5784238785764) / 151.66703718188734 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 125.03815282765781 < 152.58649668045834.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 55.83632377655027 (T) = (0 -123.76258528127482) / Math.Sqrt((11.367414248758735 / (88)) + (3.0677027459598256 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.22951362617294313 = (160.6291681273192 - 123.76258528127482) / 160.6291681273192 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.91943024512728 < 48.65900365089573.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 92.61720606036405 (T) = (0 -15.762144192892993) / Math.Sqrt((1.661026488933626 / (88)) + (1.2484076295297126 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.6901682403215168 = (50.87323587888341 - 15.762144192892993) / 50.87323587888341 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 117.18593371530082 < 144.43248197712413.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 39.82911670951627 (T) = (0 -110.52498327231463) / Math.Sqrt((22.860015775671616 / (89)) + (7.839427732517145 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.26881363471351416 = (151.15843035312875 - 110.52498327231463) / 151.15843035312875 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.77476341782602 < 145.6824495896394.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 33.764385289518046 (T) = (0 -114.00652528153834) / Math.Sqrt((18.765738171333723 / (89)) + (10.99505921582133 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2531845646771375 = (152.65689471489185 - 114.00652528153834) / 152.65689471489185 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SquareRootBenchmark - Duration of single invocation 140.50 ns 104.24 ns 0.74 0.12 False
GreaterThanOrEqualBenchmark - Duration of single invocation 159.69 ns 124.72 ns 0.78 0.12 False
UnaryNegateOperatorBenchmark - Duration of single invocation 149.60 ns 102.57 ns 0.69 0.13 False
AddBenchmark - Duration of single invocation 153.22 ns 119.77 ns 0.78 0.15 False
DivisionOperatorBenchmark - Duration of single invocation 158.31 ns 120.47 ns 0.76 0.16 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 72.89 ns 37.08 ns 0.51 0.10 False
AddOperatorBenchmark - Duration of single invocation 150.32 ns 111.18 ns 0.74 0.16 False
EqualsStaticBenchmark - Duration of single invocation 158.93 ns 125.68 ns 0.79 0.13 False
AndNotBenchmark - Duration of single invocation 74.31 ns 40.02 ns 0.54 0.09 False
ConditionalSelectBenchmark - Duration of single invocation 102.22 ns 65.35 ns 0.64 0.04 False
SubtractBenchmark - Duration of single invocation 151.14 ns 113.56 ns 0.75 0.14 False
BitwiseOrOperatorBenchmark - Duration of single invocation 70.39 ns 37.83 ns 0.54 0.13 False
MaxBenchmark - Duration of single invocation 173.26 ns 135.38 ns 0.78 0.11 False
XorBenchmark - Duration of single invocation 73.10 ns 36.65 ns 0.50 0.12 False
BitwiseAndBenchmark - Duration of single invocation 72.44 ns 37.25 ns 0.51 0.14 False
BitwiseAndOperatorBenchmark - Duration of single invocation 73.22 ns 37.20 ns 0.51 0.12 False
DivideBenchmark - Duration of single invocation 159.90 ns 122.10 ns 0.76 0.12 False
AbsBenchmark - Duration of single invocation 138.85 ns 101.51 ns 0.73 0.09 False
MinBenchmark - Duration of single invocation 190.15 ns 140.00 ns 0.74 0.13 False
OnesComplementBenchmark - Duration of single invocation 63.83 ns 29.35 ns 0.46 0.07 False
LessThanBenchmark - Duration of single invocation 158.93 ns 121.57 ns 0.76 0.09 False
AllBitsSetBenchmark - Duration of single invocation 48.55 ns 15.17 ns 0.31 0.20 False
OnesComplementOperatorBenchmark - Duration of single invocation 63.32 ns 29.44 ns 0.46 0.09 False
MultiplyBenchmark - Duration of single invocation 153.42 ns 114.64 ns 0.75 0.14 False
MultiplyOperatorBenchmark - Duration of single invocation 151.70 ns 111.74 ns 0.74 0.13 False
SubtractionOperatorBenchmark - Duration of single invocation 149.13 ns 110.90 ns 0.74 0.09 False
GreaterThanBenchmark - Duration of single invocation 158.29 ns 119.84 ns 0.76 0.19 False
BitwiseOrBenchmark - Duration of single invocation 72.11 ns 37.47 ns 0.52 0.12 False
NegateBenchmark - Duration of single invocation 143.66 ns 105.30 ns 0.73 0.06 False
LessThanOrEqualBenchmark - Duration of single invocation 160.28 ns 124.04 ns 0.77 0.16 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SquareRootBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 104.23726204605802 < 133.57243962795494.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 52.31298247490854 (T) = (0 -104.82905146809298) / Math.Sqrt((14.290050167154872 / (89)) + (3.1418319100247167 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25586461702867175 = (140.87362846463662 - 104.82905146809298) / 140.87362846463662 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 124.71863919964662 < 151.33576372544627.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 50.373544615283315 (T) = (0 -122.55492953252576) / Math.Sqrt((16.082277174866807 / (89)) + (3.261335571897148 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22637755277144145 = (158.41697713344428 - 122.55492953252576) / 158.41697713344428 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 102.56942998537245 < 136.18303998559603.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 73.02273610080259 (T) = (0 -103.44202546999081) / Math.Sqrt((15.207075330637956 / (89)) + (1.039019811810615 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.27009225508347007 = (141.71931479069335 - 103.44202546999081) / 141.71931479069335 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.7745775046042 < 145.58010427306405.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 33.89940695056827 (T) = (0 -114.29043944995206) / Math.Sqrt((14.620248596044554 / (89)) + (11.252070280257215 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25195246537823857 = (152.78499581947187 - 114.29043944995206) / 152.78499581947187 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 120.47469873759363 < 150.17968975666923.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 62.206999247558485 (T) = (0 -119.79659338703202) / Math.Sqrt((20.660617052940225 / (89)) + (1.2490746615948416 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23680644953691718 = (156.9675127814472 - 119.79659338703202) / 156.9675127814472 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.07572548865272 < 69.33355883540467.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 124.04891423618659 (T) = (0 -36.9336477902805) / Math.Sqrt((6.168681556150451 / (89)) + (0.13614287172802852 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4916621518135539 = (72.65571100410003 - 36.9336477902805) / 72.65571100410003 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 111.17679518323423 < 142.93005048075102.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.978553045385134 (T) = (0 -110.79985976218441) / Math.Sqrt((18.606327276561885 / (89)) + (4.843469395882773 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.26093711910055556 = (149.91939471691535 - 110.79985976218441) / 149.91939471691535 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 125.68475435818054 < 150.09672842677142.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 49.07726760963024 (T) = (0 -119.89313822943018) / Math.Sqrt((10.189519744149608 / (89)) + (4.688414485880689 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23817600751748433 = (157.37642738021512 - 119.89313822943018) / 157.37642738021512 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 40.02083014327468 < 70.53179237136169.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 157.29995474713812 (T) = (0 -39.052641626276774) / Math.Sqrt((2.4752852086666755 / (89)) + (0.20950779483894774 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4707464471708792 = (73.7881520445563 - 39.052641626276774) / 73.7881520445563 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.35176139041855 < 96.55571221906953.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 73.1171772011645 (T) = (0 -64.2212257403859) / Math.Sqrt((4.492929193854966 / (89)) + (1.999880122470878 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.36297434038366916 = (100.81418977544044 - 64.2212257403859) / 100.81418977544044 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 113.56014751229215 < 143.64676795331042.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 70.50953034423507 (T) = (0 -113.25951752891459) / Math.Sqrt((15.012081875521677 / (89)) + (1.1953177064559428 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25049531786543244 = (151.1124883254295 - 113.25951752891459) / 151.1124883254295 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.829744894829005 < 68.60363397888379.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 164.6430265963965 (T) = (0 -37.29797654837465) / Math.Sqrt((3.439410101834071 / (89)) + (0.06544218694770915 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.484103569121759 = (72.29741148796106 - 37.29797654837465) / 72.29741148796106 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 135.38005706737974 < 164.0154422793253.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 31.920012125151107 (T) = (0 -134.445422928488) / Math.Sqrt((14.295675069963897 / (89)) + (13.08045460711366 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2234373563512233 = (173.12888281205412 - 134.445422928488) / 173.12888281205412 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 36.65242099206575 < 69.38958351347482.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 81.1855558804145 (T) = (0 -37.07809444130335) / Math.Sqrt((8.942213923570698 / (89)) + (0.9655252486589405 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4928763165000507 = (73.11449977135027 - 37.07809444130335) / 73.11449977135027 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.25351281618735 < 68.60238271890034.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 108.97469508004049 (T) = (0 -37.18939229832193) / Math.Sqrt((5.767033064869569 / (89)) + (0.41323371265760706 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48837879443047183 = (72.68930977347453 - 37.18939229832193) / 72.68930977347453 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.202684296437475 < 68.63339756595681.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 111.17248256498993 (T) = (0 -36.82734420895092) / Math.Sqrt((8.697205157061383 / (88)) + (0.04275126989069381 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.492212703398957 = (72.52513888287625 - 36.82734420895092) / 72.52513888287625 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 122.10076360293985 < 151.6483800974966.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 66.11196880269969 (T) = (0 -122.42089319331714) / Math.Sqrt((21.65513195215308 / (89)) + (0.6876978628376367 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23176821478231438 = (159.35411102344332 - 122.42089319331714) / 159.35411102344332 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 101.51177691222648 < 130.82065911850023.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 61.91081290440475 (T) = (0 -97.5473058367351) / Math.Sqrt((17.6012951699276 / (89)) + (2.0746937776061745 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.28776074042898064 = (136.9586196294314 - 97.5473058367351) / 136.9586196294314 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 139.99530994438993 < 161.38119415337113.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 47.15875379007058 (T) = (0 -134.79415130194732) / Math.Sqrt((17.515848669742983 / (89)) + (3.5944633554016656 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2069359562112333 = (169.9662875371133 - 134.79415130194732) / 169.9662875371133 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.34877177599823 < 60.02721972478479.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 189.43086391590575 (T) = (0 -28.841777761933336) / Math.Sqrt((2.2169611779072427 / (89)) + (0.07533221801901518 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5419169622127701 = (62.96189857029752 - 28.841777761933336) / 62.96189857029752 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 121.57151882184027 < 149.54374631960806.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 60.89878247297263 (T) = (0 -119.17902639276824) / Math.Sqrt((11.79676529840921 / (89)) + (2.4559806504528376 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.239094359105271 = (156.62786551645056 - 119.17902639276824) / 156.62786551645056 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.17361414822887 < 48.7388593426221.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 85.06918768704695 (T) = (0 -15.914790593676486) / Math.Sqrt((3.0812911740845044 / (88)) + (1.3340508421726731 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.6868789165247525 = (50.82631427127956 - 15.914790593676486) / 50.82631427127956 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.44437347653583 < 59.92677931544171.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 191.64056634975913 (T) = (0 -28.783644985062086) / Math.Sqrt((2.2619786737257987 / (89)) + (0.0685734611205295 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5446431816970957 = (63.21118698153577 - 28.783644985062086) / 63.21118698153577 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 114.63621317659269 < 146.4091315303378.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.22839040816929 (T) = (0 -112.6882032637753) / Math.Sqrt((16.45323367072233 / (88)) + (0.8972294814560774 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.2649721557253431 = (153.31147539720584 - 112.6882032637753) / 153.31147539720584 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 111.73551090446004 < 143.82716314895788.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 60.09721893428373 (T) = (0 -110.9236516904584) / Math.Sqrt((20.745268800182554 / (89)) + (2.075321034934211 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2645097608321306 = (150.81593987699546 - 110.9236516904584) / 150.81593987699546 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 110.90298801518863 < 141.41228269752742.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 84.04690493057352 (T) = (0 -109.97116780655588) / Math.Sqrt((14.160369495475832 / (89)) + (0.5129140383611096 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25956638796006093 = (148.52265755950586 - 109.97116780655588) / 148.52265755950586 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.83550997155436 < 152.88728351381366.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 74.96807608408456 (T) = (0 -117.99313341233619) / Math.Sqrt((20.156541104270936 / (89)) + (0.6843529995533124 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25652652671305143 = (158.70523650383953 - 117.99313341233619) / 158.70523650383953 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.47294596694362 < 68.72363297371831.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 71.93351242649145 (T) = (0 -37.63150196636701) / Math.Sqrt((3.3468515067290983 / (89)) + (1.9403840455132841 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47916777303352664 = (72.2526372562376 - 37.63150196636701) / 72.2526372562376 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 105.30290512190278 < 136.45090934265846.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 76.1670326566896 (T) = (0 -106.49659273310472) / Math.Sqrt((11.82731883240197 / (89)) + (0.992456989156087 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.25627920094133555 = (143.19431817410327 - 106.49659273310472) / 143.19431817410327 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 124.04129934475526 < 153.07059365449322.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.723923531602036 (T) = (0 -125.26437902351333) / Math.Sqrt((21.430818023349527 / (88)) + (13.980668823186642 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.22708216563512282 = (162.0668762630451 - 125.26437902351333) / 162.0668762630451 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
MinBenchmark - Duration of single invocation 181.81 ns 144.34 ns 0.79 0.17 False
DivisionOperatorBenchmark - Duration of single invocation 152.27 ns 119.18 ns 0.78 0.23 False
NegateBenchmark - Duration of single invocation 150.52 ns 113.39 ns 0.75 0.07 False
AddBenchmark - Duration of single invocation 158.24 ns 121.92 ns 0.77 0.23 False
SquareRootBenchmark - Duration of single invocation 129.16 ns 91.89 ns 0.71 0.13 False
OnesComplementOperatorBenchmark - Duration of single invocation 64.90 ns 29.60 ns 0.46 0.13 False
AllBitsSetBenchmark - Duration of single invocation 51.09 ns 15.20 ns 0.30 0.20 False
SubtractionOperatorBenchmark - Duration of single invocation 159.92 ns 121.58 ns 0.76 0.09 False
DivideBenchmark - Duration of single invocation 157.00 ns 122.91 ns 0.78 0.18 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 71.02 ns 37.44 ns 0.53 0.10 False
MultiplyBenchmark - Duration of single invocation 158.12 ns 129.31 ns 0.82 0.23 False
MultiplyOperatorBenchmark - Duration of single invocation 157.77 ns 119.19 ns 0.76 0.14 False
OnesComplementBenchmark - Duration of single invocation 63.00 ns 29.17 ns 0.46 0.07 False
GreaterThanBenchmark - Duration of single invocation 164.55 ns 129.27 ns 0.79 0.20 False
ConditionalSelectBenchmark - Duration of single invocation 102.07 ns 65.39 ns 0.64 0.09 False
UnaryNegateOperatorBenchmark - Duration of single invocation 148.72 ns 118.42 ns 0.80 0.14 False
AddOperatorBenchmark - Duration of single invocation 161.87 ns 119.93 ns 0.74 0.18 False
AndNotBenchmark - Duration of single invocation 73.87 ns 40.02 ns 0.54 0.18 False
BitwiseAndBenchmark - Duration of single invocation 67.44 ns 37.40 ns 0.55 0.11 False
MaxBenchmark - Duration of single invocation 179.93 ns 139.52 ns 0.78 0.19 False
GreaterThanOrEqualBenchmark - Duration of single invocation 166.89 ns 129.82 ns 0.78 0.13 False
BitwiseAndOperatorBenchmark - Duration of single invocation 69.09 ns 37.91 ns 0.55 0.14 False
LessThanOrEqualBenchmark - Duration of single invocation 167.99 ns 127.47 ns 0.76 0.13 False
BitwiseOrOperatorBenchmark - Duration of single invocation 72.33 ns 38.06 ns 0.53 0.20 False
BitwiseOrBenchmark - Duration of single invocation 72.25 ns 37.54 ns 0.52 0.06 False
XorBenchmark - Duration of single invocation 79.27 ns 37.02 ns 0.47 0.11 False
EqualsStaticBenchmark - Duration of single invocation 164.30 ns 129.35 ns 0.79 0.24 False
LessThanBenchmark - Duration of single invocation 164.64 ns 131.37 ns 0.80 0.18 False
SubtractBenchmark - Duration of single invocation 156.96 ns 122.61 ns 0.78 0.17 False
AbsBenchmark - Duration of single invocation 130.58 ns 94.37 ns 0.72 0.19 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.MinBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 144.33876144471498 < 173.68063436891563.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 13.183740483040092 (T) = (0 -144.57049298934933) / Math.Sqrt((22.52661412253934 / (89)) + (75.9093949712825 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2034441935593606 = (181.4944939455701 - 144.57049298934933) / 181.4944939455701 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.17643851443525 < 145.51206699224073.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 53.93420010761051 (T) = (0 -119.53884601325599) / Math.Sqrt((38.50010612947345 / (89)) + (0.36097946710260803 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23599017265935046 = (156.46244555432548 - 119.53884601325599) / 156.46244555432548 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 113.38539396337778 < 142.6814963707343.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 29.642848294234962 (T) = (0 -116.44201217318695) / Math.Sqrt((7.829245603056188 / (89)) + (12.167415978136018 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22527576582290287 = (150.30123886194198 - 116.44201217318695) / 150.30123886194198 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 121.92070658148715 < 151.05843264367732.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.226866723628483 (T) = (0 -124.59566541290674) / Math.Sqrt((24.316900167410026 / (89)) + (22.4527135055565 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22063988794047867 = (159.8691843282212 - 124.59566541290674) / 159.8691843282212 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 91.89450003050096 < 123.02806489446668.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 60.39296907797856 (T) = (0 -92.57876923064809) / Math.Sqrt((13.751916096951403 / (89)) + (2.567030280376981 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.29494188336959487 = (131.30657891451284 - 92.57876923064809) / 131.30657891451284 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.60216098740295 < 60.074634662542785.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 136.60767455665868 (T) = (0 -29.032999407844024) / Math.Sqrt((2.8142126765452993 / (89)) + (0.3081486229790473 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5403786850662776 = (63.16721715142953 - 29.032999407844024) / 63.16721715142953 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.202879823800876 < 48.52249676684974.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 125.02179672972787 (T) = (0 -15.46583083042693) / Math.Sqrt((2.8279914449184127 / (88)) + (0.47709035118473 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.6955133250561608 = (50.79312857706996 - 15.46583083042693) / 50.79312857706996 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 121.57779058627732 < 147.4773170383645.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 54.15828201739334 (T) = (0 -120.26379309717387) / Math.Sqrt((18.11056138869945 / (89)) + (2.317273915769964 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22904135860487873 = (155.99253531881473 - 120.26379309717387) / 155.99253531881473 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 122.91380395959489 < 150.10586356954494.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 56.326226505643334 (T) = (0 -122.08082464995773) / Math.Sqrt((28.774105587344692 / (89)) + (1.1063899252363596 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23309023892998856 = (159.1853837922568 - 122.08082464995773) / 159.1853837922568 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.44127499615601 < 69.168600523937.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 110.43290321450444 (T) = (0 -37.428142303536006) / Math.Sqrt((5.338872756936283 / (89)) + (0.4320246980204531 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48660136414836236 = (72.90269137830748 - 37.428142303536006) / 72.90269137830748 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 129.31419802816657 < 151.3264301977883.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 16.420471272818315 (T) = (0 -127.54238611618072) / Math.Sqrt((29.134936781712817 / (88)) + (36.08414838189247 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.2035271156420142 = (160.13399655028937 - 127.54238611618072) / 160.13399655028937 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.18955897724902 < 149.71467834558743.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 71.17333919550515 (T) = (0 -119.81309061651037) / Math.Sqrt((19.241213624956576 / (89)) + (0.5433867753907449 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23604310495085667 = (156.83226552828364 - 119.81309061651037) / 156.83226552828364 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.17319984219218 < 59.982984619416285.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 161.9732309568767 (T) = (0 -28.819225030166006) / Math.Sqrt((3.7176314549997276 / (89)) + (0.033528756402599336 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5441889202151041 = (63.226249444761706 - 28.819225030166006) / 63.226249444761706 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 129.2733784015683 < 156.60426531170845.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 18.54573761334088 (T) = (0 -128.94433762737353) / Math.Sqrt((35.690439071923265 / (89)) + (34.58694796750174 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22031276118337328 = (165.3795665850313 - 128.94433762737353) / 165.3795665850313 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.38694685428173 < 96.86825916607783.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 70.0777528356003 (T) = (0 -64.07861298610484) / Math.Sqrt((4.869420301412445 / (89)) + (2.2118589889829554 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.36485196106688644 = (100.88768138801238 - 64.07861298610484) / 100.88768138801238 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 118.41672237879025 < 140.84571894352882.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.565365263242054 (T) = (0 -113.42681978819125) / Math.Sqrt((11.17910621013838 / (89)) + (23.10342589314209 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23693215180933197 = (148.64578563641598 - 113.42681978819125) / 148.64578563641598 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 119.93176464291908 < 153.06480760036297.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 58.769101427455574 (T) = (0 -119.92103071685862) / Math.Sqrt((24.608184751101074 / (89)) + (1.1623297239092536 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2349561221589721 = (156.75052659107428 - 119.92103071685862) / 156.75052659107428 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 40.02139652699203 < 70.59150010195319.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 12.638961512768208 (T) = (0 -41.937183519429865) / Math.Sqrt((6.463979679075547 / (89)) + (65.01664603121263 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4359033457082794 = (74.34396782956667 - 41.937183519429865) / 74.34396782956667 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.39602649785612 < 68.72553384812552.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 37.1425355798151 (T) = (0 -37.68528949541207) / Math.Sqrt((2.2651200815203243 / (89)) + (8.412483466059976 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4785035877958072 = (72.26375601728269 - 37.68528949541207) / 72.26375601728269 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.MaxBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 139.51806942501713 < 170.44052969655576.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 34.50936790502893 (T) = (0 -142.71049824404847) / Math.Sqrt((34.591722783991464 / (89)) + (8.444527054169818 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.21168274002645684 = (181.03180723055334 - 142.71049824404847) / 181.03180723055334 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 129.81525306778033 < 159.47617787878195.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 47.173148968602135 (T) = (0 -130.8671188873269) / Math.Sqrt((17.740630318684286 / (89)) + (4.421853851083716 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22403304500049082 = (168.65037621016953 - 130.8671188873269) / 168.65037621016953 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.90981761880496 < 68.84898001738347.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 73.32782746296093 (T) = (0 -37.28282132940742) / Math.Sqrt((7.6555432133085635 / (88)) + (1.4290480044679539 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.48534201030872626 = (72.44193634645048 - 37.28282132940742) / 72.44193634645048 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 127.47156030521845 < 159.27712692935552.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 64.81051412328836 (T) = (0 -129.11244003791282) / Math.Sqrt((22.304704464530573 / (88)) + (1.2145460974944824 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.23509878646080282 = (168.79622852277836 - 129.11244003791282) / 168.79622852277836 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.05815813383318 < 68.68943566580874.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 34.81677990174858 (T) = (0 -38.618152026539356) / Math.Sqrt((4.148258339910583 / (89)) + (8.532705568527074 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.46098701369044776 = (71.64605122215211 - 38.618152026539356) / 71.64605122215211 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.54289477060578 < 68.5379563161872.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 157.97180209285403 (T) = (0 -37.366008723734346) / Math.Sqrt((2.4049350645466143 / (89)) + (0.21618451803308017 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48250778915339665 = (72.20593458325597 - 37.366008723734346) / 72.20593458325597 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.015257932965504 < 69.30908846652231.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 27.65545490772949 (T) = (0 -37.915960820541784) / Math.Sqrt((8.569304948575404 / (89)) + (15.242417789104394 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48146506347249424 = (73.1213234627066 - 37.915960820541784) / 73.1213234627066 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 129.35302917878545 < 156.95938405057302.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.56435340842626 (T) = (0 -126.0072867373862) / Math.Sqrt((39.77918642922478 / (89)) + (6.87002272687062 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.23605910413597728 = (164.94376386915513 - 126.0072867373862) / 164.94376386915513 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 131.3650828151577 < 157.4606380794768.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.217259553764592 (T) = (0 -128.8001745606822) / Math.Sqrt((26.170982160784604 / (89)) + (13.489227311267433 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.2192447736315298 = (164.96869980591862 - 128.8001745606822) / 164.96869980591862 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 122.61382708281552 < 151.31062882925062.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.55119187062561 (T) = (0 -123.50812181662556) / Math.Sqrt((39.21598757424221 / (89)) + (11.65026739615593 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.22655933259087915 = (159.686614657016 - 123.50812181662556) / 159.686614657016 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 94.37490747393137 < 121.23165235278033.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 42.435390605768774 (T) = (0 -96.43491503848676) / Math.Sqrt((17.21094746042348 / (89)) + (3.641062375766286 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.24730400096566563 = (128.11934056007632 - 96.43491503848676) / 128.11934056007632 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 6, 2022 •
edited
Loading

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 042d3ee8a7f8f5d4c86f1f7814e2a6a8e7bb18b5
Compare 720ae033fa8c8b9e933f198e03c4b16e8a432387
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
MaxBenchmark - Duration of single invocation 363.66 ns 333.87 ns 0.92 0.10 False
EqualsStaticBenchmark - Duration of single invocation 355.81 ns 284.58 ns 0.80 0.14 False
ConditionalSelectBenchmark - Duration of single invocation 102.75 ns 65.37 ns 0.64 0.08 False
BitwiseAndOperatorBenchmark - Duration of single invocation 72.22 ns 37.60 ns 0.52 0.18 False
LessThanOrEqualBenchmark - Duration of single invocation 336.64 ns 313.22 ns 0.93 0.03 False
SubtractBenchmark - Duration of single invocation 290.57 ns 246.19 ns 0.85 0.07 False
DivideBenchmark - Duration of single invocation 339.06 ns 294.22 ns 0.87 0.06 False
OnesComplementOperatorBenchmark - Duration of single invocation 62.45 ns 29.53 ns 0.47 0.11 False
SubtractionOperatorBenchmark - Duration of single invocation 287.89 ns 243.14 ns 0.84 0.19 False
LessThanBenchmark - Duration of single invocation 407.88 ns 285.21 ns 0.70 0.16 False
BitwiseOrBenchmark - Duration of single invocation 69.45 ns 37.95 ns 0.55 0.12 False
AddBenchmark - Duration of single invocation 287.62 ns 240.75 ns 0.84 0.13 False
ExclusiveOrOperatorBenchmark - Duration of single invocation 73.10 ns 37.50 ns 0.51 0.08 False
GreaterThanBenchmark - Duration of single invocation 331.84 ns 295.53 ns 0.89 0.08 False
OnesComplementBenchmark - Duration of single invocation 62.37 ns 29.71 ns 0.48 0.07 False
AddOperatorBenchmark - Duration of single invocation 300.31 ns 238.03 ns 0.79 0.11 False
MultiplyBenchmark - Duration of single invocation 299.10 ns 240.38 ns 0.80 0.13 False
GreaterThanOrEqualBenchmark - Duration of single invocation 334.52 ns 291.63 ns 0.87 0.06 False
SquareRootBenchmark - Duration of single invocation 332.55 ns 287.88 ns 0.87 0.12 False
MultiplyOperatorBenchmark - Duration of single invocation 286.22 ns 239.93 ns 0.84 0.10 False
DivisionOperatorBenchmark - Duration of single invocation 334.99 ns 290.50 ns 0.87 0.06 False
BitwiseAndBenchmark - Duration of single invocation 71.76 ns 37.75 ns 0.53 0.13 False
AllBitsSetBenchmark - Duration of single invocation 51.22 ns 15.71 ns 0.31 0.10 False
MinBenchmark - Duration of single invocation 364.16 ns 318.07 ns 0.87 0.12 False
BitwiseOrOperatorBenchmark - Duration of single invocation 72.63 ns 37.71 ns 0.52 0.10 False
UnaryNegateOperatorBenchmark - Duration of single invocation 276.77 ns 234.93 ns 0.85 0.17 False
AndNotBenchmark - Duration of single invocation 73.94 ns 39.64 ns 0.54 0.08 False
NegateBenchmark - Duration of single invocation 281.69 ns 238.09 ns 0.85 0.13 False
AbsBenchmark - Duration of single invocation 298.94 ns 263.01 ns 0.88 0.03 False
XorBenchmark - Duration of single invocation 72.78 ns 37.05 ns 0.51 0.08 False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MaxBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 333.86596144693 < 349.5347326663934.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 26.38671480525682 (T) = (0 -334.31848324878285) / Math.Sqrt((92.85341790322424 / (89)) + (5.481543524049561 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.09055226950748682 = (367.6060448990642 - 334.31848324878285) / 367.6060448990642 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 284.57946335732515 < 310.0194894529977.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 25.003857441506916 (T) = (0 -285.64299475157816) / Math.Sqrt((230.90972669484617 / (89)) + (3.4892962986683136 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1305702199921377 = (328.54061514777544 - 285.64299475157816) / 328.54061514777544 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.ConditionalSelectBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.36531791263678 < 96.99814696032708.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 129.7851520073885 (T) = (0 -64.86727933214095) / Math.Sqrt((5.156558139345206 / (89)) + (0.19077121252924056 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.35701717717429415 = (100.88493351512845 - 64.86727933214095) / 100.88493351512845 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.60454408143924 < 68.85018233470528.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 106.9434583027548 (T) = (0 -36.89131350339305) / Math.Sqrt((8.280561478711324 / (89)) + (0.1734924327451093 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49061433613282174 = (72.42314835348884 - 36.89131350339305) / 72.42314835348884 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 313.2246297480629 < 319.95809962828554.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 38.64591143310736 (T) = (0 -313.3719731395746) / Math.Sqrt((23.878364112181718 / (89)) + (1.1896059193099888 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.07127391001327608 = (337.4213091656058 - 313.3719731395746) / 337.4213091656058 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.SubtractBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 246.18788747656916 < 276.08365311664.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 34.95123401857823 (T) = (0 -245.41746237371885) / Math.Sqrt((50.683521431155434 / (89)) + (10.24478806546622 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1524003797070572 = (289.5440919250282 - 245.41746237371885) / 289.5440919250282 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 294.21568126686384 < 321.3392658780481.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.29418767644744 (T) = (0 -294.7718511550631) / Math.Sqrt((42.92597052404619 / (89)) + (17.33010015590368 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.12500703065814434 = (336.884822488096 - 294.7718511550631) / 336.884822488096 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.53478643932727 < 59.83027127339271.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 153.39830113058696 (T) = (0 -28.839952987702475) / Math.Sqrt((3.3901393849874193 / (89)) + (0.12103050753363975 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5437258336640989 = (63.20750793169167 - 28.839952987702475) / 63.20750793169167 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 243.1374534566467 < 274.8322967042856.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 22.605602493899372 (T) = (0 -243.96660083034755) / Math.Sqrt((63.89446688740409 / (89)) + (30.185217276953008 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.15190113837544814 = (287.6629268939522 - 243.96660083034755) / 287.6629268939522 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.LessThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 285.2126703727665 < 311.18847898969625.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.162124204260063 (T) = (0 -286.1842781572203) / Math.Sqrt((129.23966058280007 / (89)) + (5.952176138122419 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.12342536960824445 = (326.4802199777558 - 286.1842781572203) / 326.4802199777558 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.BitwiseOrBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.947318172564465 < 68.48026394095675.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 154.37942838570532 (T) = (0 -37.27509525968873) / Math.Sqrt((3.4624636099765613 / (89)) + (0.11534880968284576 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.48190599155342534 = (71.94658624108081 - 37.27509525968873) / 71.94658624108081 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.AddBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 240.75272326960174 < 273.0811271657912.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 15.748463698929584 (T) = (0 -242.09440948651098) / Math.Sqrt((56.73155659150063 / (89)) + (66.33027286420742 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.14922719977872004 = (284.5582386079385 - 242.09440948651098) / 284.5582386079385 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.498557111672035 < 69.54641040765071.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.17772389618339 (T) = (0 -38.264241633076786) / Math.Sqrt((1.8138667408062943 / (89)) + (14.753719149166734 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47385651497568276 = (72.7258679850579 - 38.264241633076786) / 72.7258679850579 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 295.5329519599982 < 316.30708188758996.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 17.471849659638476 (T) = (0 -294.4550426890623) / Math.Sqrt((393.5484507741942 / (89)) + (2.8383268090700025 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.11403769298773533 = (332.3561740251169 - 294.4550426890623) / 332.3561740251169 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.OnesComplementBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.71237439595241 < 59.72406507799794.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 139.47515159231259 (T) = (0 -28.854390705972275) / Math.Sqrt((2.211699165679408 / (89)) + (0.35211459082677393 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.5422578087185659 = (63.03633629488111 - 28.854390705972275) / 63.03633629488111 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 238.02951711971073 < 271.7516805422194.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.756989812953705 (T) = (0 -237.35205177053498) / Math.Sqrt((54.961749263713806 / (88)) + (18.03728876422291 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.15881533411542895 = (282.16402580394265 - 237.35205177053498) / 282.16402580394265 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 240.37604567018514 < 274.8770498826547.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 61.543030718790135 (T) = (0 -238.17056152476235) / Math.Sqrt((47.089623588526436 / (89)) + (0.6957388535301811 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.16662024721073324 = (285.78875443952325 - 238.17056152476235) / 285.78875443952325 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 291.63489118564394 < 318.8235671976979.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 42.98714192918847 (T) = (0 -291.2670290299387) / Math.Sqrt((71.33399127486342 / (88)) + (0.5520509961993189 / (10))) is greater than 1.9849843115220658 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (88) + (10) - 2, .975) and 0.12074656478477679 = (331.2662963422401 - 291.2670290299387) / 331.2662963422401 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 287.88100497611214 < 315.6013743924962.
IsChangePoint: Marked as a change because one of 12/3/2022 7:24:45 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 12.150795724002796 (T) = (0 -297.230355238438) / Math.Sqrt((387.2718217830573 / (90)) + (44.17000255603779 / (9))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (90) + (9) - 2, .975) and 0.11037419906820067 = (334.10716609963106 - 297.230355238438) / 334.10716609963106 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 239.92872882619184 < 271.47019149493366.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 32.96768861950882 (T) = (0 -237.15144199001696) / Math.Sqrt((64.82014348688041 / (89)) + (12.208390188198173 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.16253679110883332 = (283.1783408181173 - 237.15144199001696) / 283.1783408181173 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 290.49822618473894 < 318.71091246164843.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 46.67226856867549 (T) = (0 -291.26156876954303) / Math.Sqrt((46.12410877257802 / (89)) + (3.6480940487123186 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.13087391154133854 = (335.12003912582634 - 291.26156876954303) / 335.12003912582634 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.BitwiseAndBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.75080707971505 < 68.60039708280019.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 136.37031359579447 (T) = (0 -36.966706977505176) / Math.Sqrt((2.71786179735759 / (89)) + (0.3645773956235355 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.4884499461058668 = (72.26410533260454 - 36.966706977505176) / 72.26410533260454 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.AllBitsSetBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.708875132013528 < 48.520031501700515.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 258.500223270005 (T) = (0 -15.212087627273572) / Math.Sqrt((1.3402942966778892 / (89)) + (0.037337295286958457 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.6996594133532986 = (50.649456995194434 - 15.212087627273572) / 50.649456995194434 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.MinBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 318.07347174471664 < 345.37247297385704.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 41.064051831729614 (T) = (0 -317.91675429645477) / Math.Sqrt((78.42345570243077 / (89)) + (2.714808924412338 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.1217857146157088 = (362.00362438574996 - 317.91675429645477) / 362.00362438574996 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.71083433999001 < 68.51397036340877.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.7099528784785 (T) = (0 -39.18594782824493) / Math.Sqrt((1.5853819464965766 / (89)) + (13.012187089501323 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.456950528089198 = (72.15907547127009 - 39.18594782824493) / 72.15907547127009 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 234.93405195592786 < 266.009346988405.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 28.211974492279094 (T) = (0 -233.90361422211578) / Math.Sqrt((73.23297107903608 / (89)) + (16.268370841586666 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.15879998337838738 = (278.05945030946185 - 233.90361422211578) / 278.05945030946185 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.AndNotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.636399507665445 < 70.4300047800166.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 114.73980851217418 (T) = (0 -38.94422519645571) / Math.Sqrt((5.160701741263225 / (89)) + (0.3539005624414265 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.47376741527260824 = (74.00572736602824 - 38.94422519645571) / 74.00572736602824 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 238.09180662315114 < 272.5788480777091.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.778748443215974 (T) = (0 -235.50150409100715) / Math.Sqrt((116.26107728943317 / (89)) + (1.9766173117537673 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.16073839307002172 = (280.60559680845216 - 235.50150409100715) / 280.60559680845216 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.AbsBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 263.012795389809 < 283.56353658134003.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 36.4922150082615 (T) = (0 -262.6491134052993) / Math.Sqrt((23.537403843370406 / (89)) + (7.123018026941176 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.12073655901136056 = (298.7149256541111 - 262.6491134052993) / 298.7149256541111 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.XorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 37.05298934419869 < 69.21302000058083.
IsChangePoint: Marked as a change because one of 12/3/2022 2:55:34 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 175.3739921345819 (T) = (0 -36.891506046885404) / Math.Sqrt((2.0425247668718463 / (89)) + (0.18721281779284998 / (10))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (89) + (10) - 2, .975) and 0.49249169360450107 = (72.69143299131743 - 36.891506046885404) / 72.69143299131743 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@lewing
Copy link
Member

lewing commented Dec 6, 2022

this is from dotnet/runtime#79165 and also improved the wasm case here #10471

@kotlarmilos kotlarmilos mentioned this issue Apr 4, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-x64 branch-refs/heads/main kind-micro_mono mono-interpreter os-linux perf-improvement runtime-mono untriaged
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lewing @kotlarmilos