[Perf] Linux/x64: 2 Regressions on 9/17/2023 8:50:51 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f5cff047f77be26cfbbd9126e9e0d1242baac24d
Compare	51a694bfb475dd14992d050bab99888ce2514a38
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.MemoryMarshal<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
GetReference - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	3.82 ns	5.16 ns	1.35	0.83	False
AsBytes - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	5.84 ns	9.37 ns	1.60	0.82	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.MemoryMarshal<Int32>*'

Payloads

Baseline
Compare

System.Memory.MemoryMarshal<Int32>.GetReference

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.155808795688205 > 4.028221282641894.
IsChangePoint: Marked as a change because one of 9/17/2023 1:05:21 AM, 9/18/2023 8:11:22 PM falls between 9/9/2023 9:29:58 PM and 9/18/2023 8:11:22 PM.
IsRegressionStdDev: Marked as regression because -2.135675917559112 (T) = (0 -6.857346627454464) / Math.Sqrt((0.8684684142797608 / (34)) + (4.719320687934903 / (4))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (34) + (4) - 2, .025) and -0.5196003356541974 = (4.512598784404936 - 6.857346627454464) / 4.512598784404936 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Memory.MemoryMarshal<Int32>.AsBytes

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.367972414495709 > 5.496447463259152.
IsChangePoint: Marked as a change because one of 9/16/2023 7:32:07 PM, 9/18/2023 8:11:22 PM falls between 9/9/2023 9:29:58 PM and 9/18/2023 8:11:22 PM.
IsRegressionStdDev: Marked as regression because -7.481101702480518 (T) = (0 -9.711259243669335) / Math.Sqrt((1.756484623063516 / (31)) + (0.6358380020965834 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.5569365951691371 = (6.2374147244026705 - 9.711259243669335) / 6.2374147244026705 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository