[Perf] Linux/x64: 8 Improvements on 10/18/2022 8:25:03 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	e8fa4a736d6bdcfbbe2c2dc1dd1303214bb97085
Compare	51e3afb2ba42609c3711cb50fb5eaa6800bc1fde
Diff	Diff

Improvements in System.IO.Tests.Perf_File

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadAllBytes - Duration of single invocation	5.75 μs	3.96 μs	0.69	0.36	False
ReadAllBytesAsync - Duration of single invocation	8.99 μs	7.53 μs	0.84	0.21	False
ReadAllBytesAsync - Duration of single invocation	7.39 μs	5.39 μs	0.73	0.34	False
CopyTo - Duration of single invocation	25.71 μs	20.06 μs	0.78	0.03	False
ReadAllBytes - Duration of single invocation	6.39 μs	5.16 μs	0.81	0.33	False
CopyTo - Duration of single invocation	26.26 μs	19.61 μs	0.75	0.03	False
ReadAllBytesAsync - Duration of single invocation	7.72 μs	6.30 μs	0.82	0.29	False
ReadAllBytes - Duration of single invocation	5.45 μs	3.66 μs	0.67	0.41	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_File*'

Related Issues

Regressions

• [Perf] Windows/x64: 4 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Windows/x86: 2 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Linux/arm64: 2 Regressions on 10/18/2022 8:25:03 PM

Improvements

• [Perf] Linux/arm64: 3 Improvements on 10/18/2022 8:25:03 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.IO.Tests.Perf_File.ReadAllBytes(size: 4096)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.9641580348048304 < 5.31154459921412.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 11.160653341691791 (T) = (0 -3997.827685038552) / Math.Sqrt((470373.84838048765 / (299)) + (14542.930564234615 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.11529343677965628 = (4518.817708875591 - 3997.827685038552) / 4518.817708875591 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytesAsync(size: 16384)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.528401546596692 < 8.578107986325465.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 10.447836650748377 (T) = (0 -7646.801850122375) / Math.Sqrt((508898.1630935424 / (299)) + (27499.640905844954 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.06795765239127675 = (8204.350231232784 - 7646.801850122375) / 8204.350231232784 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytesAsync(size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.392882124024402 < 6.766491982714017.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 8.130755409072076 (T) = (0 -5537.762637401539) / Math.Sqrt((512975.68082424096 / (299)) + (46465.46372086982 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.0814940675620888 = (6029.09838884016 - 5537.762637401539) / 6029.09838884016 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.CopyTo(size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.060717423036095 < 24.527188343990645.
IsChangePoint: Marked as a change because one of 8/9/2022 6:41:10 AM, 8/17/2022 1:34:50 AM, 9/26/2022 4:08:25 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 13.4626613884591 (T) = (0 -20070.314384331083) / Math.Sqrt((7891347.508931581 / (299)) + (35027.209736055054 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.10067488561182544 = (22317.08429268679 - 20070.314384331083) / 22317.08429268679 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytes(size: 16384)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.160671528988409 < 6.154194777028057.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 10.558078893971972 (T) = (0 -4894.3606000007685) / Math.Sqrt((470325.2112008828 / (299)) + (22598.96996243115 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.0976150482884022 = (5423.805650479205 - 4894.3606000007685) / 5423.805650479205 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.CopyTo(size: 4096)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 19.606851928929466 < 24.77421653763194.
IsChangePoint: Marked as a change because one of 8/9/2022 6:41:10 AM, 8/17/2022 1:34:50 AM, 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 13.245398971318034 (T) = (0 -20149.15038783915) / Math.Sqrt((7821100.353548732 / (299)) + (77018.6108268583 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.1012456566313076 = (22418.97414627953 - 20149.15038783915) / 22418.97414627953 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytesAsync(size: 4096)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.300890700067477 < 6.939948331338726.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 9.388046045908835 (T) = (0 -5947.161936597887) / Math.Sqrt((448164.90493087354 / (299)) + (34589.32462762479 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.07884585931456924 = (6456.207136161385 - 5947.161936597887) / 6456.207136161385 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytes(size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.661440711828692 < 4.823529689500098.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 9.907499967628704 (T) = (0 -3776.2320669630894) / Math.Sqrt((450473.79068771465 / (299)) + (22997.468762696695 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.1152449412528019 = (4268.110173125414 - 3776.2320669630894) / 4268.110173125414 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository