Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Perf] Linux/x64: 73 Regressions on 12/8/2022 11:11:00 AM #10544

Open
performanceautofiler bot opened this issue Dec 8, 2022 · 4 comments
Open

[Perf] Linux/x64: 73 Regressions on 12/8/2022 11:11:00 AM #10544

performanceautofiler bot opened this issue Dec 8, 2022 · 4 comments

Comments

@performanceautofiler
Copy link

performanceautofiler bot commented Dec 8, 2022

Run Information

Architecture x64
OS ubuntu 18.04
Baseline b399eed41e575b5d03d0901e9d4776aa9a93b9a9
Compare 8c795cbde56c3047e8a7f73f4963ec513607f44d
Diff Diff

Regressions in SOD - Pizza App - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SOD - Pizza App - Publish - pub/wwwroot/_framework/System.ObjectModel.dll.br 1.81 KB 1.79 KB 0.99 0.00 True
SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Memory.dll.br 5.37 KB 5.30 KB 0.99 0.00 True
SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll 1.36 MB 1.37 MB 1.01 0.00 True
SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll.br 456.38 KB 461.19 KB 1.01 0.00 True
SOD - Pizza App - Publish - pub/wwwroot/_framework/dotnet.timezones.blat.gz 71.32 KB 72.88 KB 1.02 0.00 True
SOD - Pizza App - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll.gz 549.00 KB 554.69 KB 1.01 0.00 True

graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish*'

Payloads

Baseline
Compare

Histogram

SOD - Pizza App - Publish


Description of detection logic

IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline b399eed41e575b5d03d0901e9d4776aa9a93b9a9
Compare 8c795cbde56c3047e8a7f73f4963ec513607f44d
Diff Diff

Regressions in SOD - Minimum Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/System.Net.Http.Json.dll.br 4.08 KB 4.00 KB 0.98 0.00 True
SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/Microsoft.Extensions.Logging.Abstractions.dll.br 8.73 KB 8.64 KB 0.99 0.00 True
SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/System.Memory.dll.br 5.37 KB 5.30 KB 0.99 0.00 True
SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll 1.10 MB 1.14 MB 1.04 0.00 True
SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll.br 380.64 KB 390.73 KB 1.03 0.00 True
SOD - Minimum Blazor Template - Publish - Aggregate - .dll 2.10 MB 2.14 MB 1.02 0.00 True
SOD - Minimum Blazor Template - Publish - Total Uncompressed _framework 3.67 MB 3.72 MB 1.01 0.00 True
SOD - Minimum Blazor Template - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll.gz 453.69 KB 467.25 KB 1.03 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish*'

Payloads

Baseline
Compare

Histogram

SOD - Minimum Blazor Template - Publish


Description of detection logic

IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 8, 2022

Run Information

Architecture x64
OS ubuntu 18.04
Baseline b399eed41e575b5d03d0901e9d4776aa9a93b9a9
Compare 8c795cbde56c3047e8a7f73f4963ec513607f44d
Diff Diff

Regressions in SOD - Minimum Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/Microsoft.Extensions.Logging.Abstractions.dll.br 8.73 KB 8.64 KB 0.99 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Memory.dll.br 5.37 KB 5.30 KB 0.99 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Net.Http.Json.dll.br 4.08 KB 4.00 KB 0.98 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .wasm 9.97 MB 14.09 MB 1.41 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub 20.28 MB 25.65 MB 1.26 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll.br 380.64 KB 390.73 KB 1.03 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - Total Uncompressed _framework 12.50 MB 16.66 MB 1.33 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm 9.97 MB 14.09 MB 1.41 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - SOD - Minimum Blazor Template - Publish - AOT 20.28 MB 25.65 MB 1.26 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .br 2.95 MB 3.33 MB 1.13 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm.br 2.11 MB 2.49 MB 1.18 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll.gz 453.69 KB 467.25 KB 1.03 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm.gz 3.08 MB 3.89 MB 1.26 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - Synthetic Wire Size - .br 2.95 MB 3.33 MB 1.13 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .gz 4.08 MB 4.89 MB 1.20 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - Synthetic Wire Size - .gz 4.08 MB 4.89 MB 1.20 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - Aggregate - .dll 2.10 MB 2.14 MB 1.02 0.00 True
SOD - Minimum Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll 1.10 MB 1.14 MB 1.04 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Minimum Blazor Template - Publish - AOT*'

Payloads

Baseline
Compare

Histogram

SOD - Minimum Blazor Template - Publish - AOT


Description of detection logic

IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS ubuntu 18.04
Baseline b399eed41e575b5d03d0901e9d4776aa9a93b9a9
Compare 8c795cbde56c3047e8a7f73f4963ec513607f44d
Diff Diff

Regressions in SOD - New Blazor Template - Publish

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Net.Http.Json.dll.br 4.08 KB 4.00 KB 0.98 0.00 True
SOD - New Blazor Template - Publish - pub/wwwroot/_framework/Microsoft.Extensions.Logging.Abstractions.dll.br 8.73 KB 8.64 KB 0.99 0.00 True
SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Memory.dll.br 5.37 KB 5.30 KB 0.99 0.00 True
SOD - New Blazor Template - Publish - pub/wwwroot/_framework/dotnet.timezones.blat.gz 71.32 KB 72.88 KB 1.02 0.00 True
SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll.br 399.11 KB 409.71 KB 1.03 0.00 True
SOD - New Blazor Template - Publish - Aggregate - .dll 2.15 MB 2.20 MB 1.02 0.00 True
SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll 1.15 MB 1.20 MB 1.04 0.00 True
SOD - New Blazor Template - Publish - pub/wwwroot/_framework/System.Private.CoreLib.dll.gz 477.69 KB 490.22 KB 1.03 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish*'

Payloads

Baseline
Compare

Histogram

SOD - New Blazor Template - Publish


Description of detection logic

IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

Run Information

Architecture x64
OS ubuntu 18.04
Baseline b399eed41e575b5d03d0901e9d4776aa9a93b9a9
Compare 8c795cbde56c3047e8a7f73f4963ec513607f44d
Diff Diff

Regressions in SOD - Pizza App - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Memory.dll.br 5.37 KB 5.30 KB 0.99 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.ObjectModel.dll.br 1.81 KB 1.79 KB 0.99 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll 1.36 MB 1.37 MB 1.01 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/dotnet.timezones.blat.gz 71.32 KB 72.88 KB 1.02 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll.br 456.53 KB 463.32 KB 1.01 0.00 True
SOD - Pizza App - Publish - AOT - SOD - Pizza App - Publish - AOT 39.86 MB 49.38 MB 1.24 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot 39.86 MB 49.38 MB 1.24 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm.br 3.38 MB 4.09 MB 1.21 0.00 True
SOD - Pizza App - Publish - AOT - Aggregate - .br 5.52 MB 6.23 MB 1.13 0.00 True
SOD - Pizza App - Publish - AOT - Aggregate - .wasm 16.67 MB 24.00 MB 1.44 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll.gz 549.21 KB 554.85 KB 1.01 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm 16.67 MB 24.00 MB 1.44 0.00 True
SOD - Pizza App - Publish - AOT - Aggregate - .gz 7.72 MB 9.18 MB 1.19 0.00 True
SOD - Pizza App - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm.gz 4.95 MB 6.40 MB 1.29 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - Pizza App - Publish - AOT*'

Payloads

Baseline
Compare

Histogram

SOD - Pizza App - Publish - AOT


Description of detection logic

IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler
Copy link
Author

performanceautofiler bot commented Dec 8, 2022

Run Information

Architecture x64
OS ubuntu 18.04
Baseline b399eed41e575b5d03d0901e9d4776aa9a93b9a9
Compare 8c795cbde56c3047e8a7f73f4963ec513607f44d
Diff Diff

Regressions in SOD - New Blazor Template - Publish - AOT

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/Microsoft.Extensions.Logging.Abstractions.dll.br 8.73 KB 8.64 KB 0.99 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Net.Http.Json.dll.br 4.08 KB 4.00 KB 0.98 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Memory.dll.br 5.37 KB 5.30 KB 0.99 0.00 True
SOD - New Blazor Template - Publish - AOT - Aggregate - .dll 2.15 MB 2.20 MB 1.02 0.00 True
SOD - New Blazor Template - Publish - AOT - Aggregate - .wasm 11.39 MB 15.51 MB 1.36 0.00 True
SOD - New Blazor Template - Publish - AOT - SOD - New Blazor Template - Publish - AOT 29.36 MB 34.73 MB 1.18 0.00 True
SOD - New Blazor Template - Publish - AOT - Aggregate - .br 4.37 MB 4.76 MB 1.09 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll.gz 477.69 KB 490.22 KB 1.03 0.00 True
SOD - New Blazor Template - Publish - AOT - Aggregate - .gz 5.98 MB 6.80 MB 1.14 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm 11.39 MB 15.51 MB 1.36 0.00 True
SOD - New Blazor Template - Publish - AOT - Synthetic Wire Size - .br 4.37 MB 4.76 MB 1.09 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.timezones.blat.gz 71.32 KB 72.88 KB 1.02 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll.br 399.11 KB 409.71 KB 1.03 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm.br 2.57 MB 2.95 MB 1.15 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/dotnet.wasm.gz 3.65 MB 4.45 MB 1.22 0.00 True
SOD - New Blazor Template - Publish - AOT - Total Uncompressed _framework 18.25 MB 22.42 MB 1.23 0.00 True
SOD - New Blazor Template - Publish - AOT - pub 29.36 MB 34.73 MB 1.18 0.00 True
SOD - New Blazor Template - Publish - AOT - Synthetic Wire Size - .gz 5.98 MB 6.80 MB 1.14 0.00 True
SOD - New Blazor Template - Publish - AOT - pub/wwwroot/_framework/System.Private.CoreLib.dll 1.15 MB 1.20 MB 1.04 0.00 True

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SOD - New Blazor Template - Publish - AOT*'

Payloads

Baseline
Compare

Histogram

SOD - New Blazor Template - Publish - AOT


Description of detection logic

IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsRegressionBase: Marked as regression because the compare was 1% greater than the baseline, and the value was not too small.
IsImprovementBase: Marked as improvement because the compare was 1% less than the baseline, and the value was not too small.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@lewing
Copy link
Member

lewing commented Dec 9, 2022

these are from dotnet/runtime#78580

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant