Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Perf] Linux/x64: 37 Improvements on 4/5/2024 11:33:11 AM #32481

Open
performanceautofiler bot opened this issue Apr 9, 2024 · 2 comments
Open

[Perf] Linux/x64: 37 Improvements on 4/5/2024 11:33:11 AM #32481

performanceautofiler bot opened this issue Apr 9, 2024 · 2 comments

Comments

@performanceautofiler
Copy link

performanceautofiler bot commented Apr 9, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Collections.Perf_SingleCharFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
160.30 μs 89.99 μs 0.56 0.14 False
1.64 μs 888.80 ns 0.54 0.14 False
207.63 μs 112.89 μs 0.54 0.13 False
2.06 ms 1.15 ms 0.56 0.15 False
2.07 μs 1.16 μs 0.56 0.16 False
1.61 ms 896.89 μs 0.56 0.12 False
16.14 μs 8.80 μs 0.55 0.18 False
21.80 μs 11.56 μs 0.53 0.15 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SingleCharFrozenDictionary*'

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Reflection.Invoke

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.22 μs 985.04 ns 0.81 0.06 False
1.02 μs 851.84 ns 0.84 0.08 False
1.60 μs 1.37 μs 0.85 0.08 False
1.50 μs 1.31 μs 0.87 0.06 False
1.68 μs 1.40 μs 0.84 0.08 False
1.70 μs 1.47 μs 0.87 0.07 False
1.04 μs 866.93 ns 0.83 0.05 False
1.58 μs 1.32 μs 0.83 0.09 False
1.07 μs 924.25 ns 0.86 0.06 False
1.18 μs 936.85 ns 0.80 0.16 False
1.11 μs 929.73 ns 0.84 0.04 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Reflection.Invoke*'

System.Reflection.Invoke.Field_SetStatic_struct

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Ctor0_ActivatorCreateInstance_NoParams

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_Get_int

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_Get_class

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_Set_int

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_Set_struct

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_GetStatic_class

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_SetStatic_class

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_GetStatic_int

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_SetStatic_int

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Field_GetStatic_struct

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Tests.Perf_Type

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.99 μs 1.75 μs 0.88 0.08 False
6.98 μs 6.40 μs 0.92 0.10 False
2.77 μs 2.47 μs 0.89 0.08 False
2.74 μs 2.51 μs 0.91 0.08 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Type*'

System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Tests.Nested))

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Collections.Generic.Dictionary`2[]))

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Int32[*]))

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Int32[,]))

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in PerfLabTests.StackWalk

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
45.78 ms 41.98 ms 0.92 0.02 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.StackWalk*'

PerfLabTests.StackWalk.Walk

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Tests.Perf_Random

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
105.16 ns 68.49 ns 0.65 0.33 False
483.73 ns 389.71 ns 0.81 0.08 False
95.07 ns 67.10 ns 0.71 0.29 False
512.70 ns 422.50 ns 0.82 0.09 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Random*'

System.Tests.Perf_Random.Next_long_long_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_long

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_long_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_long_long

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Collections.Perf_SubstringFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.64 ms 1.91 ms 0.72 0.28 False
25.28 μs 18.41 μs 0.73 0.27 False
2.66 μs 1.85 μs 0.70 0.25 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SubstringFrozenDictionary*'

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Apr 9, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Collections.Perf_DefaultFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.69 μs 957.46 ns 0.57 0.13 False
2.06 μs 1.14 μs 0.55 0.12 False
3.27 ms 2.77 ms 0.85 0.09 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_DefaultFrozenDictionary*'

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Text.Tests.Perf_Encoding

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
299.05 ns 262.54 ns 0.88 0.18 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_Encoding*'

System.Text.Tests.Perf_Encoding.GetBytes(size: 16, encName: "utf-8")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Collections.ContainsKeyTrue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
157.56 μs 128.74 μs 0.82 0.14 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;String, String&gt;*'

System.Collections.ContainsKeyTrue<String, String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 960849bc1190f98a910cbf45ddca07588ebb9322
Compare e1f53785bfc203cd70aac486f49e269e9033f639
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Improvements in System.Collections.ContainsKeyFalse<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
131.99 μs 118.85 μs 0.90 0.12 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;String, String&gt;*'

System.Collections.ContainsKeyFalse<String, String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@lewing
Copy link
Member

lewing commented Apr 9, 2024

@BrzVlad looks like some improvements from dotnet/runtime#100400 the range is dotnet/runtime@beac274...7def0b7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant