Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DSM] - Use the same header adapter on get and put #5361

Merged
merged 2 commits into from
Mar 28, 2024

Conversation

kr-igor
Copy link
Contributor

@kr-igor kr-igor commented Mar 27, 2024

Summary of changes

This is a followup to PR #5271. In the original PR only Put operation was using Noop headers adapter. Get operation should use the same adapter.

@datadog-ddstaging
Copy link

datadog-ddstaging bot commented Mar 27, 2024

Datadog Report

Branch report: kr-igor/ibmmq-quickfix
Commit report: 1e1be6c
Test service: dd-trace-dotnet

✅ 0 Failed, 308327 Passed, 1526 Skipped, 49m 22.06s Wall Time

@andrewlock
Copy link
Member

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (5361) - mean (74ms)  : 65, 83
     .   : milestone, 74,
    master - mean (73ms)  : 65, 81
     .   : milestone, 73,

    section CallTarget+Inlining+NGEN
    This PR (5361) - mean (1,004ms)  : 984, 1023
     .   : milestone, 1004,
    master - mean (1,005ms)  : 977, 1033
     .   : milestone, 1005,

Loading
gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (5361) - mean (109ms)  : 107, 112
     .   : milestone, 109,
    master - mean (110ms)  : 107, 114
     .   : milestone, 110,

    section CallTarget+Inlining+NGEN
    This PR (5361) - mean (716ms)  : 695, 737
     .   : milestone, 716,
    master - mean (725ms)  : 703, 748
     .   : milestone, 725,

Loading
gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (5361) - mean (94ms)  : 90, 97
     .   : milestone, 94,
    master - mean (93ms)  : 91, 96
     .   : milestone, 93,

    section CallTarget+Inlining+NGEN
    This PR (5361) - mean (676ms)  : 650, 701
     .   : milestone, 676,
    master - mean (675ms)  : 652, 698
     .   : milestone, 675,

Loading
gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (5361) - mean (187ms)  : 184, 191
     .   : milestone, 187,
    master - mean (188ms)  : 185, 192
     .   : milestone, 188,

    section CallTarget+Inlining+NGEN
    This PR (5361) - mean (1,078ms)  : 1059, 1097
     .   : milestone, 1078,
    master - mean (1,075ms)  : 1047, 1104
     .   : milestone, 1075,

Loading
gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (5361) - mean (270ms)  : 267, 274
     .   : milestone, 270,
    master - mean (272ms)  : 268, 276
     .   : milestone, 272,

    section CallTarget+Inlining+NGEN
    This PR (5361) - mean (877ms)  : 850, 904
     .   : milestone, 877,
    master - mean (883ms)  : 856, 909
     .   : milestone, 883,

Loading
gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (5361) - mean (261ms)  : 258, 263
     .   : milestone, 261,
    master - mean (261ms)  : 257, 265
     .   : milestone, 261,

    section CallTarget+Inlining+NGEN
    This PR (5361) - mean (858ms)  : 830, 886
     .   : milestone, 858,
    master - mean (855ms)  : 830, 880
     .   : milestone, 855,

Loading

@andrewlock
Copy link
Member

Benchmarks Report for tracer 🐌

Benchmarks for #5361 compared to master:

  • All benchmarks have the same speed
  • All benchmarks have the same allocations

The following thresholds were used for comparing the benchmark speeds:

  • Mann–Whitney U test with statistical test for significance of 5%
  • Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartStopWithChild net6.0 8.76μs 48.5ns 303ns 0.0218 0.00871 0 7.51 KB
master StartStopWithChild netcoreapp3.1 10.7μs 58.2ns 324ns 0.0167 0.00557 0 7.6 KB
master StartStopWithChild net472 16.9μs 61.8ns 239ns 1.34 0.334 0.1 8.06 KB
#5361 StartStopWithChild net6.0 8.76μs 49ns 329ns 0.033 0.0141 0 7.51 KB
#5361 StartStopWithChild netcoreapp3.1 10.5μs 48.3ns 181ns 0.025 0.01 0 7.61 KB
#5361 StartStopWithChild net472 17μs 62.7ns 243ns 1.37 0.373 0.116 8.04 KB
Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 443μs 183ns 686ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 611μs 85.3ns 296ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces net472 812μs 361ns 1.4μs 0.406 0 0 3.3 KB
#5361 WriteAndFlushEnrichedTraces net6.0 461μs 104ns 402ns 0 0 0 2.7 KB
#5361 WriteAndFlushEnrichedTraces netcoreapp3.1 601μs 168ns 651ns 0 0 0 2.7 KB
#5361 WriteAndFlushEnrichedTraces net472 816μs 387ns 1.45μs 0.406 0 0 3.3 KB
Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendRequest net6.0 170μs 167ns 624ns 0.169 0 0 18.33 KB
master SendRequest netcoreapp3.1 195μs 345ns 1.34μs 0.193 0 0 20.49 KB
master SendRequest net472 0.00128ns 0.000429ns 0.00166ns 0 0 0 0 b
#5361 SendRequest net6.0 171μs 195ns 755ns 0.257 0 0 18.33 KB
#5361 SendRequest netcoreapp3.1 194μs 195ns 728ns 0.195 0 0 20.49 KB
#5361 SendRequest net472 0.000662ns 0.000229ns 0.000827ns 0 0 0 0 b
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 548μs 2.68μs 11.4μs 0.541 0 0 41.65 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 645μs 1.53μs 5.91μs 0.326 0 0 41.64 KB
master WriteAndFlushEnrichedTraces net472 876μs 3.11μs 11.6μs 8.13 2.57 0.428 53.23 KB
#5361 WriteAndFlushEnrichedTraces net6.0 537μs 237ns 916ns 0.536 0 0 41.71 KB
#5361 WriteAndFlushEnrichedTraces netcoreapp3.1 652μs 1.16μs 4.51μs 0.326 0 0 41.82 KB
#5361 WriteAndFlushEnrichedTraces net472 886μs 3.86μs 14.9μs 8.39 2.52 0.419 53.24 KB
Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteNonQuery net6.0 1.13μs 0.425ns 1.64ns 0.0108 0 0 784 B
master ExecuteNonQuery netcoreapp3.1 1.52μs 3.56ns 13.8ns 0.0106 0 0 784 B
master ExecuteNonQuery net472 1.76μs 0.658ns 2.55ns 0.118 0 0 746 B
#5361 ExecuteNonQuery net6.0 1.19μs 0.638ns 2.47ns 0.0107 0 0 784 B
#5361 ExecuteNonQuery netcoreapp3.1 1.54μs 3.08ns 11.5ns 0.0107 0 0 784 B
#5361 ExecuteNonQuery net472 1.83μs 0.435ns 1.68ns 0.118 0 0 746 B
Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master CallElasticsearch net6.0 1.24μs 0.356ns 1.33ns 0.0144 0 0 1.01 KB
master CallElasticsearch netcoreapp3.1 1.61μs 0.926ns 3.46ns 0.0138 0 0 1.01 KB
master CallElasticsearch net472 2.47μs 1.83ns 7.09ns 0.161 0 0 1.02 KB
master CallElasticsearchAsync net6.0 1.4μs 1.03ns 3.86ns 0.0141 0 0 984 B
master CallElasticsearchAsync netcoreapp3.1 1.72μs 0.836ns 3.13ns 0.0136 0 0 1.06 KB
master CallElasticsearchAsync net472 2.53μs 1.17ns 4.53ns 0.171 0 0 1.08 KB
#5361 CallElasticsearch net6.0 1.32μs 0.693ns 2.68ns 0.0144 0 0 1.01 KB
#5361 CallElasticsearch netcoreapp3.1 1.7μs 1.02ns 3.67ns 0.0136 0 0 1.01 KB
#5361 CallElasticsearch net472 2.6μs 1.1ns 4.26ns 0.161 0 0 1.02 KB
#5361 CallElasticsearchAsync net6.0 1.34μs 0.627ns 2.43ns 0.0141 0 0 984 B
#5361 CallElasticsearchAsync netcoreapp3.1 1.7μs 0.997ns 3.86ns 0.0144 0 0 1.06 KB
#5361 CallElasticsearchAsync net472 2.6μs 1.06ns 3.82ns 0.171 0 0 1.08 KB
Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteAsync net6.0 1.26μs 1.14ns 4.27ns 0.0128 0 0 928 B
master ExecuteAsync netcoreapp3.1 1.65μs 1.84ns 7.11ns 0.0124 0 0 928 B
master ExecuteAsync net472 1.94μs 1.55ns 6.02ns 0.141 0 0 891 B
#5361 ExecuteAsync net6.0 1.32μs 0.664ns 2.49ns 0.0126 0 0 928 B
#5361 ExecuteAsync netcoreapp3.1 1.71μs 0.494ns 1.71ns 0.012 0 0 928 B
#5361 ExecuteAsync net472 1.97μs 1.09ns 4.23ns 0.141 0 0 891 B
Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendAsync net6.0 4.18μs 2.34ns 9.06ns 0.0294 0 0 2.16 KB
master SendAsync netcoreapp3.1 5.06μs 4.51ns 17.5ns 0.0355 0 0 2.7 KB
master SendAsync net472 7.65μs 7.64ns 29.6ns 0.483 0 0 3.05 KB
#5361 SendAsync net6.0 4.18μs 1.69ns 6.33ns 0.0312 0 0 2.16 KB
#5361 SendAsync netcoreapp3.1 5.18μs 1.69ns 6.34ns 0.0363 0 0 2.7 KB
#5361 SendAsync net472 7.69μs 4.48ns 16.7ns 0.484 0 0 3.05 KB
Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 1.55μs 0.638ns 2.39ns 0.0232 0 0 1.65 KB
master EnrichedLog netcoreapp3.1 2.3μs 1.22ns 4.55ns 0.0219 0 0 1.65 KB
master EnrichedLog net472 2.74μs 1.28ns 4.81ns 0.249 0 0 1.57 KB
#5361 EnrichedLog net6.0 1.56μs 1.06ns 3.97ns 0.0233 0 0 1.65 KB
#5361 EnrichedLog netcoreapp3.1 2.15μs 0.818ns 3.17ns 0.0223 0 0 1.65 KB
#5361 EnrichedLog net472 2.64μs 2.83ns 11ns 0.25 0 0 1.57 KB
Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 111μs 87.2ns 338ns 0.0556 0 0 4.23 KB
master EnrichedLog netcoreapp3.1 118μs 195ns 755ns 0.0587 0 0 4.23 KB
master EnrichedLog net472 147μs 69.3ns 268ns 0.658 0.219 0 4.41 KB
#5361 EnrichedLog net6.0 112μs 108ns 405ns 0.0565 0 0 4.23 KB
#5361 EnrichedLog netcoreapp3.1 118μs 173ns 648ns 0.0588 0 0 4.23 KB
#5361 EnrichedLog net472 150μs 144ns 557ns 0.669 0.223 0 4.41 KB
Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 3.11μs 2.52ns 9.42ns 0.0311 0 0 2.21 KB
master EnrichedLog netcoreapp3.1 3.94μs 3.78ns 14.1ns 0.0294 0 0 2.21 KB
master EnrichedLog net472 4.94μs 4.28ns 16.6ns 0.319 0 0 2.02 KB
#5361 EnrichedLog net6.0 2.96μs 0.7ns 2.62ns 0.0311 0 0 2.21 KB
#5361 EnrichedLog netcoreapp3.1 4.32μs 1.86ns 6.95ns 0.0302 0 0 2.21 KB
#5361 EnrichedLog net472 4.92μs 1.71ns 6.64ns 0.321 0 0 2.02 KB
Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendReceive net6.0 1.43μs 3.14ns 11.7ns 0.0163 0 0 1.18 KB
master SendReceive netcoreapp3.1 1.86μs 1.73ns 6.23ns 0.0159 0 0 1.18 KB
master SendReceive net472 2.21μs 2.53ns 9.78ns 0.187 0 0 1.18 KB
#5361 SendReceive net6.0 1.5μs 0.617ns 2.31ns 0.0164 0 0 1.18 KB
#5361 SendReceive netcoreapp3.1 1.88μs 0.651ns 2.44ns 0.0159 0 0 1.18 KB
#5361 SendReceive net472 2.21μs 1.45ns 5.6ns 0.187 0.0011 0 1.18 KB
Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.87μs 0.754ns 2.92ns 0.0213 0 0 1.55 KB
master EnrichedLog netcoreapp3.1 3.94μs 2.29ns 8.87ns 0.0218 0 0 1.6 KB
master EnrichedLog net472 4.39μs 3.15ns 12.2ns 0.315 0 0 1.99 KB
#5361 EnrichedLog net6.0 2.9μs 0.668ns 2.5ns 0.0216 0 0 1.55 KB
#5361 EnrichedLog netcoreapp3.1 4.02μs 1.32ns 5.12ns 0.0223 0 0 1.6 KB
#5361 EnrichedLog net472 4.53μs 1.65ns 6.16ns 0.314 0 0 1.99 KB
Benchmarks.Trace.SpanBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartFinishSpan net6.0 506ns 0.546ns 2.12ns 0.00775 0 0 552 B
master StartFinishSpan netcoreapp3.1 714ns 1.91ns 7.41ns 0.00745 0 0 552 B
master StartFinishSpan net472 779ns 2.13ns 8.27ns 0.0876 0 0 554 B
master StartFinishScope net6.0 628ns 0.945ns 3.66ns 0.00945 0 0 672 B
master StartFinishScope netcoreapp3.1 868ns 1.64ns 6.36ns 0.00911 0 0 672 B
master StartFinishScope net472 990ns 1.52ns 5.69ns 0.101 0 0 634 B
#5361 StartFinishSpan net6.0 490ns 0.162ns 0.584ns 0.00762 0 0 552 B
#5361 StartFinishSpan netcoreapp3.1 672ns 0.722ns 2.5ns 0.00724 0 0 552 B
#5361 StartFinishSpan net472 762ns 0.95ns 3.68ns 0.088 0 0 554 B
#5361 StartFinishScope net6.0 622ns 0.211ns 0.791ns 0.00948 0 0 672 B
#5361 StartFinishScope netcoreapp3.1 817ns 0.455ns 1.76ns 0.00914 0 0 672 B
#5361 StartFinishScope net472 959ns 1.6ns 6.19ns 0.101 0 0 634 B
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunOnMethodBegin net6.0 663ns 0.83ns 3.22ns 0.00962 0 0 672 B
master RunOnMethodBegin netcoreapp3.1 1.02μs 1.54ns 5.77ns 0.0089 0 0 672 B
master RunOnMethodBegin net472 1.11μs 1.83ns 6.84ns 0.1 0 0 634 B
#5361 RunOnMethodBegin net6.0 660ns 0.55ns 2.13ns 0.00958 0 0 672 B
#5361 RunOnMethodBegin netcoreapp3.1 988ns 0.669ns 2.5ns 0.00896 0 0 672 B
#5361 RunOnMethodBegin net472 1.08μs 1.47ns 5.7ns 0.1 0 0 634 B

@kr-igor kr-igor marked this pull request as ready for review March 27, 2024 16:52
@kr-igor kr-igor requested a review from a team as a code owner March 27, 2024 16:52
@kr-igor kr-igor merged commit dd8004e into master Mar 28, 2024
55 of 58 checks passed
@kr-igor kr-igor deleted the kr-igor/ibmmq-quickfix branch March 28, 2024 16:47
@github-actions github-actions bot added this to the vNext milestone Mar 28, 2024
@andrewlock andrewlock modified the milestones: vNext, vNext-v2 Apr 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants