-
Notifications
You must be signed in to change notification settings - Fork 140
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[v3] add language
tag all spans
#4839
[v3] add language
tag all spans
#4839
Conversation
Datadog ReportBranch report: ✅ |
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing the following branches/commits: Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (71ms) : 62, 81
. : milestone, 71,
master - mean (72ms) : 61, 83
. : milestone, 72,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (956ms) : 932, 979
. : milestone, 956,
master - mean (944ms) : 918, 971
. : milestone, 944,
gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (106ms) : 102, 110
. : milestone, 106,
master - mean (105ms) : 100, 110
. : milestone, 105,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (699ms) : 678, 721
. : milestone, 699,
master - mean (692ms) : 670, 714
. : milestone, 692,
gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (90ms) : 86, 95
. : milestone, 90,
master - mean (89ms) : 84, 93
. : milestone, 89,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (656ms) : 636, 676
. : milestone, 656,
master - mean (645ms) : 624, 665
. : milestone, 645,
gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (189ms) : 186, 192
. : milestone, 189,
master - mean (189ms) : 186, 192
. : milestone, 189,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (1,066ms) : 1043, 1089
. : milestone, 1066,
master - mean (1,068ms) : 1042, 1094
. : milestone, 1068,
gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (273ms) : 269, 278
. : milestone, 273,
master - mean (272ms) : 269, 276
. : milestone, 272,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (1,053ms) : 1027, 1079
. : milestone, 1053,
master - mean (1,057ms) : 1033, 1080
. : milestone, 1057,
gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (262ms) : 259, 266
. : milestone, 262,
master - mean (262ms) : 258, 266
. : milestone, 262,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (1,015ms) : 1000, 1031
. : milestone, 1015,
master - mean (1,023ms) : 1002, 1044
. : milestone, 1023,
|
Snapshots difference summaryThe following differences have been observed in committed snapshots. It is meant to help the reviewer. 2 occurrences of : + "language": "dotnet",
5689 occurrences of : + language: dotnet,
6 occurrences of : + error.msg: Cannot assign requested address,
+ error.stack: Cannot assign requested address (SocketException),
+ error.type: System.Net.WebException,
|
Benchmarks Report 🐌Benchmarks for #4839 compared to master:
The following thresholds were used for comparing the benchmark speeds:
Allocation changes below 0.5% are ignored. Benchmark detailsBenchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.Asm.AppSecWafBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ More allocations
|
Benchmark | Base Allocated | Diff Allocated | Change | Change % |
---|---|---|---|---|
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑netcoreapp3.1 | 41.65 KB | 41.91 KB | 263 B | 0.63% |
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | WriteAndFlushEnrichedTraces |
net6.0 | 554μs | 196ns | 759ns | 0.556 | 0 | 0 | 41.72 KB |
master | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 659μs | 1.82μs | 7.03μs | 0.329 | 0 | 0 | 41.65 KB |
master | WriteAndFlushEnrichedTraces |
net472 | 840μs | 3.5μs | 12.6μs | 8.45 | 2.53 | 0.422 | 53.23 KB |
#4839 | WriteAndFlushEnrichedTraces |
net6.0 | 541μs | 1.47μs | 5.7μs | 0.543 | 0 | 0 | 41.7 KB |
#4839 | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 650μs | 511ns | 1.98μs | 0.331 | 0 | 0 | 41.91 KB |
#4839 | WriteAndFlushEnrichedTraces |
net472 | 826μs | 3.86μs | 15μs | 8.17 | 2.45 | 0.408 | 53.23 KB |
Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | ExecuteNonQuery |
net6.0 | 1.1μs | 0.84ns | 3.25ns | 0.0104 | 0 | 0 | 768 B |
master | ExecuteNonQuery |
netcoreapp3.1 | 1.51μs | 1.01ns | 3.89ns | 0.0106 | 0 | 0 | 768 B |
master | ExecuteNonQuery |
net472 | 1.83μs | 1.36ns | 5.08ns | 0.116 | 0 | 0 | 730 B |
#4839 | ExecuteNonQuery |
net6.0 | 1.12μs | 0.57ns | 2.21ns | 0.0107 | 0 | 0 | 768 B |
#4839 | ExecuteNonQuery |
netcoreapp3.1 | 1.47μs | 1.76ns | 6.81ns | 0.0103 | 0 | 0 | 768 B |
#4839 | ExecuteNonQuery |
net472 | 1.68μs | 0.699ns | 2.71ns | 0.116 | 0 | 0 | 730 B |
Benchmarks.Trace.ElasticsearchBenchmark - Faster 🎉 Same allocations ✔️
Faster 🎉 in #4839
Benchmark
base/diff
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net6.0
1.117
1,410.98
1,262.79
Benchmark | base/diff | Base Median (ns) | Diff Median (ns) | Modality |
---|---|---|---|---|
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net6.0 | 1.117 | 1,410.98 | 1,262.79 |
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | CallElasticsearch |
net6.0 | 1.23μs | 1.41ns | 5.28ns | 0.0128 | 0 | 0 | 936 B |
master | CallElasticsearch |
netcoreapp3.1 | 1.51μs | 0.703ns | 2.63ns | 0.0129 | 0 | 0 | 936 B |
master | CallElasticsearch |
net472 | 2.48μs | 0.801ns | 3.1ns | 0.151 | 0 | 0 | 955 B |
master | CallElasticsearchAsync |
net6.0 | 1.41μs | 1.47ns | 5.68ns | 0.0128 | 0 | 0 | 912 B |
master | CallElasticsearchAsync |
netcoreapp3.1 | 1.79μs | 5.2ns | 18.8ns | 0.013 | 0 | 0 | 984 B |
master | CallElasticsearchAsync |
net472 | 2.78μs | 2.4ns | 8.99ns | 0.16 | 0 | 0 | 1.01 KB |
#4839 | CallElasticsearch |
net6.0 | 1.11μs | 0.273ns | 0.983ns | 0.0133 | 0 | 0 | 936 B |
#4839 | CallElasticsearch |
netcoreapp3.1 | 1.54μs | 0.686ns | 2.57ns | 0.0123 | 0 | 0 | 936 B |
#4839 | CallElasticsearch |
net472 | 2.4μs | 0.847ns | 3.17ns | 0.151 | 0 | 0 | 955 B |
#4839 | CallElasticsearchAsync |
net6.0 | 1.26μs | 2.15ns | 8.32ns | 0.0129 | 0 | 0 | 912 B |
#4839 | CallElasticsearchAsync |
netcoreapp3.1 | 1.69μs | 4.3ns | 16.7ns | 0.0134 | 0 | 0 | 984 B |
#4839 | CallElasticsearchAsync |
net472 | 2.74μs | 0.935ns | 3.5ns | 0.161 | 0 | 0 | 1.01 KB |
Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | ExecuteAsync |
net6.0 | 1.25μs | 3.06ns | 13.3ns | 0.0127 | 0 | 0 | 912 B |
master | ExecuteAsync |
netcoreapp3.1 | 1.66μs | 2.35ns | 8.78ns | 0.0124 | 0 | 0 | 912 B |
master | ExecuteAsync |
net472 | 1.71μs | 1.12ns | 4.33ns | 0.139 | 0 | 0 | 875 B |
#4839 | ExecuteAsync |
net6.0 | 1.26μs | 0.815ns | 3.05ns | 0.0127 | 0 | 0 | 912 B |
#4839 | ExecuteAsync |
netcoreapp3.1 | 1.63μs | 2.59ns | 10ns | 0.0125 | 0 | 0 | 912 B |
#4839 | ExecuteAsync |
net472 | 1.8μs | 0.907ns | 3.4ns | 0.139 | 0 | 0 | 875 B |
Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | SendAsync |
net6.0 | 4μs | 1.76ns | 6.83ns | 0.0301 | 0 | 0 | 2.1 KB |
master | SendAsync |
netcoreapp3.1 | 4.95μs | 1.59ns | 5.94ns | 0.0346 | 0 | 0 | 2.63 KB |
master | SendAsync |
net472 | 7.65μs | 3.09ns | 12ns | 0.524 | 0 | 0 | 3.31 KB |
#4839 | SendAsync |
net6.0 | 4.13μs | 2.02ns | 7.56ns | 0.0288 | 0 | 0 | 2.1 KB |
#4839 | SendAsync |
netcoreapp3.1 | 5.03μs | 1.63ns | 6.31ns | 0.0352 | 0 | 0 | 2.63 KB |
#4839 | SendAsync |
net472 | 7.76μs | 3.53ns | 13.7ns | 0.524 | 0 | 0 | 3.31 KB |
Benchmarks.Trace.Iast.StringAspectsBenchmark - Same speed ✔️ More allocations ⚠️
More allocations ⚠️ in #4839
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1
200.89 KB
212.47 KB
11.58 KB
5.77%
Fewer allocations 🎉 in #4839
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net472
61.25 KB
59.1 KB
-2.14 KB
-3.50%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0
214.22 KB
204.15 KB
-10.07 KB
-4.70%
Benchmark | Base Allocated | Diff Allocated | Change | Change % |
---|---|---|---|---|
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 | 200.89 KB | 212.47 KB | 11.58 KB | 5.77% |
Benchmark | Base Allocated | Diff Allocated | Change | Change % |
---|---|---|---|---|
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net472 | 61.25 KB | 59.1 KB | -2.14 KB | -3.50% |
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0 | 214.22 KB | 204.15 KB | -10.07 KB | -4.70% |
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | StringConcatBenchmark |
net6.0 | 60.4μs | 1.01μs | 10μs | 0 | 0 | 0 | 43.44 KB |
master | StringConcatBenchmark |
netcoreapp3.1 | 53.2μs | 215ns | 745ns | 0 | 0 | 0 | 42.64 KB |
master | StringConcatBenchmark |
net472 | 37.6μs | 128ns | 461ns | 0 | 0 | 0 | 61.25 KB |
master | StringConcatAspectBenchmark |
net6.0 | 290μs | 1.99μs | 19.1μs | 0 | 0 | 0 | 214.22 KB |
master | StringConcatAspectBenchmark |
netcoreapp3.1 | 284μs | 2.62μs | 24μs | 0 | 0 | 0 | 200.89 KB |
master | StringConcatAspectBenchmark |
net472 | 244μs | 4.02μs | 38.6μs | 0 | 0 | 0 | 221.18 KB |
#4839 | StringConcatBenchmark |
net6.0 | 52μs | 235ns | 911ns | 0 | 0 | 0 | 43.44 KB |
#4839 | StringConcatBenchmark |
netcoreapp3.1 | 56μs | 317ns | 2.31μs | 0 | 0 | 0 | 42.64 KB |
#4839 | StringConcatBenchmark |
net472 | 37.8μs | 132ns | 493ns | 0 | 0 | 0 | 59.1 KB |
#4839 | StringConcatAspectBenchmark |
net6.0 | 285μs | 6.06μs | 59.1μs | 0 | 0 | 0 | 204.15 KB |
#4839 | StringConcatAspectBenchmark |
netcoreapp3.1 | 360μs | 10.2μs | 102μs | 0 | 0 | 0 | 212.47 KB |
#4839 | StringConcatAspectBenchmark |
net472 | 265μs | 5.69μs | 55.2μs | 0 | 0 | 0 | 221.18 KB |
Benchmarks.Trace.ILoggerBenchmark - Slower ⚠️ Same allocations ✔️
Slower ⚠️ in #4839
Benchmark
diff/base
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net6.0
1.122
1,417.34
1,589.71
Benchmark | diff/base | Base Median (ns) | Diff Median (ns) | Modality |
---|---|---|---|---|
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net6.0 | 1.122 | 1,417.34 | 1,589.71 |
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | EnrichedLog |
net6.0 | 1.42μs | 0.512ns | 1.84ns | 0.0221 | 0 | 0 | 1.57 KB |
master | EnrichedLog |
netcoreapp3.1 | 2.25μs | 1.27ns | 4.57ns | 0.0214 | 0 | 0 | 1.57 KB |
master | EnrichedLog |
net472 | 2.74μs | 4.28ns | 16.6ns | 0.237 | 0 | 0 | 1.5 KB |
#4839 | EnrichedLog |
net6.0 | 1.59μs | 0.31ns | 1.16ns | 0.0219 | 0 | 0 | 1.57 KB |
#4839 | EnrichedLog |
netcoreapp3.1 | 2.2μs | 1.15ns | 4.47ns | 0.021 | 0 | 0 | 1.57 KB |
#4839 | EnrichedLog |
net472 | 2.68μs | 1.98ns | 7.66ns | 0.238 | 0 | 0 | 1.5 KB |
Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | EnrichedLog |
net6.0 | 113μs | 116ns | 449ns | 0 | 0 | 0 | 4.21 KB |
master | EnrichedLog |
netcoreapp3.1 | 117μs | 132ns | 511ns | 0.0591 | 0 | 0 | 4.21 KB |
master | EnrichedLog |
net472 | 149μs | 70.7ns | 274ns | 0.668 | 0.223 | 0 | 4.39 KB |
#4839 | EnrichedLog |
net6.0 | 113μs | 119ns | 460ns | 0.0567 | 0 | 0 | 4.21 KB |
#4839 | EnrichedLog |
netcoreapp3.1 | 120μs | 146ns | 566ns | 0 | 0 | 0 | 4.21 KB |
#4839 | EnrichedLog |
net472 | 148μs | 66.8ns | 259ns | 0.667 | 0.222 | 0 | 4.39 KB |
Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | EnrichedLog |
net6.0 | 3.08μs | 0.662ns | 2.48ns | 0.0293 | 0 | 0 | 2.13 KB |
master | EnrichedLog |
netcoreapp3.1 | 4.19μs | 1.89ns | 7.06ns | 0.0273 | 0 | 0 | 2.13 KB |
master | EnrichedLog |
net472 | 4.87μs | 1.95ns | 7.56ns | 0.308 | 0 | 0 | 1.95 KB |
#4839 | EnrichedLog |
net6.0 | 3.09μs | 0.484ns | 1.68ns | 0.0294 | 0 | 0 | 2.13 KB |
#4839 | EnrichedLog |
netcoreapp3.1 | 4.26μs | 1.33ns | 5.16ns | 0.0278 | 0 | 0 | 2.13 KB |
#4839 | EnrichedLog |
net472 | 4.99μs | 1.51ns | 5.64ns | 0.308 | 0 | 0 | 1.95 KB |
Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | SendReceive |
net6.0 | 1.32μs | 0.554ns | 2.14ns | 0.0152 | 0 | 0 | 1.1 KB |
master | SendReceive |
netcoreapp3.1 | 1.75μs | 0.533ns | 1.99ns | 0.0151 | 0 | 0 | 1.1 KB |
master | SendReceive |
net472 | 2.09μs | 1.52ns | 5.69ns | 0.176 | 0 | 0 | 1.12 KB |
#4839 | SendReceive |
net6.0 | 1.34μs | 0.884ns | 3.42ns | 0.0154 | 0 | 0 | 1.1 KB |
#4839 | SendReceive |
netcoreapp3.1 | 1.73μs | 0.499ns | 1.8ns | 0.0147 | 0 | 0 | 1.1 KB |
#4839 | SendReceive |
net472 | 2.14μs | 3.75ns | 14.5ns | 0.177 | 0 | 0 | 1.12 KB |
Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | EnrichedLog |
net6.0 | 2.97μs | 1.7ns | 6.58ns | 0.0208 | 0 | 0 | 1.53 KB |
master | EnrichedLog |
netcoreapp3.1 | 3.95μs | 1.8ns | 6.97ns | 0.0197 | 0 | 0 | 1.58 KB |
master | EnrichedLog |
net472 | 4.4μs | 1.91ns | 7.13ns | 0.312 | 0 | 0 | 1.97 KB |
#4839 | EnrichedLog |
net6.0 | 2.78μs | 0.689ns | 2.67ns | 0.0207 | 0 | 0 | 1.53 KB |
#4839 | EnrichedLog |
netcoreapp3.1 | 3.95μs | 1.05ns | 3.92ns | 0.0215 | 0 | 0 | 1.58 KB |
#4839 | EnrichedLog |
net472 | 4.32μs | 2.05ns | 7.66ns | 0.31 | 0 | 0 | 1.97 KB |
Benchmarks.Trace.SpanBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | StartFinishSpan |
net6.0 | 514ns | 0.212ns | 0.819ns | 0.00757 | 0 | 0 | 536 B |
master | StartFinishSpan |
netcoreapp3.1 | 656ns | 0.392ns | 1.52ns | 0.00715 | 0 | 0 | 536 B |
master | StartFinishSpan |
net472 | 808ns | 0.203ns | 0.76ns | 0.0853 | 0 | 0 | 538 B |
master | StartFinishScope |
net6.0 | 627ns | 0.208ns | 0.78ns | 0.00899 | 0 | 0 | 656 B |
master | StartFinishScope |
netcoreapp3.1 | 834ns | 0.485ns | 1.88ns | 0.00878 | 0 | 0 | 656 B |
master | StartFinishScope |
net472 | 963ns | 0.429ns | 1.66ns | 0.0979 | 0 | 0 | 618 B |
#4839 | StartFinishSpan |
net6.0 | 475ns | 0.1ns | 0.348ns | 0.00756 | 0 | 0 | 536 B |
#4839 | StartFinishSpan |
netcoreapp3.1 | 719ns | 0.169ns | 0.655ns | 0.00721 | 0 | 0 | 536 B |
#4839 | StartFinishSpan |
net472 | 753ns | 0.284ns | 1.1ns | 0.0851 | 0 | 0 | 538 B |
#4839 | StartFinishScope |
net6.0 | 578ns | 0.15ns | 0.582ns | 0.00925 | 0 | 0 | 656 B |
#4839 | StartFinishScope |
netcoreapp3.1 | 860ns | 0.378ns | 1.46ns | 0.00895 | 0 | 0 | 656 B |
#4839 | StartFinishScope |
net472 | 966ns | 1.22ns | 4.73ns | 0.098 | 0 | 0 | 618 B |
Benchmarks.Trace.TraceAnnotationsBenchmark - Slower ⚠️ Same allocations ✔️
Slower ⚠️ in #4839
Benchmark
diff/base
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0
1.152
569.26
655.91
Benchmark | diff/base | Base Median (ns) | Diff Median (ns) | Modality |
---|---|---|---|---|
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0 | 1.152 | 569.26 | 655.91 |
Raw results
Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
---|---|---|---|---|---|---|---|---|---|
master | RunOnMethodBegin |
net6.0 | 569ns | 0.162ns | 0.627ns | 0.00933 | 0 | 0 | 656 B |
master | RunOnMethodBegin |
netcoreapp3.1 | 960ns | 0.758ns | 2.94ns | 0.00871 | 0 | 0 | 656 B |
master | RunOnMethodBegin |
net472 | 1.06μs | 0.363ns | 1.41ns | 0.0978 | 0 | 0 | 618 B |
#4839 | RunOnMethodBegin |
net6.0 | 656ns | 0.266ns | 1.03ns | 0.00919 | 0 | 0 | 656 B |
#4839 | RunOnMethodBegin |
netcoreapp3.1 | 997ns | 0.778ns | 3.01ns | 0.00866 | 0 | 0 | 656 B |
#4839 | RunOnMethodBegin |
net472 | 1.05μs | 0.38ns | 1.47ns | 0.098 | 0 | 0 | 618 B |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, this going to be a really fun one to update snapshots I expect 😄
The good news is it always appears to be after env: integration_tests
, which should be standard across all snapshots, so 🤞 you should be able to regex replace this one
d6533cf
to
69d9ecf
Compare
Throughput/Crank Report:zap:Throughput results for AspNetCoreSimpleController comparing the following branches/commits: Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red. Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards! gantt
title Throughput Linux x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (11.260M) : 0, 11260477
master (11.078M) : 0, 11078217
benchmarks/2.9.0 (11.015M) : 0, 11014948
section Automatic
This PR (4839) (7.684M) : 0, 7683640
master (7.478M) : 0, 7478193
benchmarks/2.9.0 (7.926M) : 0, 7925773
section Trace stats
This PR (4839) (7.987M) : 0, 7986988
master (7.957M) : 0, 7956885
section Manual
This PR (4839) (9.838M) : 0, 9838045
master (9.693M) : 0, 9692849
section Manual + Automatic
This PR (4839) (7.284M) : 0, 7284378
master (7.162M) : 0, 7161560
section Version Conflict
This PR (4839) (6.575M) : 0, 6575109
master (6.527M) : 0, 6527327
gantt
title Throughput Linux arm64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (9.709M) : 0, 9708513
master (9.511M) : 0, 9511060
benchmarks/2.9.0 (9.652M) : 0, 9651615
section Automatic
This PR (4839) (6.629M) : 0, 6629273
master (6.731M) : 0, 6730572
section Trace stats
This PR (4839) (6.817M) : 0, 6817056
master (6.843M) : 0, 6842643
section Manual
This PR (4839) (8.057M) : 0, 8056657
master (8.329M) : 0, 8329261
section Manual + Automatic
This PR (4839) (6.190M) : 0, 6189719
master (6.241M) : 0, 6241377
section Version Conflict
This PR (4839) (5.797M) : 0, 5796681
master (5.733M) : 0, 5732704
gantt
title Throughput Windows x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (9.802M) : 0, 9802365
master (10.008M) : 0, 10007628
benchmarks/2.9.0 (10.371M) : 0, 10371072
section Automatic
This PR (4839) (6.910M) : 0, 6909641
master (7.094M) : 0, 7093941
benchmarks/2.9.0 (7.518M) : 0, 7518013
section Trace stats
This PR (4839) (7.264M) : 0, 7264326
master (7.321M) : 0, 7320885
section Manual
This PR (4839) (8.803M) : 0, 8803299
master (8.839M) : 0, 8838799
section Manual + Automatic
This PR (4839) (6.662M) : 0, 6661743
master (6.905M) : 0, 6904693
section Version Conflict
This PR (4839) (6.105M) : 0, 6104730
master (6.177M) : 0, 6176842
gantt
title Throughput Linux x64 (ASM) (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (7.489M) : 0, 7488839
master (7.477M) : 0, 7476892
benchmarks/2.9.0 (7.958M) : 0, 7957509
section No attack
This PR (4839) (1.747M) : 0, 1747484
master (1.770M) : 0, 1770190
benchmarks/2.9.0 (3.247M) : 0, 3247318
section Attack
This PR (4839) (1.403M) : 0, 1402862
master (1.399M) : 0, 1398783
benchmarks/2.9.0 (2.539M) : 0, 2539306
section Blocking
This PR (4839) (3.091M) : 0, 3091176
master (3.092M) : 0, 3092380
section IAST default
This PR (4839) (6.399M) : 0, 6398599
master (6.527M) : 0, 6527052
section IAST full
This PR (4839) (5.588M) : 0, 5587507
master (5.701M) : 0, 5700591
section Base vuln
This PR (4839) (0.937M) : 0, 936853
master (0.938M) : 0, 937685
section IAST vuln
This PR (4839) (0.844M) : 0, 843810
master (0.865M) : 0, 864967
|
07e99e4
to
c28b88c
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, I only skimmed a few of the snapshots as they looked the same
Datadog ReportBranch report: ❄️ New Flaky Tests (1)
|
language
tag all spanslanguage
tag all spans
cc7bb04
to
a5b9940
Compare
Datadog ReportBranch report: ❌ ❌ Failed Tests (18)
|
We're going to do this in v3 now right? If so, I suggest rebasing on |
a5b9940
to
fe8013a
Compare
Datadog ReportBranch report: ❌ ❌ Failed Tests (35)
|
89d9080
to
5aba9b1
Compare
Summary of changes
Add
language:dotnet
tag all spans.Reason for change
Spans without a
language
tag end up withlanguage:.NET
later in the pipeline. We want all spans to have a single value for this tag.Implementation details
Remove the check for
span.kind is not (client or producer)
when adding thelanguage
tag to spans.Test coverage
Other details