[v3] add language tag all spans#4839
Conversation
Datadog ReportBranch report: ✅ |
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing the following branches/commits: Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (71ms) : 62, 81
. : milestone, 71,
master - mean (72ms) : 61, 83
. : milestone, 72,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (956ms) : 932, 979
. : milestone, 956,
master - mean (944ms) : 918, 971
. : milestone, 944,
gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (106ms) : 102, 110
. : milestone, 106,
master - mean (105ms) : 100, 110
. : milestone, 105,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (699ms) : 678, 721
. : milestone, 699,
master - mean (692ms) : 670, 714
. : milestone, 692,
gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (90ms) : 86, 95
. : milestone, 90,
master - mean (89ms) : 84, 93
. : milestone, 89,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (656ms) : 636, 676
. : milestone, 656,
master - mean (645ms) : 624, 665
. : milestone, 645,
gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (189ms) : 186, 192
. : milestone, 189,
master - mean (189ms) : 186, 192
. : milestone, 189,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (1,066ms) : 1043, 1089
. : milestone, 1066,
master - mean (1,068ms) : 1042, 1094
. : milestone, 1068,
gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (273ms) : 269, 278
. : milestone, 273,
master - mean (272ms) : 269, 276
. : milestone, 272,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (1,053ms) : 1027, 1079
. : milestone, 1053,
master - mean (1,057ms) : 1033, 1080
. : milestone, 1057,
gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (4839) - mean (262ms) : 259, 266
. : milestone, 262,
master - mean (262ms) : 258, 266
. : milestone, 262,
section CallTarget+Inlining+NGEN
This PR (4839) - mean (1,015ms) : 1000, 1031
. : milestone, 1015,
master - mean (1,023ms) : 1002, 1044
. : milestone, 1023,
|
Snapshots difference summaryThe following differences have been observed in committed snapshots. It is meant to help the reviewer. 2 occurrences of : + "language": "dotnet",
5689 occurrences of : + language: dotnet,
6 occurrences of : + error.msg: Cannot assign requested address,
+ error.stack: Cannot assign requested address (SocketException),
+ error.type: System.Net.WebException,
|
Benchmarks Report 🐌Benchmarks for #4839 compared to master:
The following thresholds were used for comparing the benchmark speeds:
Allocation changes below 0.5% are ignored. Benchmark detailsBenchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.Asm.AppSecWafBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ More allocations
|
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑netcoreapp3.1 | 41.65 KB | 41.91 KB | 263 B | 0.63% |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | WriteAndFlushEnrichedTraces |
net6.0 | 554μs | 196ns | 759ns | 0.556 | 0 | 0 | 41.72 KB |
| master | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 659μs | 1.82μs | 7.03μs | 0.329 | 0 | 0 | 41.65 KB |
| master | WriteAndFlushEnrichedTraces |
net472 | 840μs | 3.5μs | 12.6μs | 8.45 | 2.53 | 0.422 | 53.23 KB |
| #4839 | WriteAndFlushEnrichedTraces |
net6.0 | 541μs | 1.47μs | 5.7μs | 0.543 | 0 | 0 | 41.7 KB |
| #4839 | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 650μs | 511ns | 1.98μs | 0.331 | 0 | 0 | 41.91 KB |
| #4839 | WriteAndFlushEnrichedTraces |
net472 | 826μs | 3.86μs | 15μs | 8.17 | 2.45 | 0.408 | 53.23 KB |
Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | ExecuteNonQuery |
net6.0 | 1.1μs | 0.84ns | 3.25ns | 0.0104 | 0 | 0 | 768 B |
| master | ExecuteNonQuery |
netcoreapp3.1 | 1.51μs | 1.01ns | 3.89ns | 0.0106 | 0 | 0 | 768 B |
| master | ExecuteNonQuery |
net472 | 1.83μs | 1.36ns | 5.08ns | 0.116 | 0 | 0 | 730 B |
| #4839 | ExecuteNonQuery |
net6.0 | 1.12μs | 0.57ns | 2.21ns | 0.0107 | 0 | 0 | 768 B |
| #4839 | ExecuteNonQuery |
netcoreapp3.1 | 1.47μs | 1.76ns | 6.81ns | 0.0103 | 0 | 0 | 768 B |
| #4839 | ExecuteNonQuery |
net472 | 1.68μs | 0.699ns | 2.71ns | 0.116 | 0 | 0 | 730 B |
Benchmarks.Trace.ElasticsearchBenchmark - Faster 🎉 Same allocations ✔️
Faster 🎉 in #4839
Benchmark
base/diff
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net6.0
1.117
1,410.98
1,262.79
| Benchmark | base/diff | Base Median (ns) | Diff Median (ns) | Modality |
|---|---|---|---|---|
| Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearchAsync‑net6.0 | 1.117 | 1,410.98 | 1,262.79 |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | CallElasticsearch |
net6.0 | 1.23μs | 1.41ns | 5.28ns | 0.0128 | 0 | 0 | 936 B |
| master | CallElasticsearch |
netcoreapp3.1 | 1.51μs | 0.703ns | 2.63ns | 0.0129 | 0 | 0 | 936 B |
| master | CallElasticsearch |
net472 | 2.48μs | 0.801ns | 3.1ns | 0.151 | 0 | 0 | 955 B |
| master | CallElasticsearchAsync |
net6.0 | 1.41μs | 1.47ns | 5.68ns | 0.0128 | 0 | 0 | 912 B |
| master | CallElasticsearchAsync |
netcoreapp3.1 | 1.79μs | 5.2ns | 18.8ns | 0.013 | 0 | 0 | 984 B |
| master | CallElasticsearchAsync |
net472 | 2.78μs | 2.4ns | 8.99ns | 0.16 | 0 | 0 | 1.01 KB |
| #4839 | CallElasticsearch |
net6.0 | 1.11μs | 0.273ns | 0.983ns | 0.0133 | 0 | 0 | 936 B |
| #4839 | CallElasticsearch |
netcoreapp3.1 | 1.54μs | 0.686ns | 2.57ns | 0.0123 | 0 | 0 | 936 B |
| #4839 | CallElasticsearch |
net472 | 2.4μs | 0.847ns | 3.17ns | 0.151 | 0 | 0 | 955 B |
| #4839 | CallElasticsearchAsync |
net6.0 | 1.26μs | 2.15ns | 8.32ns | 0.0129 | 0 | 0 | 912 B |
| #4839 | CallElasticsearchAsync |
netcoreapp3.1 | 1.69μs | 4.3ns | 16.7ns | 0.0134 | 0 | 0 | 984 B |
| #4839 | CallElasticsearchAsync |
net472 | 2.74μs | 0.935ns | 3.5ns | 0.161 | 0 | 0 | 1.01 KB |
Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | ExecuteAsync |
net6.0 | 1.25μs | 3.06ns | 13.3ns | 0.0127 | 0 | 0 | 912 B |
| master | ExecuteAsync |
netcoreapp3.1 | 1.66μs | 2.35ns | 8.78ns | 0.0124 | 0 | 0 | 912 B |
| master | ExecuteAsync |
net472 | 1.71μs | 1.12ns | 4.33ns | 0.139 | 0 | 0 | 875 B |
| #4839 | ExecuteAsync |
net6.0 | 1.26μs | 0.815ns | 3.05ns | 0.0127 | 0 | 0 | 912 B |
| #4839 | ExecuteAsync |
netcoreapp3.1 | 1.63μs | 2.59ns | 10ns | 0.0125 | 0 | 0 | 912 B |
| #4839 | ExecuteAsync |
net472 | 1.8μs | 0.907ns | 3.4ns | 0.139 | 0 | 0 | 875 B |
Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendAsync |
net6.0 | 4μs | 1.76ns | 6.83ns | 0.0301 | 0 | 0 | 2.1 KB |
| master | SendAsync |
netcoreapp3.1 | 4.95μs | 1.59ns | 5.94ns | 0.0346 | 0 | 0 | 2.63 KB |
| master | SendAsync |
net472 | 7.65μs | 3.09ns | 12ns | 0.524 | 0 | 0 | 3.31 KB |
| #4839 | SendAsync |
net6.0 | 4.13μs | 2.02ns | 7.56ns | 0.0288 | 0 | 0 | 2.1 KB |
| #4839 | SendAsync |
netcoreapp3.1 | 5.03μs | 1.63ns | 6.31ns | 0.0352 | 0 | 0 | 2.63 KB |
| #4839 | SendAsync |
net472 | 7.76μs | 3.53ns | 13.7ns | 0.524 | 0 | 0 | 3.31 KB |
Benchmarks.Trace.Iast.StringAspectsBenchmark - Same speed ✔️ More allocations ⚠️
More allocations ⚠️ in #4839
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1
200.89 KB
212.47 KB
11.58 KB
5.77%
Fewer allocations 🎉 in #4839
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net472
61.25 KB
59.1 KB
-2.14 KB
-3.50%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0
214.22 KB
204.15 KB
-10.07 KB
-4.70%
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 | 200.89 KB | 212.47 KB | 11.58 KB | 5.77% |
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net472 | 61.25 KB | 59.1 KB | -2.14 KB | -3.50% |
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0 | 214.22 KB | 204.15 KB | -10.07 KB | -4.70% |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | StringConcatBenchmark |
net6.0 | 60.4μs | 1.01μs | 10μs | 0 | 0 | 0 | 43.44 KB |
| master | StringConcatBenchmark |
netcoreapp3.1 | 53.2μs | 215ns | 745ns | 0 | 0 | 0 | 42.64 KB |
| master | StringConcatBenchmark |
net472 | 37.6μs | 128ns | 461ns | 0 | 0 | 0 | 61.25 KB |
| master | StringConcatAspectBenchmark |
net6.0 | 290μs | 1.99μs | 19.1μs | 0 | 0 | 0 | 214.22 KB |
| master | StringConcatAspectBenchmark |
netcoreapp3.1 | 284μs | 2.62μs | 24μs | 0 | 0 | 0 | 200.89 KB |
| master | StringConcatAspectBenchmark |
net472 | 244μs | 4.02μs | 38.6μs | 0 | 0 | 0 | 221.18 KB |
| #4839 | StringConcatBenchmark |
net6.0 | 52μs | 235ns | 911ns | 0 | 0 | 0 | 43.44 KB |
| #4839 | StringConcatBenchmark |
netcoreapp3.1 | 56μs | 317ns | 2.31μs | 0 | 0 | 0 | 42.64 KB |
| #4839 | StringConcatBenchmark |
net472 | 37.8μs | 132ns | 493ns | 0 | 0 | 0 | 59.1 KB |
| #4839 | StringConcatAspectBenchmark |
net6.0 | 285μs | 6.06μs | 59.1μs | 0 | 0 | 0 | 204.15 KB |
| #4839 | StringConcatAspectBenchmark |
netcoreapp3.1 | 360μs | 10.2μs | 102μs | 0 | 0 | 0 | 212.47 KB |
| #4839 | StringConcatAspectBenchmark |
net472 | 265μs | 5.69μs | 55.2μs | 0 | 0 | 0 | 221.18 KB |
Benchmarks.Trace.ILoggerBenchmark - Slower ⚠️ Same allocations ✔️
Slower ⚠️ in #4839
Benchmark
diff/base
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net6.0
1.122
1,417.34
1,589.71
| Benchmark | diff/base | Base Median (ns) | Diff Median (ns) | Modality |
|---|---|---|---|---|
| Benchmarks.Trace.ILoggerBenchmark.EnrichedLog‑net6.0 | 1.122 | 1,417.34 | 1,589.71 |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 1.42μs | 0.512ns | 1.84ns | 0.0221 | 0 | 0 | 1.57 KB |
| master | EnrichedLog |
netcoreapp3.1 | 2.25μs | 1.27ns | 4.57ns | 0.0214 | 0 | 0 | 1.57 KB |
| master | EnrichedLog |
net472 | 2.74μs | 4.28ns | 16.6ns | 0.237 | 0 | 0 | 1.5 KB |
| #4839 | EnrichedLog |
net6.0 | 1.59μs | 0.31ns | 1.16ns | 0.0219 | 0 | 0 | 1.57 KB |
| #4839 | EnrichedLog |
netcoreapp3.1 | 2.2μs | 1.15ns | 4.47ns | 0.021 | 0 | 0 | 1.57 KB |
| #4839 | EnrichedLog |
net472 | 2.68μs | 1.98ns | 7.66ns | 0.238 | 0 | 0 | 1.5 KB |
Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 113μs | 116ns | 449ns | 0 | 0 | 0 | 4.21 KB |
| master | EnrichedLog |
netcoreapp3.1 | 117μs | 132ns | 511ns | 0.0591 | 0 | 0 | 4.21 KB |
| master | EnrichedLog |
net472 | 149μs | 70.7ns | 274ns | 0.668 | 0.223 | 0 | 4.39 KB |
| #4839 | EnrichedLog |
net6.0 | 113μs | 119ns | 460ns | 0.0567 | 0 | 0 | 4.21 KB |
| #4839 | EnrichedLog |
netcoreapp3.1 | 120μs | 146ns | 566ns | 0 | 0 | 0 | 4.21 KB |
| #4839 | EnrichedLog |
net472 | 148μs | 66.8ns | 259ns | 0.667 | 0.222 | 0 | 4.39 KB |
Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 3.08μs | 0.662ns | 2.48ns | 0.0293 | 0 | 0 | 2.13 KB |
| master | EnrichedLog |
netcoreapp3.1 | 4.19μs | 1.89ns | 7.06ns | 0.0273 | 0 | 0 | 2.13 KB |
| master | EnrichedLog |
net472 | 4.87μs | 1.95ns | 7.56ns | 0.308 | 0 | 0 | 1.95 KB |
| #4839 | EnrichedLog |
net6.0 | 3.09μs | 0.484ns | 1.68ns | 0.0294 | 0 | 0 | 2.13 KB |
| #4839 | EnrichedLog |
netcoreapp3.1 | 4.26μs | 1.33ns | 5.16ns | 0.0278 | 0 | 0 | 2.13 KB |
| #4839 | EnrichedLog |
net472 | 4.99μs | 1.51ns | 5.64ns | 0.308 | 0 | 0 | 1.95 KB |
Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendReceive |
net6.0 | 1.32μs | 0.554ns | 2.14ns | 0.0152 | 0 | 0 | 1.1 KB |
| master | SendReceive |
netcoreapp3.1 | 1.75μs | 0.533ns | 1.99ns | 0.0151 | 0 | 0 | 1.1 KB |
| master | SendReceive |
net472 | 2.09μs | 1.52ns | 5.69ns | 0.176 | 0 | 0 | 1.12 KB |
| #4839 | SendReceive |
net6.0 | 1.34μs | 0.884ns | 3.42ns | 0.0154 | 0 | 0 | 1.1 KB |
| #4839 | SendReceive |
netcoreapp3.1 | 1.73μs | 0.499ns | 1.8ns | 0.0147 | 0 | 0 | 1.1 KB |
| #4839 | SendReceive |
net472 | 2.14μs | 3.75ns | 14.5ns | 0.177 | 0 | 0 | 1.12 KB |
Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 2.97μs | 1.7ns | 6.58ns | 0.0208 | 0 | 0 | 1.53 KB |
| master | EnrichedLog |
netcoreapp3.1 | 3.95μs | 1.8ns | 6.97ns | 0.0197 | 0 | 0 | 1.58 KB |
| master | EnrichedLog |
net472 | 4.4μs | 1.91ns | 7.13ns | 0.312 | 0 | 0 | 1.97 KB |
| #4839 | EnrichedLog |
net6.0 | 2.78μs | 0.689ns | 2.67ns | 0.0207 | 0 | 0 | 1.53 KB |
| #4839 | EnrichedLog |
netcoreapp3.1 | 3.95μs | 1.05ns | 3.92ns | 0.0215 | 0 | 0 | 1.58 KB |
| #4839 | EnrichedLog |
net472 | 4.32μs | 2.05ns | 7.66ns | 0.31 | 0 | 0 | 1.97 KB |
Benchmarks.Trace.SpanBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | StartFinishSpan |
net6.0 | 514ns | 0.212ns | 0.819ns | 0.00757 | 0 | 0 | 536 B |
| master | StartFinishSpan |
netcoreapp3.1 | 656ns | 0.392ns | 1.52ns | 0.00715 | 0 | 0 | 536 B |
| master | StartFinishSpan |
net472 | 808ns | 0.203ns | 0.76ns | 0.0853 | 0 | 0 | 538 B |
| master | StartFinishScope |
net6.0 | 627ns | 0.208ns | 0.78ns | 0.00899 | 0 | 0 | 656 B |
| master | StartFinishScope |
netcoreapp3.1 | 834ns | 0.485ns | 1.88ns | 0.00878 | 0 | 0 | 656 B |
| master | StartFinishScope |
net472 | 963ns | 0.429ns | 1.66ns | 0.0979 | 0 | 0 | 618 B |
| #4839 | StartFinishSpan |
net6.0 | 475ns | 0.1ns | 0.348ns | 0.00756 | 0 | 0 | 536 B |
| #4839 | StartFinishSpan |
netcoreapp3.1 | 719ns | 0.169ns | 0.655ns | 0.00721 | 0 | 0 | 536 B |
| #4839 | StartFinishSpan |
net472 | 753ns | 0.284ns | 1.1ns | 0.0851 | 0 | 0 | 538 B |
| #4839 | StartFinishScope |
net6.0 | 578ns | 0.15ns | 0.582ns | 0.00925 | 0 | 0 | 656 B |
| #4839 | StartFinishScope |
netcoreapp3.1 | 860ns | 0.378ns | 1.46ns | 0.00895 | 0 | 0 | 656 B |
| #4839 | StartFinishScope |
net472 | 966ns | 1.22ns | 4.73ns | 0.098 | 0 | 0 | 618 B |
Benchmarks.Trace.TraceAnnotationsBenchmark - Slower ⚠️ Same allocations ✔️
Slower ⚠️ in #4839
Benchmark
diff/base
Base Median (ns)
Diff Median (ns)
Modality
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0
1.152
569.26
655.91
| Benchmark | diff/base | Base Median (ns) | Diff Median (ns) | Modality |
|---|---|---|---|---|
| Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0 | 1.152 | 569.26 | 655.91 |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | RunOnMethodBegin |
net6.0 | 569ns | 0.162ns | 0.627ns | 0.00933 | 0 | 0 | 656 B |
| master | RunOnMethodBegin |
netcoreapp3.1 | 960ns | 0.758ns | 2.94ns | 0.00871 | 0 | 0 | 656 B |
| master | RunOnMethodBegin |
net472 | 1.06μs | 0.363ns | 1.41ns | 0.0978 | 0 | 0 | 618 B |
| #4839 | RunOnMethodBegin |
net6.0 | 656ns | 0.266ns | 1.03ns | 0.00919 | 0 | 0 | 656 B |
| #4839 | RunOnMethodBegin |
netcoreapp3.1 | 997ns | 0.778ns | 3.01ns | 0.00866 | 0 | 0 | 656 B |
| #4839 | RunOnMethodBegin |
net472 | 1.05μs | 0.38ns | 1.47ns | 0.098 | 0 | 0 | 618 B |
andrewlock
left a comment
There was a problem hiding this comment.
LGTM, this going to be a really fun one to update snapshots I expect 😄
The good news is it always appears to be after env: integration_tests, which should be standard across all snapshots, so 🤞 you should be able to regex replace this one
d6533cf to
69d9ecf
Compare
Throughput/Crank Report:zap:Throughput results for AspNetCoreSimpleController comparing the following branches/commits: Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red. Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards! gantt
title Throughput Linux x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (11.260M) : 0, 11260477
master (11.078M) : 0, 11078217
benchmarks/2.9.0 (11.015M) : 0, 11014948
section Automatic
This PR (4839) (7.684M) : 0, 7683640
master (7.478M) : 0, 7478193
benchmarks/2.9.0 (7.926M) : 0, 7925773
section Trace stats
This PR (4839) (7.987M) : 0, 7986988
master (7.957M) : 0, 7956885
section Manual
This PR (4839) (9.838M) : 0, 9838045
master (9.693M) : 0, 9692849
section Manual + Automatic
This PR (4839) (7.284M) : 0, 7284378
master (7.162M) : 0, 7161560
section Version Conflict
This PR (4839) (6.575M) : 0, 6575109
master (6.527M) : 0, 6527327
gantt
title Throughput Linux arm64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (9.709M) : 0, 9708513
master (9.511M) : 0, 9511060
benchmarks/2.9.0 (9.652M) : 0, 9651615
section Automatic
This PR (4839) (6.629M) : 0, 6629273
master (6.731M) : 0, 6730572
section Trace stats
This PR (4839) (6.817M) : 0, 6817056
master (6.843M) : 0, 6842643
section Manual
This PR (4839) (8.057M) : 0, 8056657
master (8.329M) : 0, 8329261
section Manual + Automatic
This PR (4839) (6.190M) : 0, 6189719
master (6.241M) : 0, 6241377
section Version Conflict
This PR (4839) (5.797M) : 0, 5796681
master (5.733M) : 0, 5732704
gantt
title Throughput Windows x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (9.802M) : 0, 9802365
master (10.008M) : 0, 10007628
benchmarks/2.9.0 (10.371M) : 0, 10371072
section Automatic
This PR (4839) (6.910M) : 0, 6909641
master (7.094M) : 0, 7093941
benchmarks/2.9.0 (7.518M) : 0, 7518013
section Trace stats
This PR (4839) (7.264M) : 0, 7264326
master (7.321M) : 0, 7320885
section Manual
This PR (4839) (8.803M) : 0, 8803299
master (8.839M) : 0, 8838799
section Manual + Automatic
This PR (4839) (6.662M) : 0, 6661743
master (6.905M) : 0, 6904693
section Version Conflict
This PR (4839) (6.105M) : 0, 6104730
master (6.177M) : 0, 6176842
gantt
title Throughput Linux x64 (ASM) (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (4839) (7.489M) : 0, 7488839
master (7.477M) : 0, 7476892
benchmarks/2.9.0 (7.958M) : 0, 7957509
section No attack
This PR (4839) (1.747M) : 0, 1747484
master (1.770M) : 0, 1770190
benchmarks/2.9.0 (3.247M) : 0, 3247318
section Attack
This PR (4839) (1.403M) : 0, 1402862
master (1.399M) : 0, 1398783
benchmarks/2.9.0 (2.539M) : 0, 2539306
section Blocking
This PR (4839) (3.091M) : 0, 3091176
master (3.092M) : 0, 3092380
section IAST default
This PR (4839) (6.399M) : 0, 6398599
master (6.527M) : 0, 6527052
section IAST full
This PR (4839) (5.588M) : 0, 5587507
master (5.701M) : 0, 5700591
section Base vuln
This PR (4839) (0.937M) : 0, 936853
master (0.938M) : 0, 937685
section IAST vuln
This PR (4839) (0.844M) : 0, 843810
master (0.865M) : 0, 864967
|
07e99e4 to
c28b88c
Compare
bouwkast
left a comment
There was a problem hiding this comment.
Looks good to me, I only skimmed a few of the snapshots as they looked the same
Datadog ReportBranch report: ❄️ New Flaky Tests (1)
|
language tag all spanslanguage tag all spans
cc7bb04 to
a5b9940
Compare
Datadog ReportBranch report: ❌ ❌ Failed Tests (18)
|
|
We're going to do this in v3 now right? If so, I suggest rebasing on |
a5b9940 to
fe8013a
Compare
Datadog ReportBranch report: ❌ ❌ Failed Tests (35)
|
89d9080 to
5aba9b1
Compare
Summary of changes
Add
language:dotnettag all spans.Reason for change
Spans without a
languagetag end up withlanguage:.NETlater in the pipeline. We want all spans to have a single value for this tag.Implementation details
Remove the check for
span.kind is not (client or producer)when adding thelanguagetag to spans.Test coverage
Other details