Bump test dependencies and add test.final_status to benchmark exporter#8301
Conversation
Co-Authored-By: Claude Opus 4.6 <[email protected]>
BenchmarksBenchmark execution time: 2026-03-13 17:34:00 Comparing candidate commit c513b52 in PR branch Found 9 performance improvements and 10 performance regressions! Performance is the same for 158 metrics, 15 unstable metrics. scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net6.0
scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net6.0
scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorMoreComplexBody net6.0
scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net6.0
scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net6.0
scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs netcoreapp3.1
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1
scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net6.0
scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net472
scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog netcoreapp3.1
scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1
scenario:Benchmarks.Trace.RedisBenchmark.SendReceive net6.0
scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net6.0
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes netcoreapp3.1
|
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing This PR (8301) and master. ✅ No regressions detected - check the details below Full Metrics ComparisonFakeDbCommand
HttpMessageHandler
Comparison explanationExecution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). Duration chartsFakeDbCommand (.NET Framework 4.8)gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (76ms) : 74, 78
master - mean (76ms) : 74, 79
section Bailout
This PR (8301) - mean (81ms) : 79, 82
master - mean (81ms) : 78, 83
section CallTarget+Inlining+NGEN
This PR (8301) - mean (1,111ms) : 1052, 1169
master - mean (1,114ms) : 1073, 1155
FakeDbCommand (.NET Core 3.1)gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (120ms) : 116, 124
master - mean (120ms) : 116, 124
section Bailout
This PR (8301) - mean (122ms) : 119, 125
master - mean (122ms) : 119, 126
section CallTarget+Inlining+NGEN
This PR (8301) - mean (769ms) : 742, 796
master - mean (775ms) : 751, 800
FakeDbCommand (.NET 6)gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (106ms) : 102, 109
master - mean (107ms) : 103, 110
section Bailout
This PR (8301) - mean (107ms) : 104, 110
master - mean (109ms) : 106, 111
section CallTarget+Inlining+NGEN
This PR (8301) - mean (729ms) : 707, 750
master - mean (732ms) : 704, 760
FakeDbCommand (.NET 8)gantt
title Execution time (ms) FakeDbCommand (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (105ms) : 103, 108
master - mean (107ms) : 96, 118
section Bailout
This PR (8301) - mean (106ms) : 104, 108
master - mean (107ms) : 104, 109
section CallTarget+Inlining+NGEN
This PR (8301) - mean (669ms) : 652, 686
master - mean (673ms) : 654, 693
HttpMessageHandler (.NET Framework 4.8)gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (195ms) : 190, 199
master - mean (199ms) : 189, 210
section Bailout
This PR (8301) - mean (198ms) : 195, 201
master - mean (202ms) : 196, 208
section CallTarget+Inlining+NGEN
This PR (8301) - mean (1,156ms) : 1094, 1218
master - mean (1,166ms) : 1102, 1231
HttpMessageHandler (.NET Core 3.1)gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (283ms) : 274, 293
master - mean (281ms) : 273, 290
section Bailout
This PR (8301) - mean (282ms) : 275, 288
master - mean (283ms) : 273, 293
section CallTarget+Inlining+NGEN
This PR (8301) - mean (899ms) : 874, 924
master - mean (913ms) : 882, 943
HttpMessageHandler (.NET 6)gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (273ms) : 268, 278
master - mean (273ms) : 267, 279
section Bailout
This PR (8301) - mean (272ms) : 268, 275
master - mean (274ms) : 268, 281
section CallTarget+Inlining+NGEN
This PR (8301) - mean (918ms) : 893, 944
master - mean (921ms) : 895, 948
HttpMessageHandler (.NET 8)gantt
title Execution time (ms) HttpMessageHandler (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8301) - mean (271ms) : 266, 276
master - mean (279ms) : 271, 286
section Bailout
This PR (8301) - mean (271ms) : 267, 275
master - mean (280ms) : 272, 288
section CallTarget+Inlining+NGEN
This PR (8301) - mean (823ms) : 804, 843
master - mean (833ms) : 810, 856
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Co-Authored-By: Claude Opus 4.6 <[email protected]>
Co-Authored-By: Claude Opus 4.6 <[email protected]>
Summary
DatadogTestCollectorfrom 0.0.52 to 0.0.53DatadogTestLoggerfrom 0.0.52 to 0.0.53test.final_statustag to the benchmark exporter (DatadogExporter)timeitsharpfrom 0.4.7 to 0.4.8Test plan
test.final_statustag correctly🤖 Generated with Claude Code