[CI] Add net10.0 to AWS Lambda test runtimes#8819
Conversation
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing This PR (8819) and master. ✅ No regressions detected - check the details below Full Metrics ComparisonFakeDbCommand
HttpMessageHandler
Comparison explanationExecution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). Duration chartsFakeDbCommand (.NET Framework 4.8)gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (73ms) : 69, 76
master - mean (70ms) : 69, 72
section Bailout
This PR (8819) - mean (76ms) : 73, 79
master - mean (74ms) : 72, 76
section CallTarget+Inlining+NGEN
This PR (8819) - mean (1,078ms) : 1034, 1122
master - mean (1,083ms) : 1035, 1131
FakeDbCommand (.NET Core 3.1)gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (113ms) : 107, 119
master - mean (109ms) : 106, 112
section Bailout
This PR (8819) - mean (110ms) : 107, 114
master - mean (110ms) : 108, 112
section CallTarget+Inlining+NGEN
This PR (8819) - mean (774ms) : 756, 791
master - mean (774ms) : 753, 795
FakeDbCommand (.NET 6)gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (99ms) : 95, 104
master - mean (96ms) : 93, 99
section Bailout
This PR (8819) - mean (99ms) : 95, 103
master - mean (101ms) : 95, 106
section CallTarget+Inlining+NGEN
This PR (8819) - mean (933ms) : 895, 971
master - mean (935ms) : 889, 980
FakeDbCommand (.NET 8)gantt
title Execution time (ms) FakeDbCommand (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (95ms) : 93, 97
master - mean (97ms) : 91, 104
section Bailout
This PR (8819) - mean (99ms) : 93, 104
master - mean (96ms) : 94, 97
section CallTarget+Inlining+NGEN
This PR (8819) - mean (812ms) : 772, 852
master - mean (812ms) : 765, 859
HttpMessageHandler (.NET Framework 4.8)gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (202ms) : 198, 207
master - mean (204ms) : 197, 211
section Bailout
This PR (8819) - mean (205ms) : 200, 209
master - mean (207ms) : 202, 212
section CallTarget+Inlining+NGEN
This PR (8819) - mean (1,211ms) : 1159, 1263
master - mean (1,213ms) : 1168, 1258
HttpMessageHandler (.NET Core 3.1)gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (290ms) : 283, 297
master - mean (294ms) : 288, 301
section Bailout
This PR (8819) - mean (291ms) : 285, 297
master - mean (295ms) : 289, 300
section CallTarget+Inlining+NGEN
This PR (8819) - mean (973ms) : 953, 993
master - mean (983ms) : 962, 1003
HttpMessageHandler (.NET 6)gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (284ms) : 279, 289
master - mean (289ms) : 283, 294
section Bailout
This PR (8819) - mean (284ms) : 277, 291
master - mean (288ms) : 283, 292
section CallTarget+Inlining+NGEN
This PR (8819) - mean (1,167ms) : 1133, 1201
master - mean (1,171ms) : 1132, 1211
HttpMessageHandler (.NET 8)gantt
title Execution time (ms) HttpMessageHandler (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8819) - mean (281ms) : 274, 288
master - mean (282ms) : 276, 287
section Bailout
This PR (8819) - mean (282ms) : 276, 287
master - mean (282ms) : 276, 289
section CallTarget+Inlining+NGEN
This PR (8819) - mean (1,045ms) : 1003, 1088
master - mean (1,047ms) : 1001, 1094
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
andrewlock
left a comment
There was a problem hiding this comment.
We no longer support net6.0 and net7.0, but customers still use it, right? Can those customers actually update their lambda layers, or are they now locked on the old version unless they update their runtimes? If they can't update, this looks good. If they can update, we probably should keep testing those older runtimes for now (like we do across all our other "unsupported" runtimes)
| net10: | ||
| publishTargetFramework: "net10.0" | ||
| lambdaBaseImage: "public.ecr.aws/lambda/dotnet:10" |
There was a problem hiding this comment.
We'll need to update the VMs with the new image. I'll add it to the script
BenchmarksBenchmark execution time: 2026-06-26 16:01:22 Comparing candidate commit d29fa5b in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 72 metrics, 0 unstable metrics, 59 known flaky benchmarks, 67 flaky benchmarks without significant changes.
|
Thanks. AWS isn't blocking those until Feb-March 2027, so I restored those. This PR is now only adding |
Summary of changes
Add
net10.0to the .NET TFMs used in AWS Lambda tests.Reason for change
We support .NET 10, so the AWS Lambda tests should run against it.
Implementation details
net10matrix entry (net10.0TFM,public.ecr.aws/lambda/dotnet:10base image) to the AWS Lambda test stage inultimate-pipeline.ymlnet6/net7/net8/net9entries are unchangedTest coverage
This PR adds a runtime version that the existing AWS Lambda tests run on.
Other details
n/a