-
Notifications
You must be signed in to change notification settings - Fork 3
Description
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | 1eb702ce1efe3581488a37704cee47603a291069 |
| Compare | 2ed506c010b41c41c01997c81df977831f0fa217 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Memory.ReadOnlySequence
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 78.00 ns | 70.97 ns | 0.91 | 0.01 | False | ||||
| 16.31 ns | 15.04 ns | 0.92 | 0.15 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'Details
Payloads
System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Multiple)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 70.9675078740011 < 74.17207532211717.
IsChangePoint: Marked as a change because one of 3/30/2023 5:15:39 PM, 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 53.44766461497719 (T) = (0 -71.40036633129068) / Math.Sqrt((0.710580271976168 / (299)) + (0.14319416325351939 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08218519725011607 = (77.79387096107686 - 71.40036633129068) / 77.79387096107686 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Multiple)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 15.03862358351022 < 15.476501023514638.
IsChangePoint: Marked as a change because one of 5/20/2023 6:43:26 AM, 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 14.390592444469052 (T) = (0 -15.029865462873703) / Math.Sqrt((0.1688622722015428 / (299)) + (0.09915503617153498 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0825346746357677 = (16.38194387009326 - 15.029865462873703) / 16.38194387009326 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | 1eb702ce1efe3581488a37704cee47603a291069 |
| Compare | 2ed506c010b41c41c01997c81df977831f0fa217 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in PerfLabTests.CastingPerf2.CastingPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 200.19 μs | 166.82 μs | 0.83 | 0.00 | True | ||||
| 500.48 μs | 467.12 μs | 0.93 | 0.02 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'Details
Payloads
PerfLabTests.CastingPerf2.CastingPerf.IntObj
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 166.82075690466448 < 190.1816348429893.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 28201.312740240213 (T) = (0 -166823.18739901777) / Math.Sqrt((104.33808340529421 / (299)) + (12.611175930344501 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16667612652388217 = (200190.0974025062 - 166823.18739901777) / 200190.0974025062 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 467.1150393099548 < 475.4541717198525.
IsChangePoint: Marked as a change because one of 5/9/2023 11:02:55 PM, 5/11/2023 10:01:37 AM, 8/16/2023 6:13:11 AM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 106.70820066556858 (T) = (0 -467520.76626194414) / Math.Sqrt((24927014.085984003 / (299)) + (169384.20277484859 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06692930009633684 = (501056.1003686155 - 467520.76626194414) / 501056.1003686155 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | 1eb702ce1efe3581488a37704cee47603a291069 |
| Compare | 2ed506c010b41c41c01997c81df977831f0fa217 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in PerfLabTests.LowLevelPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 367.01 μs | 233.56 μs | 0.64 | 0.50 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'Details
Payloads
PerfLabTests.LowLevelPerf.StaticDelegate
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 233.56112966417908 < 285.288722935468.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 20.794494124396525 (T) = (0 -233564.30699000417) / Math.Sqrt((4321875866.6362 / (299)) + (112.55217197818334 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.252888028657919 = (312622.8944912219 - 233564.30699000417) / 312622.8944912219 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | 1eb702ce1efe3581488a37704cee47603a291069 |
| Compare | 2ed506c010b41c41c01997c81df977831f0fa217 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in PerfLabTests.DelegatePerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 342.00 ms | 309.23 ms | 0.90 | 0.50 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.DelegatePerf*'Details
Payloads
PerfLabTests.DelegatePerf.MulticastDelegateCombineInvoke
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 309.23377725 < 341.09923290961535.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 9.499982750381408 (T) = (0 -315711726.30792123) / Math.Sqrt((320085786768962.94 / (299)) + (226494620638994.88 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11846485988350715 = (358138560.7228325 - 315711726.30792123) / 358138560.7228325 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository





