[Perf] Windows/arm64: 8 Improvements on 8/16/2023 6:13:11 AM #20785
Description
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.19041 |
| Queue | SurfaceWindows |
| Baseline | 067a3572a555f1cdef7ca29a54efb7b38cfa086f |
| Compare | 2ed506c010b41c41c01997c81df977831f0fa217 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Memory.ReadOnlySequence
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 74.61 ns | 68.32 ns | 0.92 | 0.01 | False | ||||
| 14.89 ns | 13.72 ns | 0.92 | 0.10 | False | ||||
| 15.28 ns | 14.15 ns | 0.93 | 0.10 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'Details
Payloads
System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Multiple)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 68.32249766558556 < 70.81392757189643.
IsChangePoint: Marked as a change because one of 4/1/2023 3:05:46 AM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 53.707778257375516 (T) = (0 -68.03198107130243) / Math.Sqrt((0.42331431832916216 / (299)) + (0.1429541780222461 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.0808423956014771 = (74.01557768302543 - 68.03198107130243) / 74.01557768302543 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Multiple)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.720484194246996 < 14.041309699988387.
IsChangePoint: Marked as a change because one of 4/3/2023 6:15:03 PM, 5/19/2023 4:22:12 AM, 8/3/2023 11:36:41 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 9.198036419455018 (T) = (0 -13.693393165564704) / Math.Sqrt((0.13730825302920255 / (299)) + (0.10483162606961899 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.05839226307505668 = (14.542566536553661 - 13.693393165564704) / 14.542566536553661 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Multiple)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.150065589029635 < 14.51765301882002.
IsChangePoint: Marked as a change because one of 5/10/2023 2:36:50 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 22.246070324518016 (T) = (0 -14.26720548630663) / Math.Sqrt((0.1516771841265255 / (299)) + (0.040207183155083745 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.08555254766122566 = (15.601995992024563 - 14.26720548630663) / 15.601995992024563 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.19041 |
| Queue | SurfaceWindows |
| Baseline | 067a3572a555f1cdef7ca29a54efb7b38cfa086f |
| Compare | 2ed506c010b41c41c01997c81df977831f0fa217 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in PerfLabTests.CastingPerf2.CastingPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 190.99 μs | 159.19 μs | 0.83 | 0.00 | True | ||||
| 477.68 μs | 446.22 μs | 0.93 | 0.08 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'Details
Payloads
PerfLabTests.CastingPerf2.CastingPerf.IntObj
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 159.1921875 < 181.50767727841898.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 1659.798448870265 (T) = (0 -159253.7368646057) / Math.Sqrt((13897.372599238026 / (299)) + (4195.645174467447 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.16685197436351562 = (191146.9894475758 - 159253.7368646057) / 191146.9894475758 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 446.22255494505487 < 453.87516200113726.
IsChangePoint: Marked as a change because one of 4/11/2023 2:19:19 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 33.65117202433701 (T) = (0 -451897.32817383483) / Math.Sqrt((56984111.73175929 / (299)) + (6365251.8474338455 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.05786266082287072 = (479651.2242774772 - 451897.32817383483) / 479651.2242774772 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.19041 |
| Queue | SurfaceWindows |
| Baseline | 067a3572a555f1cdef7ca29a54efb7b38cfa086f |
| Compare | 2ed506c010b41c41c01997c81df977831f0fa217 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in PerfLabTests.CastingPerf
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 318.36 μs | 286.62 μs | 0.90 | 0.10 | False | ||||
| 318.89 μs | 286.52 μs | 0.90 | 0.06 | True | ||||
| 318.43 μs | 286.93 μs | 0.90 | 0.08 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf*'Details
Payloads
PerfLabTests.CastingPerf.ScalarValueTypeObj
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 286.6180587121212 < 302.49360026552694.
IsChangePoint: Marked as a change because one of 3/22/2023 9:02:35 AM, 3/23/2023 3:52:33 AM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 23.974507295690596 (T) = (0 -286691.1880727446) / Math.Sqrt((735729798.6946676 / (299)) + (54788.917890415556 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.11605309159182856 = (324330.7775000012 - 286691.1880727446) / 324330.7775000012 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
PerfLabTests.CastingPerf.FooObjIsFoo
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 286.52122159090914 < 302.536247695292.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 26.777409484667174 (T) = (0 -286717.0611840083) / Math.Sqrt((553382229.3784314 / (299)) + (40660.36181081947 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.11281639072209979 = (323176.68877739314 - 286717.0611840083) / 323176.68877739314 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
PerfLabTests.CastingPerf.IntObj
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 286.93449810606063 < 302.75452512448487.
IsChangePoint: Marked as a change because one of 5/19/2023 9:46:56 PM, 5/20/2023 7:49:01 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 25.287866509598047 (T) = (0 -286785.5747481759) / Math.Sqrt((630594835.206264 / (299)) + (132239.61361994667 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.1137602549942791 = (323598.18701916223 - 286785.5747481759) / 323598.18701916223 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository