Skip to content

[Perf] Linux/arm64: 6 Improvements on 8/16/2023 6:13:11 AM #20799

@performanceautofiler

Description

@performanceautofiler

Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline 1eb702ce1efe3581488a37704cee47603a291069
Compare 2ed506c010b41c41c01997c81df977831f0fa217
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Memory.ReadOnlySequence

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
78.00 ns 70.97 ns 0.91 0.01 False
16.31 ns 15.04 ns 0.92 0.15 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'
Details

Payloads

Baseline
Compare

System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Multiple)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 70.9675078740011 < 74.17207532211717.
IsChangePoint: Marked as a change because one of 3/30/2023 5:15:39 PM, 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 53.44766461497719 (T) = (0 -71.40036633129068) / Math.Sqrt((0.710580271976168 / (299)) + (0.14319416325351939 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.08218519725011607 = (77.79387096107686 - 71.40036633129068) / 77.79387096107686 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Multiple)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 15.03862358351022 < 15.476501023514638.
IsChangePoint: Marked as a change because one of 5/20/2023 6:43:26 AM, 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 14.390592444469052 (T) = (0 -15.029865462873703) / Math.Sqrt((0.1688622722015428 / (299)) + (0.09915503617153498 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.0825346746357677 = (16.38194387009326 - 15.029865462873703) / 16.38194387009326 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline 1eb702ce1efe3581488a37704cee47603a291069
Compare 2ed506c010b41c41c01997c81df977831f0fa217
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in PerfLabTests.CastingPerf2.CastingPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
200.19 μs 166.82 μs 0.83 0.00 True
500.48 μs 467.12 μs 0.93 0.02 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'
Details

Payloads

Baseline
Compare

PerfLabTests.CastingPerf2.CastingPerf.IntObj

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 166.82075690466448 < 190.1816348429893.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 28201.312740240213 (T) = (0 -166823.18739901777) / Math.Sqrt((104.33808340529421 / (299)) + (12.611175930344501 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.16667612652388217 = (200190.0974025062 - 166823.18739901777) / 200190.0974025062 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 467.1150393099548 < 475.4541717198525.
IsChangePoint: Marked as a change because one of 5/9/2023 11:02:55 PM, 5/11/2023 10:01:37 AM, 8/16/2023 6:13:11 AM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 106.70820066556858 (T) = (0 -467520.76626194414) / Math.Sqrt((24927014.085984003 / (299)) + (169384.20277484859 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.06692930009633684 = (501056.1003686155 - 467520.76626194414) / 501056.1003686155 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline 1eb702ce1efe3581488a37704cee47603a291069
Compare 2ed506c010b41c41c01997c81df977831f0fa217
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in PerfLabTests.LowLevelPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
367.01 μs 233.56 μs 0.64 0.50 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'
Details

Payloads

Baseline
Compare

PerfLabTests.LowLevelPerf.StaticDelegate

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 233.56112966417908 < 285.288722935468.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 20.794494124396525 (T) = (0 -233564.30699000417) / Math.Sqrt((4321875866.6362 / (299)) + (112.55217197818334 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.252888028657919 = (312622.8944912219 - 233564.30699000417) / 312622.8944912219 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline 1eb702ce1efe3581488a37704cee47603a291069
Compare 2ed506c010b41c41c01997c81df977831f0fa217
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in PerfLabTests.DelegatePerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
342.00 ms 309.23 ms 0.90 0.50 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.DelegatePerf*'
Details

Payloads

Baseline
Compare

PerfLabTests.DelegatePerf.MulticastDelegateCombineInvoke

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 309.23377725 < 341.09923290961535.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 5:32:05 AM falls between 8/14/2023 7:19:10 AM and 8/23/2023 5:32:05 AM.
IsImprovementStdDev: Marked as improvement because 9.499982750381408 (T) = (0 -315711726.30792123) / Math.Sqrt((320085786768962.94 / (299)) + (226494620638994.88 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.11846485988350715 = (358138560.7228325 - 315711726.30792123) / 358138560.7228325 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions