Skip to content

[Perf] Changes at 2/23/2022 8:21:20 AM #3829

@performanceautofiler

Description

@performanceautofiler

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 59f90aa6ee01a27e73d2610459470d730bd34bd6
Compare 05920e13af192144c3e9670f4616055f04e5f19a
Diff Diff

Improvements in System.Text.Perf_Utf8Encoding

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
GetByteCount - Duration of single invocation 31.06 μs 25.27 μs 0.81 0.00 True

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Perf_Utf8Encoding*'
Details

Payloads

Baseline
Compare

Histogram

System.Text.Perf_Utf8Encoding.GetByteCount(Input: Chinese)


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.27140256588072 < 29.488678234947127.
IsChangePoint: Marked as a change because one of 12/2/2021 4:22:41 PM, 2/23/2022 2:01:04 AM, 3/2/2022 11:33:11 PM falls between 2/22/2022 9:40:20 AM and 3/2/2022 11:33:11 PM.
IsImprovementStdDev: Marked as improvement because 330.63424834198946 (T) = (0 -25277.775869611833) / Math.Sqrt((85774.40350460469 / (299)) + (189.0346934698752 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.1843765944382053 = (30991.96969733931 - 25277.775869611833) / 30991.96969733931 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture arm64
OS Windows 10.0.19041
Baseline 59f90aa6ee01a27e73d2610459470d730bd34bd6
Compare 05920e13af192144c3e9670f4616055f04e5f19a
Diff Diff

Improvements in System.Collections.ContainsFalse<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
ImmutableArray - Duration of single invocation 96.46 μs 68.15 μs 0.71 0.16 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsFalse<Int32>.ImmutableArray(Size: 512)


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 68.15128687888199 < 91.61663133818342.
IsChangePoint: Marked as a change because one of 11/22/2021 3:34:51 PM, 2/23/2022 2:01:04 AM, 3/2/2022 11:33:11 PM falls between 2/22/2022 9:40:20 AM and 3/2/2022 11:33:11 PM.
IsImprovementStdDev: Marked as improvement because 97.95591857739407 (T) = (0 -68664.19202541842) / Math.Sqrt((9051125.720094832 / (299)) + (523395.247122718 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.2636367547467653 = (93247.71771003435 - 68664.19202541842) / 93247.71771003435 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 59f90aa6ee01a27e73d2610459470d730bd34bd6
Compare 05920e13af192144c3e9670f4616055f04e5f19a
Diff Diff

Improvements in System.Text.Tests.Perf_Encoding

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
GetBytes - Duration of single invocation 208.63 ns 158.27 ns 0.76 0.00 True

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_Encoding*'
Details

Payloads

Baseline
Compare

Histogram

System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "utf-8")


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 158.26671248265725 < 196.8850993656884.
IsChangePoint: Marked as a change because one of 2/23/2022 2:01:04 AM, 3/2/2022 11:33:11 PM falls between 2/22/2022 9:40:20 AM and 3/2/2022 11:33:11 PM.
IsImprovementStdDev: Marked as improvement because 140.57947959533803 (T) = (0 -155.2194331969516) / Math.Sqrt((6.781366532625207 / (299)) + (2.020259664231919 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.25900409432197397 = (209.4740767223575 - 155.2194331969516) / 209.4740767223575 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 59f90aa6ee01a27e73d2610459470d730bd34bd6
Compare 05920e13af192144c3e9670f4616055f04e5f19a
Diff Diff

Improvements in SIMD.ConsoleMandel

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
VectorDoubleSinglethreadADT - Duration of single invocation 575.76 ms 515.73 ms 0.90 0.00 True
VectorDoubleSinglethreadRaw - Duration of single invocation 568.52 ms 511.02 ms 0.90 0.00 True

graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'SIMD.ConsoleMandel*'
Details

Payloads

Baseline
Compare

Histogram

SIMD.ConsoleMandel.VectorDoubleSinglethreadADT


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 515.7250571428572 < 546.9745674358974.
IsChangePoint: Marked as a change because one of 1/11/2022 6:41:22 PM, 2/23/2022 2:01:04 AM, 3/2/2022 11:33:11 PM falls between 2/22/2022 9:40:20 AM and 3/2/2022 11:33:11 PM.
IsImprovementStdDev: Marked as improvement because 149.37012631357385 (T) = (0 -516197102.1749084) / Math.Sqrt((36869400918809.3 / (299)) + (41998921827.173546 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.0931251497489741 = (569204341.7369258 - 516197102.1749084) / 569204341.7369258 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### SIMD.ConsoleMandel.VectorDoubleSinglethreadRaw

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 511.0246333333333 < 540.6577675128206.
IsChangePoint: Marked as a change because one of 1/11/2022 6:41:22 PM, 2/23/2022 2:01:04 AM, 3/2/2022 11:33:11 PM falls between 2/22/2022 9:40:20 AM and 3/2/2022 11:33:11 PM.
IsImprovementStdDev: Marked as improvement because 155.24767080695324 (T) = (0 -511082132.99221605) / Math.Sqrt((54040632374573.055 / (299)) + (31277033743.34053 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.11491576564939182 = (577438974.9097725 - 511082132.99221605) / 577438974.9097725 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 59f90aa6ee01a27e73d2610459470d730bd34bd6
Compare 05920e13af192144c3e9670f4616055f04e5f19a
Diff Diff

Improvements in System.Memory.Span<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
IndexOfValue - Duration of single invocation 83.02 ns 60.96 ns 0.73 0.12 True

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Int32>.IndexOfValue(Size: 512)


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 60.9583910201218 < 82.65539164573113.
IsChangePoint: Marked as a change because one of 11/22/2021 3:34:51 PM, 2/23/2022 2:01:04 AM, 3/2/2022 11:33:11 PM falls between 2/22/2022 9:40:20 AM and 3/2/2022 11:33:11 PM.
IsImprovementStdDev: Marked as improvement because 103.363239108507 (T) = (0 -61.183101401259115) / Math.Sqrt((6.44535528420062 / (299)) + (0.5232622046074216 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.28239687150946047 = (85.26036045851174 - 61.183101401259115) / 85.26036045851174 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 59f90aa6ee01a27e73d2610459470d730bd34bd6
Compare 05920e13af192144c3e9670f4616055f04e5f19a
Diff Diff

Improvements in System.Memory.Span<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
LastIndexOfValue - Duration of single invocation 25.23 ns 16.20 ns 0.64 0.37 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span&lt;Byte&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Byte>.LastIndexOfValue(Size: 512)


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.199095278134394 < 23.94203034135299.
IsChangePoint: Marked as a change because one of 1/28/2022 8:15:35 PM, 2/23/2022 2:01:04 AM, 3/2/2022 11:33:11 PM falls between 2/22/2022 9:40:20 AM and 3/2/2022 11:33:11 PM.
IsImprovementStdDev: Marked as improvement because 29.15615508425939 (T) = (0 -17.78926410019949) / Math.Sqrt((1.7935222978938357 / (299)) + (1.0645432123869998 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.30623290300038564 = (25.641550568099913 - 17.78926410019949) / 25.641550568099913 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions