[Perf] Linux/arm64: 5 Regressions on 1/27/2023 2:26:56 PM

### Run Information

Architecture | arm64
-- | --
OS | ubuntu 20.04
Baseline | [f60d188f16f3843eddc0116ee47a7c0f85a08cb2](https://github.com/dotnet/runtime/commit/f60d188f16f3843eddc0116ee47a7c0f85a08cb2)
Compare | [ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7](https://github.com/dotnet/runtime/commit/ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7)
Diff | [Diff](https://github.com/dotnet/runtime/compare/f60d188f16f3843eddc0116ee47a7c0f85a08cb2...ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7)


### Regressions in System.Hashing

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[GetStringHashCode - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Hashing.GetStringHashCode(BytesCount%3a%2010).html>) | 4.31 ns | 5.93 ns | 1.38 | 0.17 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/02_02_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Hashing_1.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/02_02_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Hashing.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Hashing*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-e4ecf67c-a1d6-4565-972a-54a911feb88cb9216e27d9b4a48aa/c6aa0028-8818-4ddc-a530-c122b99c58e4.zip?sv=2021-08-06&se=2023-02-26T02%3A08%3A18Z&sr=c&sp=rl&sig=NdglI3TjYP0XvaqjUm%2Bh7Kzo9I%2BeLatKISRYkFyIjDM%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-70adfc2d-aa05-484d-8d62-71219cab667d8458cb5b4ee467fb1/f2173e0e-8071-470b-af1b-e8a5101b9dfc.zip?sv=2021-08-06&se=2023-02-26T21%3A01%3A56Z&sr=c&sp=rl&sig=6xrh%2BiRsa%2F%2FSVU6l7s5s85Ze%2FBsVhPZXgjhcD%2BloFAU%3D>)
### Histogram

#### System.Hashing.GetStringHashCode(BytesCount: 10)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.9349663563034 > 4.493280504769283.
IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 2/2/2023 2:17:49 AM falls between 1/24/2023 11:54:43 AM and 2/2/2023 2:17:49 AM.
IsRegressionStdDev: Marked as regression because -72.33306740231566 (T) = (0 -5.9194456174117756) / Math.Sqrt((0.008107597421865047 / (22)) + (0.0026408891834471923 / (17))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (17) - 2, .025) and -0.3882814163973431 = (4.263865774975956 - 5.9194456174117756) / 4.263865774975956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>
### Run Information

Architecture | arm64
-- | --
OS | ubuntu 20.04
Baseline | [f60d188f16f3843eddc0116ee47a7c0f85a08cb2](https://github.com/dotnet/runtime/commit/f60d188f16f3843eddc0116ee47a7c0f85a08cb2)
Compare | [ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7](https://github.com/dotnet/runtime/commit/ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7)
Diff | [Diff](https://github.com/dotnet/runtime/compare/f60d188f16f3843eddc0116ee47a7c0f85a08cb2...ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7)


### Regressions in System.Globalization.Tests.StringSearch

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(%2c%20None%2c%20False)).html>) | 7.69 ns | 8.81 ns | 1.15 | 0.60 | False | | |
[IsPrefix_DifferentFirstChar - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options%3a%20(en-US%2c%20Ordinal%2c%20False)).html>) | 6.05 ns | 8.15 ns | 1.35 | 0.42 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/02_02_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Globalization.Tests.StringSearch_1.png>)
![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/02_02_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Globalization.Tests.StringSearch_2.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/02_02_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Globalization.Tests.StringSearch.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringSearch*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-e4ecf67c-a1d6-4565-972a-54a911feb88cb9216e27d9b4a48aa/c6aa0028-8818-4ddc-a530-c122b99c58e4.zip?sv=2021-08-06&se=2023-02-26T02%3A08%3A18Z&sr=c&sp=rl&sig=NdglI3TjYP0XvaqjUm%2Bh7Kzo9I%2BeLatKISRYkFyIjDM%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-70adfc2d-aa05-484d-8d62-71219cab667d8458cb5b4ee467fb1/f2173e0e-8071-470b-af1b-e8a5101b9dfc.zip?sv=2021-08-06&se=2023-02-26T21%3A01%3A56Z&sr=c&sp=rl&sig=6xrh%2BiRsa%2F%2FSVU6l7s5s85Ze%2FBsVhPZXgjhcD%2BloFAU%3D>)
### Histogram

#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, None, False))

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.813453643175082 > 7.992300890003956.
IsChangePoint: Marked as a change because one of 11/14/2022 3:36:58 AM, 11/14/2022 7:25:10 PM, 1/27/2023 3:43:27 AM, 2/2/2023 2:17:49 AM falls between 1/24/2023 11:54:43 AM and 2/2/2023 2:17:49 AM.
IsRegressionStdDev: Marked as regression because -4.055596368892988 (T) = (0 -8.755802452278674) / Math.Sqrt((1.0393319274162365 / (22)) + (0.02257802373945518 / (17))) is less than -2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (17) - 2, .025) and -0.11368621572679055 = (7.862001278847333 - 8.755802452278674) / 7.862001278847333 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, Ordinal, False))

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.1548878509087 > 6.33305152028561.
IsChangePoint: Marked as a change because one of 12/17/2022 3:28:28 PM, 1/7/2023 2:04:07 AM, 1/31/2023 8:24:06 AM, 2/2/2023 2:17:49 AM falls between 1/24/2023 11:54:43 AM and 2/2/2023 2:17:49 AM.
IsRegressionStdDev: Marked as regression because -5.485274716996756 (T) = (0 -7.601167359486666) / Math.Sqrt((0.3170710389521432 / (36)) + (0.38969506275245686 / (4))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (36) + (4) - 2, .025) and -0.30753786929410126 = (5.813343948187366 - 7.601167359486666) / 5.813343948187366 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


### Run Information

Architecture | arm64
-- | --
OS | ubuntu 20.04
Baseline | [f60d188f16f3843eddc0116ee47a7c0f85a08cb2](https://github.com/dotnet/runtime/commit/f60d188f16f3843eddc0116ee47a7c0f85a08cb2)
Compare | [ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7](https://github.com/dotnet/runtime/commit/ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7)
Diff | [Diff](https://github.com/dotnet/runtime/compare/f60d188f16f3843eddc0116ee47a7c0f85a08cb2...ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7)


### Regressions in System.Collections.IterateForEach&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Dictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.Collections.IterateForEach(Int32).Dictionary(Size%3a%20512).html>) | 2.25 μs | 2.40 μs | 1.07 | 0.00 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/02_02_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Collections.IterateForEach(Int32)_1.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/02_02_2023/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.Collections.IterateForEach(Int32).html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-e4ecf67c-a1d6-4565-972a-54a911feb88cb9216e27d9b4a48aa/c6aa0028-8818-4ddc-a530-c122b99c58e4.zip?sv=2021-08-06&se=2023-02-26T02%3A08%3A18Z&sr=c&sp=rl&sig=NdglI3TjYP0XvaqjUm%2Bh7Kzo9I%2BeLatKISRYkFyIjDM%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-70adfc2d-aa05-484d-8d62-71219cab667d8458cb5b4ee467fb1/f2173e0e-8071-470b-af1b-e8a5101b9dfc.zip?sv=2021-08-06&se=2023-02-26T21%3A01%3A56Z&sr=c&sp=rl&sig=6xrh%2BiRsa%2F%2FSVU6l7s5s85Ze%2FBsVhPZXgjhcD%2BloFAU%3D>)
### Histogram

#### System.Collections.IterateForEach&lt;Int32&gt;.Dictionary(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.3998109775024368 > 2.3598939562945893.
IsChangePoint: Marked as a change because one of 11/14/2022 9:30:20 AM, 1/27/2023 3:43:27 AM, 2/2/2023 2:17:49 AM falls between 1/24/2023 11:54:43 AM and 2/2/2023 2:17:49 AM.
IsRegressionStdDev: Marked as regression because -27.07311900124489 (T) = (0 -2375.6129219666673) / Math.Sqrt((75.19406458414267 / (22)) + (288.80368289430686 / (18))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (18) - 2, .025) and -0.05293772756643626 = (2256.1760869346144 - 2375.6129219666673) / 2256.1760869346144 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>





Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Linux/arm64: 5 Regressions on 1/27/2023 2:26:56 PM #81551

Run Information

Regressions in System.Hashing

Repro

Payloads

Histogram

System.Hashing.GetStringHashCode(BytesCount: 10)

Description of detection logic

Docs

Regressions in System.Globalization.Tests.StringSearch

Repro

Payloads

Histogram

System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, None, False))

Description of detection logic

Description of detection logic

Docs

Run Information

Regressions in System.Collections.IterateForEach<Int32>

Repro

Payloads

Histogram

System.Collections.IterateForEach<Int32>.Dictionary(Size: 512)

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	arm64
OS	ubuntu 20.04
Baseline	f60d188f16f3843eddc0116ee47a7c0f85a08cb2
Compare	ddfaf2750e8dcf127a8baf0a3e5a2bd4835f79c7
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IsPrefix_DifferentFirstChar - Duration of single invocation	7.69 ns	8.81 ns	1.15	0.60	False
IsPrefix_DifferentFirstChar - Duration of single invocation	6.05 ns	8.15 ns	1.35	0.42	False

[Perf] Linux/arm64: 5 Regressions on 1/27/2023 2:26:56 PM #81551

Description

Run Information

Regressions in System.Hashing

Repro

Payloads

Histogram

System.Hashing.GetStringHashCode(BytesCount: 10)

Description of detection logic

Docs

Regressions in System.Globalization.Tests.StringSearch

Repro

Payloads

Histogram

System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, None, False))

Description of detection logic

Description of detection logic

Docs

Run Information

Regressions in System.Collections.IterateForEach<Int32>

Repro

Payloads

Histogram

System.Collections.IterateForEach<Int32>.Dictionary(Size: 512)

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions