[Perf] Windows/x64: 2 Regressions on 11/1/2022 1:15:18 PM

### Run Information

Architecture | x64
-- | --
OS | Windows 10.0.19042
Baseline | [7d2de493f4407377faba16364b345660a77dca63](https://github.com/dotnet/runtime/commit/7d2de493f4407377faba16364b345660a77dca63)
Compare | [7ba371c7c5a7cec915d025d983d2ccedb839cc34](https://github.com/dotnet/runtime/commit/7ba371c7c5a7cec915d025d983d2ccedb839cc34)
Diff | [Diff](https://github.com/dotnet/runtime/compare/7d2de493f4407377faba16364b345660a77dca63...7ba371c7c5a7cec915d025d983d2ccedb839cc34)


### Regressions in System.Collections.ContainsKeyFalse&lt;String, String&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[SortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.ContainsKeyFalse(String%2c%20String).SortedDictionary(Size%3a%20512).html>) | 301.96 μs | 339.81 μs | 1.13 | 0.04 | False | | |
[ImmutableSortedDictionary - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.ContainsKeyFalse(String%2c%20String).ImmutableSortedDictionary(Size%3a%20512).html>) | 290.29 μs | 311.25 μs | 1.07 | 0.04 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_08_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/System.Collections.ContainsKeyFalse(String,%20String)_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_08_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/System.Collections.ContainsKeyFalse(String,%20String)_2.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_08_2022/refs/heads/main_x64_Windows%2010.0.19042/amd_Regression/System.Collections.ContainsKeyFalse(String,%20String).html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;String, String&gt;*'
```

### Related Issues

#### Regressions

* [[Perf] Windows/arm64: 1 Regression on 11/1/2022 1:15:18 PM](<https://github.com/dotnet/perf-autofiling-issues/issues/9464>)
#### Improvements
* [[Perf] Windows/arm64: 1 Improvement on 11/1/2022 1:15:18 PM](<https://github.com/dotnet/perf-autofiling-issues/issues/9467>)

<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-42ca7bf4-58f1-46b2-925c-195f5e8f38f2d16e899bca4421da4/65066d3d-f25c-4557-9860-8c76bbaa5025.zip?sv=2021-08-06&se=2022-12-01T08%3A24%3A02Z&sr=c&sp=rl&sig=mJPib1P4USB40ZHWHZYFInYsq07PbJRppNhPijWBoIQ%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-83660a46-e04d-44e8-abd4-8a830554dd1fc9b94b78c1b484191/d3ba4f80-b91e-4fd8-9b8e-dc09700fe28e.zip?sv=2021-08-06&se=2022-12-01T17%3A54%3A34Z&sr=c&sp=rl&sig=xnc8yvG0QolbrHPGuEEIX3SPuXoxzcSaq4GjOtgkha4%3D>)
### Histogram

### Edge Detector Info

[Collection Data](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/reports/11_08_2022/refs/heads/main_x64_Windows 10.0.19042/amd/System.Collections.ContainsKeyFalse-String, String-.ImmutableSortedDictionary(Size- 512).txt?sv=2018-03-28&sr=c&sig=JoytaT70%2ByX0ce090BDZwAg8TDntVqLeANIlSNxVryw%3D&se=2022-11-24T00%3A17%3A57Z&sp=racwdl>)
#### System.Collections.ContainsKeyFalse&lt;String, String&gt;.SortedDictionary(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 339.8119662267081 > 318.7910558894231.
IsChangePoint: Marked as a change because one of 9/23/2022 1:16:35 AM, 10/11/2022 8:42:28 PM, 10/26/2022 4:56:52 PM, 10/27/2022 9:35:54 AM, 11/1/2022 10:15:31 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -11.314044762999258 (T) = (0 -339440.83251085784) / Math.Sqrt((119839738.15851592 / (23)) + (19161793.93681896 / (7))) is less than -2.048407141790485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (7) - 2, .025) and -0.10371322413414204 = (307544.4101679108 - 339440.83251085784) / 307544.4101679108 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyFalse&lt;String, String&gt;.ImmutableSortedDictionary(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 311.25481209150325 > 301.1426729166667.
IsChangePoint: Marked as a change because one of 10/6/2022 2:13:23 PM, 10/7/2022 9:25:17 PM, 11/1/2022 4:32:17 PM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -7.935245098261172 (T) = (0 -306916.53590383584) / Math.Sqrt((40234119.00838339 / (25)) + (77355954.97085167 / (23))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (23) - 2, .025) and -0.061182143211994146 = (289221.3536263045 - 306916.53590383584) / 289221.3536263045 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Windows/x64: 2 Regressions on 11/1/2022 1:15:18 PM #9574

Run Information

Regressions in System.Collections.ContainsKeyFalse<String, String>

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Collections.ContainsKeyFalse<String, String>.SortedDictionary(Size: 512)

Description of detection logic

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	x64
OS	Windows 10.0.19042
Baseline	7d2de493f4407377faba16364b345660a77dca63
Compare	7ba371c7c5a7cec915d025d983d2ccedb839cc34
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SortedDictionary - Duration of single invocation	301.96 μs	339.81 μs	1.13	0.04	False
ImmutableSortedDictionary - Duration of single invocation	290.29 μs	311.25 μs	1.07	0.04	False

[Perf] Windows/x64: 2 Regressions on 11/1/2022 1:15:18 PM #9574

Description

Run Information

Regressions in System.Collections.ContainsKeyFalse<String, String>

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Collections.ContainsKeyFalse<String, String>.SortedDictionary(Size: 512)

Description of detection logic

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions