[Perf] Changes at 11/22/2021 8:11:44 PM

### Run Information

Architecture | x64
-- | --
OS | alpine 3.12
Baseline | [f45dfdc2244166da0248c4a0fabad19a8bfcea1a](https://github.com/dotnet/runtime/commit/f45dfdc2244166da0248c4a0fabad19a8bfcea1a)
Compare | [48fe63793040eaee87bdb26ee7d19636527efa3b](https://github.com/dotnet/runtime/commit/48fe63793040eaee87bdb26ee7d19636527efa3b)
Diff | [Diff](https://github.com/dotnet/runtime/compare/f45dfdc2244166da0248c4a0fabad19a8bfcea1a...48fe63793040eaee87bdb26ee7d19636527efa3b)


### Improvements in System.Collections.ContainsFalse&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[ImmutableArray - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.12/System.Collections.ContainsFalse(Int32).ImmutableArray(Size%3a%20512).html>) | 38.90 μs | 22.24 μs | 0.57 | 0.13 | False | | |
[Array - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.12/System.Collections.ContainsFalse(Int32).Array(Size%3a%20512).html>) | 40.28 μs | 18.81 μs | 0.47 | 0.09 | False | | |
[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.12/System.Collections.ContainsFalse(Int32).Span(Size%3a%20512).html>) | 36.32 μs | 17.78 μs | 0.49 | 0.07 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_alpine%203.12_Improvement/System.Collections.ContainsFalse(Int32)_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_alpine%203.12_Improvement/System.Collections.ContainsFalse(Int32)_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_alpine%203.12_Improvement/System.Collections.ContainsFalse(Int32)_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_alpine%203.12_Improvement/System.Collections.ContainsFalse(Int32).html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-a00ebab0-2827-49b0-b460-180ce5465528a216e4b267047d091/1f9d1fd7-bbcc-4574-a3af-b55f43f35895.zip?sv=2019-07-07&se=2021-12-22T17%3A09%3A08Z&sr=c&sp=rl&sig=MHvJt2NM3KCri9Ftkx0TWDdcYiUUGBo5bG3%2FUygVyTc%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-f397e695-3304-4691-b8d8-4f3ec0efae32bd9fad35bf4476587/7492930b-4ddb-4078-a063-8caff2fb0fc6.zip?sv=2019-07-07&se=2021-12-23T01%3A39%3A18Z&sr=c&sp=rl&sig=MpdDB5M6qYrGGHMXqgYrw7a0U2oWii5pAKZIePGSZLE%3D>)
### Histogram

#### System.Collections.ContainsFalse&lt;Int32&gt;.ImmutableArray(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 22.238306160411426 < 36.97994862314173.
IsChangePoint: Marked as a change because one of 11/22/2021 6:07:11 PM, 11/23/2021 6:42:08 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 6:42:08 AM.
IsImprovementStdDev: Marked as improvement because 371.34392078607164 (T) = (0 -22236.159055871227) / Math.Sqrt((637318.6110205639 / (299)) + (9.220115813090674 / (2))) is greater than 1.9679296690655894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (2) - 2, .975) and 0.4356155851795846 = (39398.96012710888 - 22236.159055871227) / 39398.96012710888 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsFalse&lt;Int32&gt;.Array(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.814560989520658 < 35.8563517237025.
IsChangePoint: Marked as a change because one of 11/22/2021 6:07:11 PM, 11/23/2021 6:42:08 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 6:42:08 AM.
IsImprovementStdDev: Marked as improvement because 380.9128834654921 (T) = (0 -18820.121939266483) / Math.Sqrt((749990.6289880677 / (299)) + (61.848324151170544 / (2))) is greater than 1.9679296690655894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (2) - 2, .975) and 0.5049252450013874 = (38014.70737347378 - 18820.121939266483) / 38014.70737347378 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsFalse&lt;Int32&gt;.Span(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 17.7808710072635 < 35.65414976426354.
IsChangePoint: Marked as a change because one of 11/22/2021 6:07:11 PM, 11/23/2021 6:42:08 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 6:42:08 AM.
IsImprovementStdDev: Marked as improvement because 452.2803137030013 (T) = (0 -17782.701920928193) / Math.Sqrt((510767.6624360083 / (299)) + (6.704489695106301 / (2))) is greater than 1.9679296690655894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (2) - 2, .975) and 0.5127257957251296 = (36494.24033720653 - 17782.701920928193) / 36494.24033720653 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>
### Run Information

Architecture | x64
-- | --
OS | alpine 3.12
Baseline | [f45dfdc2244166da0248c4a0fabad19a8bfcea1a](https://github.com/dotnet/runtime/commit/f45dfdc2244166da0248c4a0fabad19a8bfcea1a)
Compare | [48fe63793040eaee87bdb26ee7d19636527efa3b](https://github.com/dotnet/runtime/commit/48fe63793040eaee87bdb26ee7d19636527efa3b)
Diff | [Diff](https://github.com/dotnet/runtime/compare/f45dfdc2244166da0248c4a0fabad19a8bfcea1a...48fe63793040eaee87bdb26ee7d19636527efa3b)


### Improvements in System.Collections.ContainsTrue&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Queue - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.12/System.Collections.ContainsTrue(Int32).Queue(Size%3a%20512).html>) | 23.68 μs | 16.17 μs | 0.68 | 0.01 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_alpine%203.12_Improvement/System.Collections.ContainsTrue(Int32)_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_alpine%203.12_Improvement/System.Collections.ContainsTrue(Int32).html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsTrue&lt;Int32&gt;*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-a00ebab0-2827-49b0-b460-180ce5465528a216e4b267047d091/1f9d1fd7-bbcc-4574-a3af-b55f43f35895.zip?sv=2019-07-07&se=2021-12-22T17%3A09%3A08Z&sr=c&sp=rl&sig=MHvJt2NM3KCri9Ftkx0TWDdcYiUUGBo5bG3%2FUygVyTc%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-f397e695-3304-4691-b8d8-4f3ec0efae32bd9fad35bf4476587/7492930b-4ddb-4078-a063-8caff2fb0fc6.zip?sv=2019-07-07&se=2021-12-23T01%3A39%3A18Z&sr=c&sp=rl&sig=MpdDB5M6qYrGGHMXqgYrw7a0U2oWii5pAKZIePGSZLE%3D>)
### Histogram

#### System.Collections.ContainsTrue&lt;Int32&gt;.Queue(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.172932967080317 < 22.239195991209566.
IsChangePoint: Marked as a change because one of 11/22/2021 6:07:11 PM, 11/23/2021 6:42:08 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 6:42:08 AM.
IsImprovementStdDev: Marked as improvement because 12.38196494195861 (T) = (0 -15559.276071125194) / Math.Sqrt((68201.73599364515 / (299)) + (753149.5719065538 / (2))) is greater than 1.9679296690655894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (2) - 2, .975) and 0.3281790411141863 = (23159.855115162805 - 15559.276071125194) / 23159.855115162805 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>




Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Changes at 11/22/2021 8:11:44 PM #2517

Run Information

Improvements in System.Collections.ContainsFalse<Int32>

Repro

Payloads

Histogram

System.Collections.ContainsFalse<Int32>.ImmutableArray(Size: 512)

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Improvements in System.Collections.ContainsTrue<Int32>

Repro

Payloads

Histogram

System.Collections.ContainsTrue<Int32>.Queue(Size: 512)

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	x64
OS	alpine 3.12
Baseline	f45dfdc2244166da0248c4a0fabad19a8bfcea1a
Compare	48fe63793040eaee87bdb26ee7d19636527efa3b
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ImmutableArray - Duration of single invocation	38.90 μs	22.24 μs	0.57	0.13	False
Array - Duration of single invocation	40.28 μs	18.81 μs	0.47	0.09	False
Span - Duration of single invocation	36.32 μs	17.78 μs	0.49	0.07	False

[Perf] Changes at 11/22/2021 8:11:44 PM #2517

Description

Run Information

Improvements in System.Collections.ContainsFalse<Int32>

Repro

Payloads

Histogram

System.Collections.ContainsFalse<Int32>.ImmutableArray(Size: 512)

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Improvements in System.Collections.ContainsTrue<Int32>

Repro

Payloads

Histogram

System.Collections.ContainsTrue<Int32>.Queue(Size: 512)

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions