[Perf] Changes at 3/25/2022 1:38:06 PM

### Run Information

Architecture | x64
-- | --
OS | ubuntu 18.04
Baseline | [cd5beb14b0ce11ae1e4e3f1d30bffba7e37ce606](https://github.com/dotnet/runtime/commit/cd5beb14b0ce11ae1e4e3f1d30bffba7e37ce606)
Compare | [55f204501f7300786f4a15f84a5f353f0620475b](https://github.com/dotnet/runtime/commit/55f204501f7300786f4a15f84a5f353f0620475b)
Diff | [Diff](https://github.com/dotnet/runtime/compare/cd5beb14b0ce11ae1e4e3f1d30bffba7e37ce606...55f204501f7300786f4a15f84a5f353f0620475b)


### Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22(%3fi)Tom%7cSawyer%7cHuckleberry%7cFinn%22%2c%20Options%3a%20Compiled).html>) | 58.63 ms | 61.93 ms | 1.06 | 0.01 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_31_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_31_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-9fa85738-335a-49de-9b12-9a69b910861832ac5a9b1b7438281/78d70f7a-8973-46c5-ae6a-7cb155a89922.zip?sv=2019-07-07&se=2022-04-24T07%3A16%3A47Z&sr=c&sp=rl&sig=LfR57eeEgakPyq5UEOkiKSU3X4uejVvmBGQ9QbqAfiI%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-f0d3a92d-6f28-42c3-a950-c67a0cdc4d6a8018b04d003461d82/69a79cf1-f30f-4142-a24d-802387702eec.zip?sv=2019-07-07&se=2022-04-24T19%3A14%3A11Z&sr=c&sp=rl&sig=f9hAFVqsLzHIItH6X5NomqHRd03ZZ0oVztB8VMBc1l0%3D>)
### Histogram

#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "(?i)Tom|Sawyer|Huckleberry|Finn", Options: Compiled)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 61.93496114285714 > 61.49630496625.
IsChangePoint: Marked as a change because one of 2/26/2022 10:27:55 AM, 3/3/2022 7:35:51 PM, 3/25/2022 7:34:40 AM, 3/31/2022 1:45:25 PM falls between 3/22/2022 11:55:12 PM and 3/31/2022 1:45:25 PM.
IsRegressionStdDev: Marked as regression because -56.18143353379927 (T) = (0 -61718977.43862088) / Math.Sqrt((9290315793.464077 / (28)) + (71687780117.21857 / (25))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (25) - 2, .025) and -0.05428240651430854 = (58541219.18118458 - 61718977.43862088) / 58541219.18118458 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>
### Run Information

Architecture | x64
-- | --
OS | ubuntu 18.04
Baseline | [cd5beb14b0ce11ae1e4e3f1d30bffba7e37ce606](https://github.com/dotnet/runtime/commit/cd5beb14b0ce11ae1e4e3f1d30bffba7e37ce606)
Compare | [55f204501f7300786f4a15f84a5f353f0620475b](https://github.com/dotnet/runtime/commit/55f204501f7300786f4a15f84a5f353f0620475b)
Diff | [Diff](https://github.com/dotnet/runtime/compare/cd5beb14b0ce11ae1e4e3f1d30bffba7e37ce606...55f204501f7300786f4a15f84a5f353f0620475b)


### Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%7cIrene%7cAdler%7cJohn%7cBaker%22%2c%20Options%3a%20Compiled).html>) | 2.82 ms | 3.72 ms | 1.32 | 0.01 | True | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fi)Sherlock%7cHolmes%7cWatson%22%2c%20Options%3a%20Compiled).html>) | 1.69 ms | 1.81 ms | 1.07 | 0.01 | False | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern%3a%20%22(%3fs).*%22%2c%20Options%3a%20None).html>) | 2.08 ms | 2.46 ms | 1.19 | 0.10 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_31_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_31_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_31_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_31_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-9fa85738-335a-49de-9b12-9a69b910861832ac5a9b1b7438281/78d70f7a-8973-46c5-ae6a-7cb155a89922.zip?sv=2019-07-07&se=2022-04-24T07%3A16%3A47Z&sr=c&sp=rl&sig=LfR57eeEgakPyq5UEOkiKSU3X4uejVvmBGQ9QbqAfiI%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-f0d3a92d-6f28-42c3-a950-c67a0cdc4d6a8018b04d003461d82/69a79cf1-f30f-4142-a24d-802387702eec.zip?sv=2019-07-07&se=2022-04-24T19%3A14%3A11Z&sr=c&sp=rl&sig=f9hAFVqsLzHIItH6X5NomqHRd03ZZ0oVztB8VMBc1l0%3D>)
### Histogram

#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: Compiled)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.7249341312500004 > 2.9621166482031254.
IsChangePoint: Marked as a change because one of 3/25/2022 7:34:40 AM, 3/31/2022 1:45:25 PM falls between 3/22/2022 11:55:12 PM and 3/31/2022 1:45:25 PM.
IsRegressionStdDev: Marked as regression because -388.71719033205414 (T) = (0 -3728581.989910439) / Math.Sqrt((128495629.14198779 / (28)) + (20145541.743603308 / (25))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (25) - 2, .025) and -0.3195216919046374 = (2825707.2337541427 - 3728581.989910439) / 2825707.2337541427 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson", Options: Compiled)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.8128644503968252 > 1.7787570154326926.
IsChangePoint: Marked as a change because one of 2/26/2022 10:27:55 AM, 3/3/2022 7:35:51 PM, 3/25/2022 7:34:40 AM, 3/31/2022 1:45:25 PM falls between 3/22/2022 11:55:12 PM and 3/31/2022 1:45:25 PM.
IsRegressionStdDev: Marked as regression because -286.8453061257668 (T) = (0 -1812529.6314675924) / Math.Sqrt((770316.4331677527 / (28)) + (3557112.2085716366 / (25))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (25) - 2, .025) and -0.06976102649524937 = (1694331.338098754 - 1812529.6314675924) / 1694331.338098754 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?s).*", Options: None)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.460865924369748 > 2.179366704839876.
IsChangePoint: Marked as a change because one of 2/26/2022 10:27:55 AM, 3/25/2022 7:34:40 AM, 3/31/2022 1:45:25 PM falls between 3/22/2022 11:55:12 PM and 3/31/2022 1:45:25 PM.
IsRegressionStdDev: Marked as regression because -32.44043239101472 (T) = (0 -2348501.7320499266) / Math.Sqrt((1688753.655261995 / (28)) + (1763120449.231305 / (25))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (25) - 2, .025) and -0.13128817394448097 = (2075953.5776471235 - 2348501.7320499266) / 2075953.5776471235 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>




Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Changes at 3/25/2022 1:38:06 PM #4280

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "(?i)Tom|Sawyer|Huckleberry|Finn", Options: Compiled)

Description of detection logic

Docs

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: Compiled)

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	x64
OS	ubuntu 18.04
Baseline	cd5beb14b0ce11ae1e4e3f1d30bffba7e37ce606
Compare	55f204501f7300786f4a15f84a5f353f0620475b
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Count - Duration of single invocation	2.82 ms	3.72 ms	1.32	0.01	True
Count - Duration of single invocation	1.69 ms	1.81 ms	1.07	0.01	False
Count - Duration of single invocation	2.08 ms	2.46 ms	1.19	0.10	False

[Perf] Changes at 3/25/2022 1:38:06 PM #4280

Description

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "(?i)Tom|Sawyer|Huckleberry|Finn", Options: Compiled)

Description of detection logic

Docs

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?i)Sherlock|Holmes|Watson|Irene|Adler|John|Baker", Options: Compiled)

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions