[Perf] Changes at 4/13/2022 10:02:29 PM

### Run Information

Architecture | arm64
-- | --
OS | ubuntu 18.04
Baseline | [5c57f2c0cda44176e237574ceb51d659ef9915fa](https://github.com/dotnet/runtime/commit/5c57f2c0cda44176e237574ceb51d659ef9915fa)
Compare | [1a296c06fff8750b4658f6f7d901347e006744d0](https://github.com/dotnet/runtime/commit/1a296c06fff8750b4658f6f7d901347e006744d0)
Diff | [Diff](https://github.com/dotnet/runtime/compare/5c57f2c0cda44176e237574ceb51d659ef9915fa...1a296c06fff8750b4658f6f7d901347e006744d0)


### Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22%5ba-z%5dshing%22%2c%20Options%3a%20NonBacktracking).html>) | 14.94 ms | 7.77 ms | 0.52 | 0.41 | False | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22%5ba-z%5dshing%22%2c%20Options%3a%20None).html>) | 15.68 ms | 6.17 ms | 0.39 | 0.35 | False | | |
[Count - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern%3a%20%22%5ba-z%5dshing%22%2c%20Options%3a%20Compiled).html>) | 10.81 ms | 6.14 ms | 0.57 | 0.05 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/04_20_2022/refs/heads/main_arm64_ubuntu%2018.04_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/04_20_2022/refs/heads/main_arm64_ubuntu%2018.04_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/04_20_2022/refs/heads/main_arm64_ubuntu%2018.04_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/04_20_2022/refs/heads/main_arm64_ubuntu%2018.04_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-e603f335-e331-4aba-9eb1-303886ae161dd7db7ca21884e1385/8baf6556-ad32-4263-b885-3be2a5e5b796.zip?sv=2019-07-07&se=2022-05-13T11%3A26%3A14Z&sr=c&sp=rl&sig=qJR9ti3C2T8j%2FfpVYWiFszvZuNO5SXrMsUXntz8%2Femk%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-4da026f8-8f3f-4a0e-84ee-92f85993001b2bf5dc47b8144fa9f/6deb34c0-e58e-4448-858f-5e536e8a51c4.zip?sv=2019-07-07&se=2022-05-14T05%3A49%3A01Z&sr=c&sp=rl&sig=ApiBNRpjndaJkxP0XDSW2u4venJ9lJ%2BVa8jEnb0eGXM%3D>)
### Histogram

#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: NonBacktracking)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.7701488125 < 15.821533609523808.
IsChangePoint: Marked as a change because one of 4/13/2022 4:27:35 PM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 62.035468083592434 (T) = (0 -6811371.82696138) / Math.Sqrt((2887308506452.2773 / (299)) + (281146385323.55646 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.5874967069125302 = (16512284.728638649 - 6811371.82696138) / 16512284.728638649 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: None)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.174596361616163 < 14.374173771666664.
IsChangePoint: Marked as a change because one of 4/13/2022 4:27:35 PM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 84.77650918384593 (T) = (0 -6243837.653675223) / Math.Sqrt((2663444789267.1333 / (299)) + (107676850037.8346 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.6210956387607868 = (16478663.991236852 - 6243837.653675223) / 16478663.991236852 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: Compiled)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.135361006666666 < 10.33918883189394.
IsChangePoint: Marked as a change because one of 2/8/2022 5:20:12 PM, 4/13/2022 4:27:35 PM, 4/19/2022 4:53:57 AM falls between 4/10/2022 3:30:35 PM and 4/19/2022 4:53:57 AM.
IsImprovementStdDev: Marked as improvement because 50.10348989754411 (T) = (0 -6103396.734111798) / Math.Sqrt((132653792953.55429 / (299)) + (182625603121.79562 / (19))) is greater than 1.9674995188240387 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (19) - 2, .975) and 0.451510138758976 = (11127638.203379242 - 6103396.734111798) / 11127638.203379242 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Changes at 4/13/2022 10:02:29 PM #4747

Run Information

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: NonBacktracking)

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	arm64
OS	ubuntu 18.04
Baseline	5c57f2c0cda44176e237574ceb51d659ef9915fa
Compare	1a296c06fff8750b4658f6f7d901347e006744d0
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Count - Duration of single invocation	14.94 ms	7.77 ms	0.52	0.41	False
Count - Duration of single invocation	15.68 ms	6.17 ms	0.39	0.35	False
Count - Duration of single invocation	10.81 ms	6.14 ms	0.57	0.05	True

[Perf] Changes at 4/13/2022 10:02:29 PM #4747

Description

Run Information

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: "[a-z]shing", Options: NonBacktracking)

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions