[Perf] Alpine/x64: 2 Regressions on 10/27/2022 5:53:52 AM

### Run Information

Architecture | x64
-- | --
OS | alpine 3.15
Baseline | [65233ebb1368ab5eebe76c05aac852b9b6a8cde8](https://github.com/dotnet/runtime/commit/65233ebb1368ab5eebe76c05aac852b9b6a8cde8)
Compare | [060a1967649469fa71986dc92bb41629c0970946](https://github.com/dotnet/runtime/commit/060a1967649469fa71986dc92bb41629c0970946)
Diff | [Diff](https://github.com/dotnet/runtime/compare/65233ebb1368ab5eebe76c05aac852b9b6a8cde8...060a1967649469fa71986dc92bb41629c0970946)


### Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[IsMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total%3a%20400000%2c%20unique%3a%201%2c%20cacheSize%3a%2015).html>) | 32.59 ms | 35.80 ms | 1.10 | 0.12 | False | | |
[IsMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total%3a%2040000%2c%20unique%3a%207%2c%20cacheSize%3a%200).html>) | 36.38 ms | 39.22 ms | 1.08 | 0.05 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_01_2022/refs/heads/main_x64_alpine%203.15_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Cache_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_01_2022/refs/heads/main_x64_alpine%203.15_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Cache_2.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_01_2022/refs/heads/main_x64_alpine%203.15_Regression/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Cache*'
```

### Related Issues

#### Regressions

* [[Perf] Windows/x64: 5 Regressions on 10/27/2022 5:53:52 AM](<https://github.com/dotnet/perf-autofiling-issues/issues/9387>)
#### Improvements

<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-4e382074-ddd3-444a-8ef3-db0df9d832f51e877c525004d4d8f/357fe4a3-f4ad-4876-a245-6fae5ecf5ca0.zip?sv=2021-08-06&se=2022-11-26T02%3A13%3A57Z&sr=c&sp=rl&sig=goFW4%2BzbumYbiTrHw9AS3b3A5AEy9SCXkSaPqhukbjo%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-fc3eeb8b-71c4-4799-8643-aec01afe37d7a097d281a1c428db3/4974e5d3-0bfa-46fb-828e-f1e3ffd30126.zip?sv=2021-08-06&se=2022-11-26T12%3A08%3A45Z&sr=c&sp=rl&sig=5VZlBpFOquw8iCRQ9mrZuoB1ssCMI%2BQS4RncuNDzxxA%3D>)
### Histogram

### Edge Detector Info

[Collection Data](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/reports/11_01_2022/refs/heads/main_x64_alpine 3.15/System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total- 40000, unique- 7, cacheSize- 0).txt?sv=2018-03-28&sr=c&sig=JoytaT70%2ByX0ce090BDZwAg8TDntVqLeANIlSNxVryw%3D&se=2022-11-24T00%3A17%3A57Z&sp=racwdl>)
#### System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 400000, unique: 1, cacheSize: 15)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 35.804903616666664 > 34.5423636425.
IsChangePoint: Marked as a change because one of 9/9/2022 3:12:19 AM, 10/27/2022 4:20:56 AM, 11/1/2022 10:15:31 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 10:15:31 AM.
IsRegressionStdDev: Marked as regression because -6.726731538051464 (T) = (0 -35090999.35288918) / Math.Sqrt((982903008551.4868 / (30)) + (783410010258.5068 / (22))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (22) - 2, .025) and -0.05276961858227307 = (33332078.294722226 - 35090999.35288918) / 33332078.294722226 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 40000, unique: 7, cacheSize: 0)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 39.2239965 > 38.15560217875.
IsChangePoint: Marked as a change because one of 9/8/2022 6:17:28 PM, 10/27/2022 12:34:03 AM, 11/1/2022 10:15:31 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 10:15:31 AM.
IsRegressionStdDev: Marked as regression because -19.89399289828881 (T) = (0 -38733526.80766046) / Math.Sqrt((247016117122.89456 / (29)) + (104401505467.41608 / (23))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (23) - 2, .025) and -0.06234811895796832 = (36460295.93920046 - 38733526.80766046) / 36460295.93920046 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Alpine/x64: 2 Regressions on 10/27/2022 5:53:52 AM #9441

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 400000, unique: 1, cacheSize: 15)

Description of detection logic

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	x64
OS	alpine 3.15
Baseline	65233ebb1368ab5eebe76c05aac852b9b6a8cde8
Compare	060a1967649469fa71986dc92bb41629c0970946
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IsMatch - Duration of single invocation	32.59 ms	35.80 ms	1.10	0.12	False
IsMatch - Duration of single invocation	36.38 ms	39.22 ms	1.08	0.05	False

[Perf] Alpine/x64: 2 Regressions on 10/27/2022 5:53:52 AM #9441

Description

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Repro

Related Issues

Regressions

Improvements

Payloads

Histogram

Edge Detector Info

System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 400000, unique: 1, cacheSize: 15)

Description of detection logic

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions