[Perf] Changes at 11/17/2021 8:43:26 PM

### Run Information

Architecture | x64
-- | --
OS | Windows 10.0.18362
Baseline | [44d28bf5b6c8b448ac4f19638b90cdbdba6be5bc](https://github.com/dotnet/runtime/commit/44d28bf5b6c8b448ac4f19638b90cdbdba6be5bc)
Compare | [9962c10813de695782baa20f1bf0bb2e9810971d](https://github.com/dotnet/runtime/commit/9962c10813de695782baa20f1bf0bb2e9810971d)
Diff | [Diff](https://github.com/dotnet/runtime/compare/44d28bf5b6c8b448ac4f19638b90cdbdba6be5bc...9962c10813de695782baa20f1bf0bb2e9810971d)


### Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Ctor - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options%3a%20Compiled).html>) | 31.25 μs | 28.11 μs | 0.90 | 0.01 | False | | |
[Email_IsMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options%3a%20None).html>) | 545.10 ns | 445.81 ns | 0.82 | 0.03 | False | | |
[SplitWords - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options%3a%20Compiled).html>) | 7.06 μs | 2.83 μs | 0.40 | 0.00 | True | | |
[MatchesSet - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options%3a%20None).html>) | 214.31 μs | 161.99 μs | 0.76 | 0.00 | True | | |
[IP_IsMatch - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options%3a%20IgnoreCase%2c%20Compiled).html>) | 330.09 ns | 207.36 ns | 0.63 | 0.06 | True | | |
[SplitWords - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options%3a%20None).html>) | 82.00 μs | 72.88 μs | 0.89 | 0.01 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_Windows%2010.0.18362_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Common_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_Windows%2010.0.18362_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Common_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_Windows%2010.0.18362_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Common_3.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_Windows%2010.0.18362_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Common_4.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_Windows%2010.0.18362_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Common_5.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_Windows%2010.0.18362_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Common_6.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/11_23_2021/refs/heads/main_x64_Windows%2010.0.18362_Improvement/System.Text.RegularExpressions.Tests.Perf_Regex_Common.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-3d311ed2-b9ff-4e5b-aa5e-1d78e893d4996604eb846ac46beaa/6acce8f0-5f63-4503-b6f4-9f4cffab7ecf.zip?sv=2019-07-07&se=2021-12-17T14%3A01%3A21Z&sr=c&sp=rl&sig=5c8UWkJUc8Ig%2F1ue10PaYZdunxXWjTMPixRR3Oh%2FqNo%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-8c3dbb41-1036-4b3f-8c72-ec68fdd449543a0b120bb804f1191/6269ef7b-f457-47bd-a11b-685aa6bcb2aa.zip?sv=2019-07-07&se=2021-12-18T01%3A51%3A44Z&sr=c&sp=rl&sig=HDy%2Foo3BNIwt5Z7igz8hFMXlo3fpbK9ktsGBc8y4vNo%3D>)
### Histogram

#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: Compiled)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 28.10861932497013 < 29.895365765261147.
IsChangePoint: Marked as a change because one of 10/25/2021 8:49:36 PM, 11/17/2021 2:42:53 PM, 11/23/2021 3:51:55 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 3:51:55 AM.
IsImprovementStdDev: Marked as improvement because 10.838689809640297 (T) = (0 -28690.54771677082) / Math.Sqrt((920863.1034703099 / (299)) + (338234.0629477164 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.057029522249564556 = (30425.71150818573 - 28690.54771677082) / 30425.71150818573 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options: None)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 445.8090956018935 < 524.1613522195368.
IsChangePoint: Marked as a change because one of 9/16/2021 4:14:14 PM, 10/24/2021 4:04:01 PM, 11/17/2021 2:42:53 PM, 11/23/2021 3:51:55 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 3:51:55 AM.
IsImprovementStdDev: Marked as improvement because 68.41865907005929 (T) = (0 -444.41980523373417) / Math.Sqrt((208.54295890030818 / (299)) + (21.653862027948932 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.1599783428721162 = (529.0575563887828 - 444.41980523373417) / 529.0575563887828 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: Compiled)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.828269345504445 < 6.713405797313858.
IsChangePoint: Marked as a change because one of 11/17/2021 2:42:53 PM, 11/23/2021 3:51:55 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 3:51:55 AM.
IsImprovementStdDev: Marked as improvement because 985.7533310429112 (T) = (0 -2820.0106806027206) / Math.Sqrt((2739.6106925655763 / (299)) + (243.0321816061054 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.6006237949677364 = (7061.038301906109 - 2820.0106806027206) / 7061.038301906109 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: None)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 161.9936507936508 < 203.1192948295427.
IsChangePoint: Marked as a change because one of 11/17/2021 2:42:53 PM, 11/23/2021 3:51:55 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 3:51:55 AM.
IsImprovementStdDev: Marked as improvement because 169.90899788047167 (T) = (0 -162563.0325670929) / Math.Sqrt((18401557.629951462 / (299)) + (1307483.887297209 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.2589978478981436 = (219382.67264944105 - 162563.0325670929) / 219382.67264944105 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options: IgnoreCase, Compiled)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 207.35771245266542 < 316.73956544788103.
IsChangePoint: Marked as a change because one of 10/8/2021 11:00:59 PM, 11/17/2021 2:42:53 PM, 11/23/2021 3:51:55 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 3:51:55 AM.
IsImprovementStdDev: Marked as improvement because 165.73064073670236 (T) = (0 -205.53897079496116) / Math.Sqrt((141.72836005588948 / (299)) + (5.1039836570779284 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.3976478020435598 = (341.2272280109202 - 205.53897079496116) / 341.2272280109202 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: None)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 72.88408677125703 < 78.3423958233709.
IsChangePoint: Marked as a change because one of 11/17/2021 2:42:53 PM, 11/23/2021 3:51:55 AM falls between 11/14/2021 12:07:47 PM and 11/23/2021 3:51:55 AM.
IsImprovementStdDev: Marked as improvement because 20.76272623547007 (T) = (0 -70100.21980805622) / Math.Sqrt((1372048.878981285 / (299)) + (9463947.708446093 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.1524121526159508 = (82705.55084574404 - 70100.21980805622) / 82705.55084574404 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Changes at 11/17/2021 8:43:26 PM #2507

Run Information

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: Compiled)

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	x64
OS	Windows 10.0.18362
Baseline	44d28bf5b6c8b448ac4f19638b90cdbdba6be5bc
Compare	9962c10813de695782baa20f1bf0bb2e9810971d
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Ctor - Duration of single invocation	31.25 μs	28.11 μs	0.90	0.01	False
Email_IsMatch - Duration of single invocation	545.10 ns	445.81 ns	0.82	0.03	False
SplitWords - Duration of single invocation	7.06 μs	2.83 μs	0.40	0.00	True
MatchesSet - Duration of single invocation	214.31 μs	161.99 μs	0.76	0.00	True
IP_IsMatch - Duration of single invocation	330.09 ns	207.36 ns	0.63	0.06	True
SplitWords - Duration of single invocation	82.00 μs	72.88 μs	0.89	0.01	True

[Perf] Changes at 11/17/2021 8:43:26 PM #2507

Description

Run Information

Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Repro

Payloads

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: Compiled)

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions