[Perf] Changes at 7/15/2022 10:58:28 PM

### Run Information

Architecture | arm64
-- | --
OS | ubuntu 20.04
Baseline | [87aa786b3997a23501912abd4654e4fd9958230c](https://github.com/dotnet/runtime/commit/87aa786b3997a23501912abd4654e4fd9958230c)
Compare | [55bf5d8a28f4a8c519dbc6edfc1d3d64519f530f](https://github.com/dotnet/runtime/commit/55bf5d8a28f4a8c519dbc6edfc1d3d64519f530f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/87aa786b3997a23501912abd4654e4fd9958230c...55bf5d8a28f4a8c519dbc6edfc1d3d64519f530f)


### Regressions in System.IO.Compression.Brotli

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Compress - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.IO.Compression.Brotli.Compress(level%3a%20Optimal%2c%20file%3a%20%22alice29.txt%22).html>) | 6.98 μs | 2.07 ms | 295.70 | 0.19 | False | | |
[Compress - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04/System.IO.Compression.Brotli.Compress(level%3a%20Optimal%2c%20file%3a%20%22TestDocument.pdf%22).html>) | 5.86 μs | 351.71 μs | 60.00 | 0.21 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/07_28_2022/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.IO.Compression.Brotli_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/07_28_2022/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.IO.Compression.Brotli_2.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/07_28_2022/refs/heads/main_arm64_ubuntu%2020.04_Regression/System.IO.Compression.Brotli.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Compression.Brotli*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-59b8c734-48ea-49d0-9dbc-238e660716f266d50e5ef4e42cd9a/9f8b8fef-778e-4500-ba29-a44bc2efb5f2.zip?sv=2021-06-08&se=2022-08-14T13%3A15%3A52Z&sr=c&sp=rl&sig=yG%2BR3r79aKSQKJydmtajFSX8XAwIt5YAdj%2FfkHi26Uk%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-dcdcd4d7-ba9e-4a89-8c97-c3b51730115c70f86f5cb734d34a9/a52db9ab-14e8-442a-a7d6-477b4407a532.zip?sv=2021-06-08&se=2022-08-15T05%3A36%3A46Z&sr=c&sp=rl&sig=PgYQzxJ7GF5oA1A76x4oMRmOjewwOGpNLHfEG%2BPPRPc%3D>)
### Histogram

#### System.IO.Compression.Brotli.Compress(level: Optimal, file: "alice29.txt")

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.0650003010416667 > 7.198041053538143.
IsChangePoint: Marked as a change because one of 7/15/2022 6:44:31 PM, 7/18/2022 2:17:16 AM falls between 7/8/2022 10:31:34 AM and 7/18/2022 2:17:16 AM.
IsRegressionStdDev: Marked as regression because -265.3310209481037 (T) = (0 -2087243.4577368232) / Math.Sqrt((19356.6264753582 / (46)) + (553333649.5356491 / (9))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (46) + (9) - 2, .025) and -307.2250520225251 = (6771.816385594404 - 2087243.4577368232) / 6771.816385594404 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Compression.Brotli.Compress(level: Optimal, file: "TestDocument.pdf")

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 351.7089752232142 > 6.124847277644463.
IsChangePoint: Marked as a change because one of 7/15/2022 6:44:31 PM, 7/18/2022 2:17:16 AM falls between 7/8/2022 10:31:34 AM and 7/18/2022 2:17:16 AM.
IsRegressionStdDev: Marked as regression because -69.3481541417026 (T) = (0 -339108.9594720117) / Math.Sqrt((14876.823862319685 / (46)) + (207810708.11120316 / (9))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (46) + (9) - 2, .025) and -56.73123162698258 = (5873.925601710497 - 339108.9594720117) / 5873.925601710497 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Changes at 7/15/2022 10:58:28 PM #6971

Run Information

Regressions in System.IO.Compression.Brotli

Repro

Payloads

Histogram

System.IO.Compression.Brotli.Compress(level: Optimal, file: "alice29.txt")

Description of detection logic

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	arm64
OS	ubuntu 20.04
Baseline	87aa786b3997a23501912abd4654e4fd9958230c
Compare	55bf5d8a28f4a8c519dbc6edfc1d3d64519f530f
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Compress - Duration of single invocation	6.98 μs	2.07 ms	295.70	0.19	False
Compress - Duration of single invocation	5.86 μs	351.71 μs	60.00	0.21	False

[Perf] Changes at 7/15/2022 10:58:28 PM #6971

Description

Run Information

Regressions in System.IO.Compression.Brotli

Repro

Payloads

Histogram

System.IO.Compression.Brotli.Compress(level: Optimal, file: "alice29.txt")

Description of detection logic

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions