[Perf] Changes at 3/15/2022 4:36:24 AM

### Run Information

Architecture | arm64
-- | --
OS | ubuntu 18.04
Baseline | [63fd977f7d57e0c0e434caecfff0dd0a07d2f27f](https://github.com/dotnet/runtime/commit/63fd977f7d57e0c0e434caecfff0dd0a07d2f27f)
Compare | [466b0f66aafe63a31696c16dca43a727cd4bbce5](https://github.com/dotnet/runtime/commit/466b0f66aafe63a31696c16dca43a727cd4bbce5)
Diff | [Diff](https://github.com/dotnet/runtime/compare/63fd977f7d57e0c0e434caecfff0dd0a07d2f27f...466b0f66aafe63a31696c16dca43a727cd4bbce5)


### Improvements in System.Text.Json.Tests.Perf_Reader

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[ReadSingleSpanSequenceEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04/System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact%3a%20True%2c%20TestCase%3a%20DeepTree).html>) | 7.08 μs | 6.57 μs | 0.93 | 0.07 | False | | |
[ReadSingleSpanSequenceEmptyLoop - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 18.04/System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact%3a%20True%2c%20TestCase%3a%20LotsOfStrings).html>) | 2.90 μs | 2.49 μs | 0.86 | 0.02 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_23_2022/refs/heads/main_arm64_ubuntu%2018.04_Improvement/System.Text.Json.Tests.Perf_Reader_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_23_2022/refs/heads/main_arm64_ubuntu%2018.04_Improvement/System.Text.Json.Tests.Perf_Reader_2.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/03_23_2022/refs/heads/main_arm64_ubuntu%2018.04_Improvement/System.Text.Json.Tests.Perf_Reader.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Reader*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-890805d7-6d5b-4a8c-835f-553dc5c38ef24cdc1c3f7084ed3b5/a30cfdff-223f-4af3-9398-dd2029fbcf1e.zip?sv=2019-07-07&se=2022-04-13T20%3A20%3A15Z&sr=c&sp=rl&sig=6vtlK6iA5DSkY1XWinJJVdxfl2bj7VP8ZtjQ48v1QdQ%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-d352dbe7-d8a3-4901-bad0-25a8d40bd60b4229041e8724444bc/d99c8959-ed30-489e-b649-f4291d879c95.zip?sv=2019-07-07&se=2022-04-14T14%3A45%3A22Z&sr=c&sp=rl&sig=JHZbnWLmrLxng49s3y6Rp2pjyNS5dAcggXz%2FO845T0E%3D>)
### Histogram

#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: DeepTree)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.573152698800621 < 6.675386868119128.
IsChangePoint: Marked as a change because one of 1/7/2022 4:24:34 PM, 2/3/2022 2:32:50 PM, 3/15/2022 12:53:39 AM, 3/22/2022 12:26:23 PM falls between 3/13/2022 11:50:20 AM and 3/22/2022 12:26:23 PM.
IsImprovementStdDev: Marked as improvement because 12.801989486925464 (T) = (0 -6524.754105901543) / Math.Sqrt((93851.38247100294 / (299)) + (45690.68711264657 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.10211702848199221 = (7266.820190242001 - 6524.754105901543) / 7266.820190242001 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: LotsOfStrings)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.4897204094006615 < 2.6568884127444083.
IsChangePoint: Marked as a change because one of 1/25/2022 5:52:36 PM, 3/17/2022 6:54:53 PM, 3/22/2022 12:26:23 PM falls between 3/13/2022 11:50:20 AM and 3/22/2022 12:26:23 PM.
IsImprovementStdDev: Marked as improvement because 10.320986297665282 (T) = (0 -2513.0619274796813) / Math.Sqrt((4805.2220435387035 / (299)) + (4084.8735485512534 / (5))) is greater than 1.9678502273660254 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (5) - 2, .975) and 0.10597470741042656 = (2810.9517127871354 - 2513.0619274796813) / 2810.9517127871354 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Perf] Changes at 3/15/2022 4:36:24 AM #4258

Run Information

Improvements in System.Text.Json.Tests.Perf_Reader

Repro

Payloads

Histogram

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: DeepTree)

Description of detection logic

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Fields

Projects

Milestone

Relationships

Development

Architecture	arm64
OS	ubuntu 18.04
Baseline	63fd977f7d57e0c0e434caecfff0dd0a07d2f27f
Compare	466b0f66aafe63a31696c16dca43a727cd4bbce5
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation	7.08 μs	6.57 μs	0.93	0.07	False
ReadSingleSpanSequenceEmptyLoop - Duration of single invocation	2.90 μs	2.49 μs	0.86	0.02	False

[Perf] Changes at 3/15/2022 4:36:24 AM #4258

Description

Run Information

Improvements in System.Text.Json.Tests.Perf_Reader

Repro

Payloads

Histogram

System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: DeepTree)

Description of detection logic

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Fields

Projects

Milestone

Relationships

Development

Issue actions