Skip to content

[Perf] Changes at 8/3/2022 1:34:55 AM #7145

@performanceautofiler

Description

@performanceautofiler

Run Information

Architecture arm64
OS Windows 10.0.19041
Baseline 54c717a4ed822f46a23893479b8d4398596c041d
Compare 1926f0939a855d6ef41593377c75ab4c31e9fcbb
Diff Diff

Improvements in System.IO.Compression.Gzip

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Decompress - Duration of single invocation 672.84 μs 620.74 μs 0.92 0.00 False
Decompress - Duration of single invocation 518.10 μs 464.07 μs 0.90 0.00 False
Decompress - Duration of single invocation 514.67 μs 460.12 μs 0.89 0.00 False
Decompress - Duration of single invocation 165.42 μs 152.08 μs 0.92 0.00 False
Decompress - Duration of single invocation 178.40 μs 164.93 μs 0.92 0.00 False
Decompress - Duration of single invocation 703.36 μs 651.82 μs 0.93 0.00 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Compression.Gzip*'
Details

Payloads

Baseline
Compare

Histogram

System.IO.Compression.Gzip.Decompress(level: Optimal, file: "alice29.txt")


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 620.73505 < 639.32621557971.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/15/2022 7:24:26 PM, 8/2/2022 9:32:02 PM, 8/4/2022 5:17:15 AM falls between 7/26/2022 2:47:26 PM and 8/4/2022 5:17:15 AM.
IsImprovementStdDev: Marked as improvement because 81.35062588033031 (T) = (0 -619479.3863095238) / Math.Sqrt((38657243.93722757 / (299)) + (1381680.2296386666 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.08297175127012511 = (675529.2295166812 - 619479.3863095238) / 675529.2295166812 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Compression.Gzip.Decompress(level: Fastest, file: "TestDocument.pdf")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 464.07152048319335 < 492.48084727182544.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 8/2/2022 9:32:02 PM, 8/4/2022 5:17:15 AM falls between 7/26/2022 2:47:26 PM and 8/4/2022 5:17:15 AM.
IsImprovementStdDev: Marked as improvement because 366.7468716116831 (T) = (0 -464399.2498779815) / Math.Sqrt((2836467.0230982783 / (299)) + (52910.85263543908 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.106361781665294 = (519672.5479617345 - 464399.2498779815) / 519672.5479617345 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Compression.Gzip.Decompress(level: Optimal, file: "TestDocument.pdf")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 460.11625525210087 < 488.83410204899263.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 8/2/2022 9:32:02 PM, 8/4/2022 5:17:15 AM falls between 7/26/2022 2:47:26 PM and 8/4/2022 5:17:15 AM.
IsImprovementStdDev: Marked as improvement because 324.98315928483703 (T) = (0 -459732.0680147059) / Math.Sqrt((1761612.9510928676 / (299)) + (95505.94028284594 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.1087059048091197 = (515802.88761617936 - 459732.0680147059) / 515802.88761617936 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Compression.Gzip.Decompress(level: Optimal, file: "sum")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 152.0765344551282 < 157.7508927018989.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/15/2022 7:24:26 PM, 8/2/2022 9:32:02 PM, 8/4/2022 5:17:15 AM falls between 7/26/2022 2:47:26 PM and 8/4/2022 5:17:15 AM.
IsImprovementStdDev: Marked as improvement because 68.16583041956117 (T) = (0 -152348.35390289035) / Math.Sqrt((1590318.8395787845 / (299)) + (168894.78029438792 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.08888772863175336 = (167211.39500635187 - 152348.35390289035) / 167211.39500635187 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Compression.Gzip.Decompress(level: Fastest, file: "sum")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 164.9257659774436 < 169.49045472674732.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/15/2022 7:24:26 PM, 8/2/2022 9:32:02 PM, 8/4/2022 5:17:15 AM falls between 7/26/2022 2:47:26 PM and 8/4/2022 5:17:15 AM.
IsImprovementStdDev: Marked as improvement because 90.54385805681737 (T) = (0 -165232.10903588758) / Math.Sqrt((1679335.6081015405 / (299)) + (77707.20435915502 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.07979826449291696 = (179560.74484562385 - 165232.10903588758) / 179560.74484562385 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Compression.Gzip.Decompress(level: Fastest, file: "alice29.txt")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 651.8171354166665 < 667.9703900786714.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/15/2022 7:24:26 PM, 8/2/2022 9:32:02 PM, 8/4/2022 5:17:15 AM falls between 7/26/2022 2:47:26 PM and 8/4/2022 5:17:15 AM.
IsImprovementStdDev: Marked as improvement because 138.6534781190379 (T) = (0 -652272.4020337302) / Math.Sqrt((37391441.123318486 / (299)) + (151355.82264225508 / (4))) is greater than 1.9678765312856872 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (4) - 2, .975) and 0.07901453831138996 = (708233.1146007458 - 652272.4020337302) / 708233.1146007458 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions