[Perf] Changes at 4/26/2022 4:04:55 PM #5028
Description
Run Information
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 8006e6a89bc02e410331e6323e3f6321b224b327 |
| Compare | e4163ea55ebb3673c29e1c2a850a6a790029d278 |
| Diff | Diff |
Improvements in System.Collections.IterateForEach<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ConcurrentBag - Duration of single invocation | 2.28 μs | 2.13 μs | 0.93 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<Int32>*'Details
Payloads
Histogram
System.Collections.IterateForEach<Int32>.ConcurrentBag(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.130357305157918 < 2.1673093005007398.
IsChangePoint: Marked as a change because one of 3/4/2022 1:10:06 AM, 3/21/2022 1:28:14 PM, 4/1/2022 10:26:17 PM, 4/26/2022 12:44:27 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsImprovementStdDev: Marked as improvement because 45.60234315335284 (T) = (0 -2123.762366598546) / Math.Sqrt((6027.3233351106655 / (299)) + (14.359463885193623 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.08876481104943998 = (2330.6413013356237 - 2123.762366598546) / 2330.6413013356237 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | x86 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | 8006e6a89bc02e410331e6323e3f6321b224b327 |
| Compare | e4163ea55ebb3673c29e1c2a850a6a790029d278 |
| Diff | Diff |
Improvements in System.Collections.IterateForEach<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ImmutableQueue - Duration of single invocation | 5.90 μs | 5.16 μs | 0.87 | 0.39 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<String>*'Details
Payloads
Histogram
System.Collections.IterateForEach<String>.ImmutableQueue(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.157081993900428 < 5.602133292711919.
IsChangePoint: Marked as a change because one of 3/17/2022 6:54:53 PM, 4/21/2022 3:06:05 PM, 4/26/2022 12:44:27 PM, 5/3/2022 11:42:39 AM falls between 4/24/2022 10:52:31 PM and 5/3/2022 11:42:39 AM.
IsImprovementStdDev: Marked as improvement because 8.64583008746533 (T) = (0 -4823.4831963876995) / Math.Sqrt((398397.20738056727 / (299)) + (61615.72991144538 / (34))) is greater than 1.9671567996108528 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (34) - 2, .975) and 0.09133486736865291 = (5308.317688409231 - 4823.4831963876995) / 5308.317688409231 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository