[Perf] Changes at 7/31/2022 3:07:22 PM #6998
Description
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | ec5e8b5fac0ca3524c01b826a048b0b293b63a7d |
| Compare | 3605700d507d52716ed8750dac35d34dc45f0e3d |
| Diff | Diff |
Improvements in System.Tests.Perf_DateTimeOffset
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| GetNow - Duration of single invocation | 159.36 ns | 151.35 ns | 0.95 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTimeOffset*'Details
Payloads
Histogram
System.Tests.Perf_DateTimeOffset.GetNow
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 151.34912818088398 < 151.48505778395258.
IsChangePoint: Marked as a change because one of 7/2/2022 7:35:06 PM, 7/31/2022 12:39:41 PM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM.
IsImprovementStdDev: Marked as improvement because 31.900126633601054 (T) = (0 -150.41704162313602) / Math.Sqrt((3.620349526786433 / (299)) + (0.4500215594952509 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.050200728155356034 = (158.36718987055542 - 150.41704162313602) / 158.36718987055542 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.18362 |
| Baseline | ec5e8b5fac0ca3524c01b826a048b0b293b63a7d |
| Compare | 3605700d507d52716ed8750dac35d34dc45f0e3d |
| Diff | Diff |
Improvements in System.Tests.Perf_DateTime
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| GetNow - Duration of single invocation | 122.03 ns | 109.70 ns | 0.90 | 0.00 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTime*'Details
Payloads
Histogram
System.Tests.Perf_DateTime.GetNow
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 109.70214268451106 < 115.14152703872895.
IsChangePoint: Marked as a change because one of 7/31/2022 12:39:41 PM, 8/2/2022 8:20:46 AM falls between 7/24/2022 6:07:37 PM and 8/2/2022 8:20:46 AM.
IsImprovementStdDev: Marked as improvement because 120.80564532655481 (T) = (0 -109.27693232148873) / Math.Sqrt((0.7339766979906134 / (299)) + (0.06953017762327127 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.10034921628874939 = (121.46594467544192 - 109.27693232148873) / 121.46594467544192 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository