[Perf] Windows/x64: 3 Improvements on 7/12/2023 7:15:00 AM #19879
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 83bf4b66ed3de5905b2e410a194a0f5f3d924c3d |
| Compare | 82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Diagnostics.Perf_Process
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| StartAndWaitForExit - Duration of single invocation 📝 - Benchmark Source |
9.62 ms | 7.76 ms | 0.81 | 0.14 | False | |||
| Start - Duration of single invocation 📝 - Benchmark Source |
2.97 ms | 1.43 ms | 0.48 | 0.30 | False | 1850000 | 3550000 | 1.9189189189189189) |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Diagnostics.Perf_Process*'Payloads
System.Diagnostics.Perf_Process.StartAndWaitForExit
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.7616825 < 9.402279407051282.
IsChangePoint: Marked as a change because one of 5/6/2023 11:12:53 AM, 7/12/2023 2:12:47 AM, 7/17/2023 6:26:12 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 6:26:12 PM.
IsImprovementStdDev: Marked as improvement because 15.82905216423524 (T) = (0 -8179509.783152113) / Math.Sqrt((144892725861.92346 / (299)) + (75037486135.15579 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.16121670243824515 = (9751636.455958283 - 8179509.783152113) / 9751636.455958283 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Diagnostics.Perf_Process.Start
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.42645 < 2.8750388333333334.
IsChangePoint: Marked as a change because one of 5/8/2023 11:50:12 PM, 7/2/2023 6:37:07 PM, 7/3/2023 3:46:39 PM, 7/11/2023 10:26:36 PM, 7/17/2023 6:26:12 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 6:26:12 PM.
IsImprovementStdDev: Marked as improvement because 45.12279605827771 (T) = (0 -1423358.8596491227) / Math.Sqrt((111252158030.27527 / (299)) + (5872721664.006237 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.5036609986736065 = (2867715.121812721 - 1423358.8596491227) / 2867715.121812721 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | Windows 10.0.18362 |
| Queue | TigerWindows |
| Baseline | 83bf4b66ed3de5905b2e410a194a0f5f3d924c3d |
| Compare | 82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_Byte
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| ToString - Duration of single invocation 📝 - Benchmark Source |
3.63 ns | 2.63 ns | 0.72 | 0.07 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Byte*'Payloads
System.Tests.Perf_Byte.ToString(value: 255)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.628996410754918 < 3.377995592320623.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 6/26/2023 10:42:28 PM, 7/12/2023 2:12:47 AM, 7/17/2023 6:26:12 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 6:26:12 PM.
IsImprovementStdDev: Marked as improvement because 11.051403962999444 (T) = (0 -2.330555894672302) / Math.Sqrt((0.27246339094221894 / (299)) + (0.018410283834375738 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.2118354782847959 = (2.956940880313345 - 2.330555894672302) / 2.956940880313345 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository