[Perf] Linux/x64: 3 Improvements on 7/12/2023 4:12:15 PM #19874
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 18.04 |
| Queue | TigerUbuntu |
| Baseline | 546429639d35977305da69fe2c5d3c856b61123d |
| Compare | d9f6b98de38081b71fa9b5a463f302288546435d |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_Int32
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| TryParseSpan - Duration of single invocation 📝 - Benchmark Source |
18.03 ns | 13.51 ns | 0.75 | 0.13 | False | |||
| TryParse - Duration of single invocation 📝 - Benchmark Source |
17.14 ns | 13.57 ns | 0.79 | 0.13 | False | |||
| ParseSpan - Duration of single invocation 📝 - Benchmark Source |
16.93 ns | 14.01 ns | 0.83 | 0.13 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'Payloads
System.Tests.Perf_Int32.TryParseSpan(value: "2147483647")
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.513110235847268 < 15.886555724848106.
IsChangePoint: Marked as a change because one of 5/2/2023 3:18:41 PM, 7/12/2023 7:15:00 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM.
IsImprovementStdDev: Marked as improvement because 10.055544761624395 (T) = (0 -13.713480859287007) / Math.Sqrt((1.7961127103898287 / (299)) + (1.8631133112666702 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.2638373723136595 = (18.628330675229495 - 13.713480859287007) / 18.628330675229495 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Tests.Perf_Int32.TryParse(value: "2147483647")
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.571864203482647 < 16.134476383161317.
IsChangePoint: Marked as a change because one of 5/2/2023 9:04:55 PM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM.
IsImprovementStdDev: Marked as improvement because 37.678265654717016 (T) = (0 -13.437293000442647) / Math.Sqrt((1.9433510069755444 / (299)) + (0.09738284495582017 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.26955087660527316 = (18.39593281732406 - 13.437293000442647) / 18.39593281732406 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Tests.Perf_Int32.ParseSpan(value: "2147483647")
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.0077867175092 < 16.386588773813095.
IsChangePoint: Marked as a change because one of 5/3/2023 7:05:50 AM, 7/12/2023 2:12:47 AM, 7/17/2023 10:23:26 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 10:23:26 PM.
IsImprovementStdDev: Marked as improvement because 30.311433041947147 (T) = (0 -13.455503909556514) / Math.Sqrt((2.036599886907039 / (299)) + (0.2024921541970603 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.2783284929636763 = (18.64491500407714 - 13.455503909556514) / 18.64491500407714 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository