[Perf] Alpine/x64: 6 Improvements on 4/9/2023 11:24:15 AM #17049
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | alpine 3.15 |
| Queue | TigerAlpine |
| Baseline | 1411364699b5784040e86f76cb3db8200f6a2c8c |
| Compare | 86b48d7c6f081c12dcc9c048fb53de1b78c9966f |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_DateTimeOffset
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ToString - Duration of single invocation | 277.40 ns | 180.39 ns | 0.65 | 0.01 | True | |||||
| ToString - Duration of single invocation | 283.02 ns | 185.24 ns | 0.65 | 0.02 | True | |||||
| ToString - Duration of single invocation | 28.83 ns | 25.37 ns | 0.88 | 0.03 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'Details
Payloads
Histogram
System.Tests.Perf_DateTimeOffset.ToString(format: null)
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 180.38981720866 < 262.56845806682435.
IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 4:44:56 PM falls between 4/3/2023 9:14:01 PM and 4/12/2023 4:44:56 PM.
IsImprovementStdDev: Marked as improvement because 147.89797386754177 (T) = (0 -181.19451136566488) / Math.Sqrt((10.468934199031567 / (299)) + (4.620385931083226 / (12))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (12) - 2, .975) and 0.34598275921111415 = (277.04852420573076 - 181.19451136566488) / 277.04852420573076 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
System.Tests.Perf_DateTimeOffset.ToString(value: 12/30/2017 3:45:22 AM -08:00)
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 185.23679144451944 < 266.41150337800667.
IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 4:44:56 PM falls between 4/3/2023 9:14:01 PM and 4/12/2023 4:44:56 PM.
IsImprovementStdDev: Marked as improvement because 84.4955204300451 (T) = (0 -187.7927568367476) / Math.Sqrt((9.90258002815979 / (299)) + (16.606448046597965 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.3319220880790236 = (281.0940961912249 - 187.7927568367476) / 281.0940961912249 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
System.Tests.Perf_DateTimeOffset.ToString(format: "r")
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 25.368191309069687 < 27.29086308590269.
IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 4:44:56 PM falls between 4/3/2023 9:14:01 PM and 4/12/2023 4:44:56 PM.
IsImprovementStdDev: Marked as improvement because 21.039864567084262 (T) = (0 -25.4795435998435) / Math.Sqrt((0.3407477054726829 / (299)) + (0.2902490150213683 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.10883099694143637 = (28.591146586557272 - 25.4795435998435) / 28.591146586557272 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | alpine 3.15 |
| Queue | TigerAlpine |
| Baseline | 1411364699b5784040e86f76cb3db8200f6a2c8c |
| Compare | 86b48d7c6f081c12dcc9c048fb53de1b78c9966f |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_DateTime
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| ToString - Duration of single invocation | 23.09 ns | 20.65 ns | 0.89 | 0.04 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'Details
Payloads
Histogram
System.Tests.Perf_DateTime.ToString(format: "r")
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 20.645134594348175 < 22.065500426945707.
IsChangePoint: Marked as a change because one of 1/31/2023 8:24:06 AM, 1/31/2023 6:07:33 PM, 4/9/2023 4:09:45 AM, 4/12/2023 4:44:56 PM falls between 4/3/2023 9:14:01 PM and 4/12/2023 4:44:56 PM.
IsImprovementStdDev: Marked as improvement because 19.11115980990107 (T) = (0 -20.836422323461125) / Math.Sqrt((0.2566886888108114 / (299)) + (0.23849111642780196 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.10928289417866417 = (23.39286198421858 - 20.836422323461125) / 23.39286198421858 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | alpine 3.15 |
| Queue | TigerAlpine |
| Baseline | 1411364699b5784040e86f76cb3db8200f6a2c8c |
| Compare | 86b48d7c6f081c12dcc9c048fb53de1b78c9966f |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Text.Tests.Perf_StringBuilder
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Append_ValueTypes - Duration of single invocation | 2.31 μs | 1.96 μs | 0.85 | 0.00 | True | |||||
| Append_ValueTypes_Interpolated - Duration of single invocation | 2.91 μs | 2.37 μs | 0.81 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_StringBuilder*'Details
Payloads
Histogram
System.Text.Tests.Perf_StringBuilder.Append_ValueTypes
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.9589071286332524 < 2.19770340534766.
IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 4:44:56 PM falls between 4/3/2023 9:14:01 PM and 4/12/2023 4:44:56 PM.
IsImprovementStdDev: Marked as improvement because 59.79899629963798 (T) = (0 -1957.2719042278766) / Math.Sqrt((484.93726957319717 / (299)) + (520.9912366968343 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.15994325741949064 = (2329.9282120103876 - 1957.2719042278766) / 2329.9282120103876 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
System.Text.Tests.Perf_StringBuilder.Append_ValueTypes_Interpolated
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.3659120221917935 < 2.7750039552851367.
IsChangePoint: Marked as a change because one of 2/9/2023 12:40:40 PM, 4/9/2023 4:09:45 AM, 4/12/2023 4:44:56 PM falls between 4/3/2023 9:14:01 PM and 4/12/2023 4:44:56 PM.
IsImprovementStdDev: Marked as improvement because 78.00118993589494 (T) = (0 -2351.1407554400407) / Math.Sqrt((884.8281894747479 / (299)) + (653.1786046891253 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.19483927513498744 = (2920.0887261785106 - 2351.1407554400407) / 2920.0887261785106 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository