Skip to content

[Perf] Windows/x64: 78 Improvements on 12/1/2022 1:10:54 PM #10365

@performanceautofiler

Description

@performanceautofiler

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 067e43a1363f6d1748acc679f1804cd48299ba89
Compare 776a87d9f0c9105c2729d1ab781d74bffa2a182b
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DivideBenchmark - Duration of single invocation 27.74 ns 22.83 ns 0.82 0.01 False
DivisionOperatorBenchmark - Duration of single invocation 27.38 ns 21.98 ns 0.80 0.00 False
SquareRootBenchmark - Duration of single invocation 20.46 ns 13.36 ns 0.65 0.04 False

graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<UInt32>.DivideBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 22.826180395786924 < 26.293911941979374.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 77.07481459319962 (T) = (0 -22.480150397815418) / Math.Sqrt((0.1548236286227109 / (262)) + (0.09471252756523273 / (22))) is greater than 1.968411900500806 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (262) + (22) - 2, .975) and 0.19348540015160273 = (27.873209489376972 - 22.480150397815418) / 27.873209489376972 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.976315869565102 < 25.933200443323415.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 88.75882256369866 (T) = (0 -22.243056428237274) / Math.Sqrt((0.09419171886061721 / (299)) + (0.07825624773960926 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.19891602691090257 = (27.766198270656673 - 22.243056428237274) / 27.766198270656673 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.364147874688188 < 19.210682298167225.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 44.93847839778605 (T) = (0 -13.091498391532252) / Math.Sqrt((3.7402504353262374 / (299)) + (0.019732563855612263 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.2844100829699443 = (18.294693762408606 - 13.091498391532252) / 18.294693762408606 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecture x64
OS Windows 10.0.18362
Baseline 067e43a1363f6d1748acc679f1804cd48299ba89
Compare 776a87d9f0c9105c2729d1ab781d74bffa2a182b
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DivisionOperatorBenchmark - Duration of single invocation 54.37 ns 43.85 ns 0.81 0.01 False
SquareRootBenchmark - Duration of single invocation 68.53 ns 38.27 ns 0.56 0.01 False
SumBenchmark - Duration of single invocation 29.81 ns 10.73 ns 0.36 0.05 False
DivideBenchmark - Duration of single invocation 54.32 ns 43.82 ns 0.81 0.01 False
MultiplyBenchmark - Duration of single invocation 38.12 ns 30.19 ns 0.79 0.02 False
MultiplyOperatorBenchmark - Duration of single invocation 37.84 ns 30.18 ns 0.80 0.01 False
DotBenchmark - Duration of single invocation 53.33 ns 18.94 ns 0.36 0.01 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.DivisionOperatorBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.8469439190636 < 51.64942516038073.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 110.47639644955824 (T) = (0 -43.783874498770636) / Math.Sqrt((1.3247247951286358 / (107)) + (0.01767417094745293 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.22463792631060958 = (56.46894010489147 - 43.783874498770636) / 56.46894010489147 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.270872194069526 < 65.053229479199.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 514.9485174150567 (T) = (0 -38.263090334380784) / Math.Sqrt((0.2379038026996817 / (107)) + (0.028837588595208692 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.44446679555471896 = (68.87633363443648 - 38.263090334380784) / 68.87633363443648 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.SumBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.73126088513603 < 28.27712225261814.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 88.11604805784948 (T) = (0 -11.8875683548653) / Math.Sqrt((3.642575123370617 / (107)) + (0.07787585093755647 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.5896585542079018 = (28.969943145563235 - 11.8875683548653) / 28.969943145563235 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.81700720707334 < 51.560930069888684.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 111.49978919721798 (T) = (0 -43.779496944531935) / Math.Sqrt((1.2180569385607432 / (107)) + (0.02064448387882959 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.22040229549049278 = (56.15652366764767 - 43.779496944531935) / 56.15652366764767 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 30.19296622598612 < 35.91400034504547.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 117.3036793991263 (T) = (0 -30.222498344400286) / Math.Sqrt((0.1221639964427724 / (107)) + (0.06614890717910667 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.1999949114634506 = (37.777882637829656 - 30.222498344400286) / 37.777882637829656 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 30.177259342785145 < 35.922701220702784.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 132.87630302940312 (T) = (0 -30.25203458457415) / Math.Sqrt((0.03933388097674107 / (107)) + (0.06333624661788345 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.20017041868892255 = (37.82310043470152 - 30.25203458457415) / 37.82310043470152 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;.DotBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.935478080564742 < 50.77833365597443.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 474.5624577679904 (T) = (0 -18.50993106378901) / Math.Sqrt((0.31695797837406947 / (107)) + (0.05280014546858758 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.6524663855636597 = (53.26083663535683 - 18.50993106378901) / 53.26083663535683 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 067e43a1363f6d1748acc679f1804cd48299ba89
Compare 776a87d9f0c9105c2729d1ab781d74bffa2a182b
Diff Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DotBenchmark - Duration of single invocation 11.20 ns 2.31 ns 0.21 0.07 False
SquareRootBenchmark - Duration of single invocation 11.42 ns 8.32 ns 0.73 0.09 False
MultiplyBenchmark - Duration of single invocation 9.93 ns 7.70 ns 0.78 0.15 False
DivisionOperatorBenchmark - Duration of single invocation 37.29 ns 33.60 ns 0.90 0.01 False
DivideBenchmark - Duration of single invocation 37.19 ns 33.69 ns 0.91 0.00 False
MultiplyOperatorBenchmark - Duration of single invocation 9.88 ns 7.70 ns 0.78 0.01 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Int64>.DotBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.3091030815774833 < 10.417216299615294.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 257.66377221820767 (T) = (0 -2.3546454846740583) / Math.Sqrt((0.1774057877302338 / (299)) + (0.014343681753542094 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.7943065205250277 = (11.447351129866806 - 2.3546454846740583) / 11.447351129866806 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;.SquareRootBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.31979423539817 < 11.01254285019863.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 67.62390914305746 (T) = (0 -8.382186307882764) / Math.Sqrt((0.27289032466195723 / (299)) + (0.014121924464225505 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.24132638476973245 = (11.04847478495566 - 8.382186307882764) / 11.04847478495566 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;.MultiplyBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.697919583621377 < 9.400736080269906.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 32.76988353880268 (T) = (0 -7.473838781349832) / Math.Sqrt((0.5523510669447258 / (299)) + (0.02063887936407875 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.18792188275602079 = (9.20334955793964 - 7.473838781349832) / 9.20334955793964 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 33.599982143174465 < 35.437347497905485.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 85.20392743696368 (T) = (0 -33.585695337468515) / Math.Sqrt((0.19325580879389376 / (299)) + (0.026491744415056258 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.09839384614278328 = (37.2509606259712 - 33.585695337468515) / 37.2509606259712 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 33.685884312711146 < 35.42109169593895.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 69.83917820951577 (T) = (0 -33.60609008025245) / Math.Sqrt((0.206114799708436 / (299)) + (0.04439214522777084 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.0975773542450083 = (37.23985677701679 - 33.60609008025245) / 37.23985677701679 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.69800048768593 < 9.386499205943098.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 29.582648648620566 (T) = (0 -7.482474144018055) / Math.Sqrt((0.6418293073815582 / (299)) + (0.01978778929400877 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.179118173166679 = (9.115166031733045 - 7.482474144018055) / 9.115166031733045 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture x64
OS Windows 10.0.18362
Baseline 067e43a1363f6d1748acc679f1804cd48299ba89
Compare 776a87d9f0c9105c2729d1ab781d74bffa2a182b
Diff Diff

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
SquareRootBenchmark - Duration of single invocation 41.01 ns 27.08 ns 0.66 0.01 False
DivideBenchmark - Duration of single invocation 33.68 ns 29.17 ns 0.87 0.01 False
DivisionOperatorBenchmark - Duration of single invocation 34.52 ns 28.91 ns 0.84 0.01 False

graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SquareRootBenchmark


Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 27.080209902613827 < 38.80102757072071.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 199.99131120801312 (T) = (0 -26.56600832733476) / Math.Sqrt((0.21700267630403697 / (107)) + (0.06375100385926004 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.3457012017310642 = (40.60225755819799 - 26.56600832733476) / 40.60225755819799 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.DivideBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 29.166301578334515 < 31.981938745423605.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 100.290765291543 (T) = (0 -28.872184244319328) / Math.Sqrt((0.03703206615138227 / (107)) + (0.047012645526390194 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.14755063974139665 = (33.869676710837716 - 28.872184244319328) / 33.869676710837716 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 28.912732225083033 < 32.0228513443476.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 12/6/2022 5:44:36 AM falls between 11/27/2022 4:37:47 PM and 12/6/2022 5:44:36 AM.
IsImprovementStdDev: Marked as improvement because 95.75094979974396 (T) = (0 -28.904323485524955) / Math.Sqrt((0.03821568391862624 / (107)) + (0.05200110848381395 / (22))) is greater than 1.9788195347025928 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (107) + (22) - 2, .975) and 0.147336303423437 = (33.89885555298713 - 28.904323485524955) / 33.89885555298713 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions