-
Notifications
You must be signed in to change notification settings - Fork 3
Description
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | b9c11299d520ba7476b158a6cb69e7476328d7ae |
| Compare | b5ee6a11541fdac14b5b1892e396dc9bf78b667e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.CreateAddAndClear<String>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 9.88 μs | 8.42 μs | 0.85 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear<String>*'Details
Payloads
System.Collections.CreateAddAndClear<String>.ConcurrentQueue(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 8.421322036791292 < 9.304229773550928.
IsChangePoint: Marked as a change because one of 5/19/2023 4:22:12 AM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 31.820186433796447 (T) = (0 -8374.878927949183) / Math.Sqrt((141837.51279629784 / (299)) + (15056.811908893233 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.14970767551070632 = (9849.41141622011 - 8374.878927949183) / 9849.41141622011 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | b9c11299d520ba7476b158a6cb69e7476328d7ae |
| Compare | b5ee6a11541fdac14b5b1892e396dc9bf78b667e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_Array
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 52.47 ns | 33.21 ns | 0.63 | 0.07 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Array*'Details
Payloads
System.Tests.Perf_Array.Reverse
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 33.20769894272132 < 49.8553083274324.
IsChangePoint: Marked as a change because one of 4/6/2023 11:23:56 PM, 4/12/2023 8:39:35 PM, 4/28/2023 1:33:49 PM, 5/3/2023 7:05:50 AM, 7/1/2023 8:07:46 AM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 12.880813849586009 (T) = (0 -33.148709154701606) / Math.Sqrt((83.2690356492716 / (299)) + (0.004759387409911905 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.17030040427189105 = (39.952663982693295 - 33.148709154701606) / 39.952663982693295 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | b9c11299d520ba7476b158a6cb69e7476328d7ae |
| Compare | b5ee6a11541fdac14b5b1892e396dc9bf78b667e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Buffers.Tests.RentReturnArrayPoolTests<Object>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 74.69 μs | 63.89 μs | 0.86 | 0.13 | False | ||||
| 46.09 ns | 43.38 ns | 0.94 | 0.03 | False | ||||
| 71.10 μs | 64.88 μs | 0.91 | 0.28 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Object>*'Details
Payloads
System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 63.894577212666654 < 70.49590674596666.
IsChangePoint: Marked as a change because one of 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 20.045796732816157 (T) = (0 -64654.692393585974) / Math.Sqrt((7399640.697174522 / (299)) + (3719265.6369277053 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.17025660943924548 = (77921.31052697057 - 64654.692393585974) / 77921.31052697057 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 43.375536000000004 < 43.81901378828125.
IsChangePoint: Marked as a change because one of 6/1/2023 4:59:33 PM, 7/18/2023 9:59:03 AM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 11.036547153833924 (T) = (0 -42.372307544369406) / Math.Sqrt((4.489733452988712 / (299)) + (0.5032728648650169 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.06487134130028543 = (45.31174095689421 - 42.372307544369406) / 45.31174095689421 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Buffers.Tests.RentReturnArrayPoolTests<Object>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 64.87606145333334 < 67.56586555433451.
IsChangePoint: Marked as a change because one of 5/10/2023 10:36:48 PM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 6.482060542834885 (T) = (0 -62367.677180969775) / Math.Sqrt((9074990.946006874 / (299)) + (10343155.572234198 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.1014309786877399 = (69407.77580990798 - 62367.677180969775) / 69407.77580990798 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | b9c11299d520ba7476b158a6cb69e7476328d7ae |
| Compare | b5ee6a11541fdac14b5b1892e396dc9bf78b667e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.CreateAddAndClear<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 8.52 μs | 7.76 μs | 0.91 | 0.00 | True |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear<Int32>*'Details
Payloads
System.Collections.CreateAddAndClear<Int32>.ConcurrentQueue(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.764758544352216 < 8.160764186166565.
IsChangePoint: Marked as a change because one of 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 62.93461082030875 (T) = (0 -7799.423543934216) / Math.Sqrt((3272.7996277937714 / (299)) + (1403.729391522325 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.09440789872350322 = (8612.512778038115 - 7799.423543934216) / 8612.512778038115 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | b9c11299d520ba7476b158a6cb69e7476328d7ae |
| Compare | b5ee6a11541fdac14b5b1892e396dc9bf78b667e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 1.31 μs | 1.13 μs | 0.86 | 0.24 | False | ||||
| 78.08 μs | 68.26 μs | 0.87 | 0.16 | False | ||||
| 45.32 ns | 39.40 ns | 0.87 | 0.04 | False | ||||
| 72.90 μs | 60.57 μs | 0.83 | 0.14 | False | ||||
| 9.42 μs | 8.42 μs | 0.89 | 0.08 | False | ||||
| 71.48 μs | 56.06 μs | 0.78 | 0.21 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Byte>*'Details
Payloads
System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.1258874125 < 1.241689216475.
IsChangePoint: Marked as a change because one of 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 8.944217319139668 (T) = (0 -1157.0762443187054) / Math.Sqrt((1968.6145642510687 / (299)) + (1423.9100562251401 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.09027436194712062 = (1271.8958287195687 - 1157.0762443187054) / 1271.8958287195687 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 68.263692892 < 73.79483152089999.
IsChangePoint: Marked as a change because one of 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 13.612772280857383 (T) = (0 -69172.89129520986) / Math.Sqrt((6657072.653875238 / (299)) + (4921195.35470094 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.12926402437035095 = (79441.86668661458 - 69172.89129520986) / 79441.86668661458 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 39.40169096354166 < 42.36401670208333.
IsChangePoint: Marked as a change because one of 6/1/2023 4:59:33 PM, 7/18/2023 9:59:03 AM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 22.33560379310756 (T) = (0 -39.84863390854786) / Math.Sqrt((2.5882475133188647 / (299)) + (0.12189221478078283 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.07707711232599765 = (43.17655834603521 - 39.84863390854786) / 43.17655834603521 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 60.573562917333334 < 67.65625353226666.
IsChangePoint: Marked as a change because one of 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 17.559774294150586 (T) = (0 -62834.64069032276) / Math.Sqrt((3966685.820801899 / (299)) + (1776529.044326837 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.11368368867920843 = (70894.14906139589 - 62834.64069032276) / 70894.14906139589 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 8.419887774666666 < 9.032893868785896.
IsChangePoint: Marked as a change because one of 4/3/2023 11:26:06 PM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 34.34424771022511 (T) = (0 -8447.938184539995) / Math.Sqrt((67455.49366711351 / (299)) + (4868.960833218025 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.10117278498815015 = (9398.845566139895 - 8447.938184539995) / 9398.845566139895 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: True, UseSharedPool: False)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 56.064081720000004 < 67.48512483418331.
IsChangePoint: Marked as a change because one of 5/19/2023 1:23:34 PM, 8/3/2023 2:00:30 PM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 6.598654805630787 (T) = (0 -62192.422877515455) / Math.Sqrt((9315714.211676657 / (299)) + (10724627.128227267 / (11))) is greater than 1.9676960046166507 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (11) - 2, .975) and 0.09618810760093809 = (68811.24645575642 - 62192.422877515455) / 68811.24645575642 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | ubuntu 20.04 |
| Queue | AmpereUbuntu |
| Baseline | b9c11299d520ba7476b158a6cb69e7476328d7ae |
| Compare | b5ee6a11541fdac14b5b1892e396dc9bf78b667e |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Threading.Tests.Perf_SemaphoreSlim
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 68.00 ns | 54.99 ns | 0.81 | 0.03 | False | ||||
| 69.08 ns | 56.51 ns | 0.82 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_SemaphoreSlim*'Details
Payloads
System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWaitAsync
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 54.99022942294669 < 64.06890264516706.
IsChangePoint: Marked as a change because one of 4/25/2023 6:46:56 PM, 5/19/2023 4:22:12 AM, 7/29/2023 11:09:12 AM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 34.08987745849901 (T) = (0 -54.996379476241174) / Math.Sqrt((10.55934750178178 / (299)) + (0.03314189042559111 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.10905895671439074 = (61.72841614011374 - 54.996379476241174) / 61.72841614011374 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Threading.Tests.Perf_SemaphoreSlim.ReleaseWait
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 56.50572771202587 < 65.88829567067853.
IsChangePoint: Marked as a change because one of 4/26/2023 12:55:36 AM, 5/22/2023 10:35:01 AM, 7/29/2023 11:09:12 AM, 8/4/2023 10:42:53 AM, 8/9/2023 3:40:37 PM falls between 8/1/2023 12:22:20 AM and 8/9/2023 3:40:37 PM.
IsImprovementStdDev: Marked as improvement because 39.45931489784058 (T) = (0 -57.71307691465365) / Math.Sqrt((8.086239222258886 / (299)) + (0.26870070139485225 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.14022235517128495 = (67.12558445986491 - 57.71307691465365) / 67.12558445986491 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository













