Details
Payloads
Baseline
Compare
Histogram
Span.IndexerBench.Indexer5(length: 1024)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 1012.2516095370784 (T) = (0 -792.2556437768623) / Math.Sqrt((4.192152244834137 / (299)) + (0.04488686982677043 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.14217194148578266 = (923.5599557667438 - 792.2556437768623) / 923.5599557667438 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### Span.IndexerBench.Fixed2(length: 1024)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/2/2021 4:22:41 PM, 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 32.15634749462845 (T) = (0 -966.3020986865672) / Math.Sqrt((37.61139641141697 / (299)) + (1453.691443334185 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.23544661878626397 = (1263.8778696558154 - 966.3020986865672) / 1263.8778696558154 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### Span.IndexerBench.CoveredIndex1(length: 1024)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 143.43228390895982 (T) = (0 -1583.8682548318968) / Math.Sqrt((452.18874915698774 / (299)) + (2.400694324558875 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.10430330229695033 = (1768.308690758394 - 1583.8682548318968) / 1768.308690758394 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### Span.IndexerBench.Fixed1(length: 1024)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/2/2021 4:22:41 PM, 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 23.03718283952055 (T) = (0 -941.8437401171865) / Math.Sqrt((31.340125419406824 / (299)) + (3309.8456655801283 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.25450290831856126 = (1263.3768134398697 - 941.8437401171865) / 1263.3768134398697 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### Span.IndexerBench.Indexer6(length: 1024)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 133.8094386794249 (T) = (0 -792.40434010995) / Math.Sqrt((16.627129738494016 / (299)) + (15.076155431738766 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.1408442369903772 = (922.3057962553349 - 792.40434010995) / 922.3057962553349 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Details
Payloads
Baseline
Compare
Histogram
System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 78.74625111055448 (T) = (0 -1814.8191174710191) / Math.Sqrt((99.49227864788256 / (299)) + (6179.631540557241 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.4528523311677933 = (3316.8726120033384 - 1814.8191174710191) / 3316.8726120033384 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 67.01293396083874 (T) = (0 -2211.9637140318832) / Math.Sqrt((232.81787729748933 / (299)) + (5523.51221554674 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.353480380612911 = (3421.340432218995 - 2211.9637140318832) / 3421.340432218995 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 67.22922486215384 (T) = (0 -3366.453944755666) / Math.Sqrt((10604.922571561303 / (299)) + (6288.814231082381 / (16))) is greater than 1.9675720194858106 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (16) - 2, .975) and 0.29248616709386405 = (4758.145760808446 - 3366.453944755666) / 4758.145760808446 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 410.6173824394327 (T) = (0 -18484.324240164617) / Math.Sqrt((7994.979790127664 / (299)) + (10466.402394102905 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.3602214146624097 = (28891.75202763475 - 18484.324240164617) / 28891.75202763475 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 13.056022408314096 (T) = (0 -3615.5557357939456) / Math.Sqrt((82045.80807416352 / (299)) + (57102.55844223259 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.1787568460328365 = (4402.539879119053 - 3615.5557357939456) / 4402.539879119053 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 127.7128364237592 (T) = (0 -18560.294277260935) / Math.Sqrt((63279.18805718723 / (299)) + (119560.49859883924 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.36935396494469974 = (29430.604880649753 - 18560.294277260935) / 29430.604880649753 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.MultipleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 745.3214370562816 (T) = (0 -17066.58257351325) / Math.Sqrt((2746.587537335524 / (299)) + (3195.9153174097855 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.38012890098107643 = (27532.47021925156 - 17066.58257351325) / 27532.47021925156 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 75.35002186656249 (T) = (0 -2867.6997718374605) / Math.Sqrt((4504.502259630132 / (299)) + (3781.2578652199886 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.2882181128346196 = (4028.9024257948827 - 2867.6997718374605) / 4028.9024257948827 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 105.11280222394153 (T) = (0 -1867.6450309765135) / Math.Sqrt((33.51090402642433 / (299)) + (3697.1046772759973 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.45360982333298744 = (3418.152651222929 - 1867.6450309765135) / 3418.152651222929 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.ProducerConsumer(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 9.250252963195182 (T) = (0 -6818.248459882355) / Math.Sqrt((261997.39447023533 / (299)) + (404264.61854643724 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.17562004189053032 = (8270.759608856184 - 6818.248459882355) / 8270.759608856184 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 3/22/2022 12:26:23 PM, 4/4/2022 9:46:30 AM falls between 3/22/2022 12:26:23 PM and 4/4/2022 9:46:30 AM.
IsImprovementStdDev: Marked as improvement because 65.22726683366132 (T) = (0 -3277.2149817170525) / Math.Sqrt((11204.705483925267 / (299)) + (6917.4288083683105 / (17))) is greater than 1.9675476980854363 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (17) - 2, .975) and 0.2955602825312979 = (4652.229141044503 - 3277.2149817170525) / 4652.229141044503 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository