-
Notifications
You must be signed in to change notification settings - Fork 3
Description
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | f6b6415119b4d6d4421b3186a6a8aaa4803af969 |
| Compare | 27eb95c53f086e368b6dcc99cfdc1e6713d98ee6 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Buffers.Text.Tests.Utf8FormatterTests
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 10.92 ns | 8.78 ns | 0.80 | 0.17 | True | ||||
| 3.98 ns | 1.33 ns | 0.33 | 0.04 | True |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'Details
Payloads
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: -2147483648)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 8.778522553995263 < 10.231591283280784.
IsChangePoint: Marked as a change because one of 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 22.190430922245834 (T) = (0 -8.840345923603017) / Math.Sqrt((0.40453555623314147 / (68)) + (0.021938694126123884 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.1974395850696566 = (11.015178121350898 - 8.840345923603017) / 11.015178121350898 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.3260894111033263 < 3.7627009410143786.
IsChangePoint: Marked as a change because one of 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 92.73467024898108 (T) = (0 -1.325506699531602) / Math.Sqrt((0.0486253033024063 / (68)) + (7.388815677270218E-06 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.6518652989225748 = (3.8074535386140944 - 1.325506699531602) / 3.8074535386140944 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | f6b6415119b4d6d4421b3186a6a8aaa4803af969 |
| Compare | 27eb95c53f086e368b6dcc99cfdc1e6713d98ee6 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.ContainsKeyFalse<Int32, Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 23.46 μs | 17.53 μs | 0.75 | 0.11 | True |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse<Int32, Int32>*'Details
Payloads
System.Collections.ContainsKeyFalse<Int32, Int32>.SortedDictionary(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 17.53097654320987 < 22.27051779562024.
IsChangePoint: Marked as a change because one of 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 9.958856411701419 (T) = (0 -18261.013206158863) / Math.Sqrt((542787.311252309 / (62)) + (1755175.189863195 / (6))) is greater than 1.9965644189515825 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (62) + (6) - 2, .975) and 0.23038166767045454 = (23727.36256279771 - 18261.013206158863) / 23727.36256279771 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | f6b6415119b4d6d4421b3186a6a8aaa4803af969 |
| Compare | 27eb95c53f086e368b6dcc99cfdc1e6713d98ee6 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.IO.Tests.Perf_StreamWriter
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 106.55 ms | 87.61 ms | 0.82 | 0.38 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_StreamWriter*'Details
Payloads
System.IO.Tests.Perf_StreamWriter.WritePartialCharArray(writeLength: 2)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 87.6109985 < 101.51340363249999.
IsChangePoint: Marked as a change because one of 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 8.91770383028208 (T) = (0 -90322175.9728836) / Math.Sqrt((42588376612416.734 / (68)) + (20495733481261.164 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.16562688086387942 = (108251541.06882048 - 90322175.9728836) / 108251541.06882048 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | f6b6415119b4d6d4421b3186a6a8aaa4803af969 |
| Compare | 27eb95c53f086e368b6dcc99cfdc1e6713d98ee6 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Linq.Tests.Perf_Enumerable
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 210.18 ns | 192.17 ns | 0.91 | 0.03 | False | ||||
| 11.10 ns | 9.78 ns | 0.88 | 0.09 | False | ||||
| 5.09 ns | 3.98 ns | 0.78 | 0.29 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'Details
Payloads
System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: List)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 192.17008377235268 < 199.1222592644151.
IsChangePoint: Marked as a change because one of 8/14/2023 10:44:26 PM, 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 8.645065905256741 (T) = (0 -194.56145910242503) / Math.Sqrt((62.41054194438532 / (68)) + (5.54632271052485 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.05687826794273813 = (206.2951711207225 - 194.56145910242503) / 206.2951711207225 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Linq.Tests.Perf_Enumerable.Contains_ElementNotFound(input: ICollection)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 9.782993473984698 < 10.541559437216137.
IsChangePoint: Marked as a change because one of 8/15/2023 7:48:35 PM, 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 26.15063196490128 (T) = (0 -9.776464418294216) / Math.Sqrt((0.13521896495988908 / (68)) + (0.00017796899825791036 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.10727478472481512 = (10.951258294278823 - 9.776464418294216) / 10.951258294278823 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Linq.Tests.Perf_Enumerable.ElementAt(input: IList)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 3.975158904852031 < 5.35675585942774.
IsChangePoint: Marked as a change because one of 8/15/2023 7:48:35 PM, 8/28/2023 1:23:07 PM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 10.053815024073403 (T) = (0 -4.027586600594557) / Math.Sqrt((0.5240684053991004 / (49)) + (0.007702790287819613 / (25))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (49) + (25) - 2, .975) and 0.2075114850420327 = (5.082201854758962 - 4.027586600594557) / 5.082201854758962 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | f6b6415119b4d6d4421b3186a6a8aaa4803af969 |
| Compare | 27eb95c53f086e368b6dcc99cfdc1e6713d98ee6 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Text.Encodings.Web.Tests.Perf_Encoders
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 73.26 ns | 67.09 ns | 0.92 | 0.12 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'Details
Payloads
System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 67.08752725014091 < 69.29182973792324.
IsChangePoint: Marked as a change because one of 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 13.601909153993795 (T) = (0 -66.34620847813214) / Math.Sqrt((4.051102208154569 / (68)) + (1.1368494812094632 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.09281590706381436 = (73.13422820653355 - 66.34620847813214) / 73.13422820653355 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | f6b6415119b4d6d4421b3186a6a8aaa4803af969 |
| Compare | 27eb95c53f086e368b6dcc99cfdc1e6713d98ee6 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.TryGetValueTrue<Int32, Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 20.07 μs | 14.45 μs | 0.72 | 0.03 | True |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue<Int32, Int32>*'Details
Payloads
System.Collections.TryGetValueTrue<Int32, Int32>.SortedDictionary(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.450565250154181 < 19.074157374140164.
IsChangePoint: Marked as a change because one of 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 139.95853935851306 (T) = (0 -14455.025534811715) / Math.Sqrt((104666.73919505815 / (62)) + (339.4916980632919 / (6))) is greater than 1.9965644189515825 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (62) + (6) - 2, .975) and 0.28796944762486854 = (20301.13102112523 - 14455.025534811715) / 20301.13102112523 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | x64 |
| OS | ubuntu 22.04 |
| Queue | TigerUbuntu |
| Baseline | f6b6415119b4d6d4421b3186a6a8aaa4803af969 |
| Compare | 27eb95c53f086e368b6dcc99cfdc1e6713d98ee6 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Collections.IndexerSet<Int32>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 19.01 μs | 17.24 μs | 0.91 | 0.01 | True | ||||
| 4.69 μs | 2.33 μs | 0.50 | 0.45 | False | ||||
| 677.73 ns | 469.09 ns | 0.69 | 0.16 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSet<Int32>*'Details
Payloads
System.Collections.IndexerSet<Int32>.SortedDictionary(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 17.238612265193375 < 18.14753529900505.
IsChangePoint: Marked as a change because one of 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 41.37297881625694 (T) = (0 -17219.882565129465) / Math.Sqrt((72874.23096332162 / (68)) + (4116.759881967324 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.09151454385615373 = (18954.494481640806 - 17219.882565129465) / 18954.494481640806 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
JIT Disasms
System.Collections.IndexerSet<Int32>.Dictionary(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.330328107445833 < 2.4701226986489093.
IsChangePoint: Marked as a change because one of 8/26/2023 7:53:22 PM, 9/2/2023 3:43:46 AM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 5.621469298724456 (T) = (0 -2375.109419169881) / Math.Sqrt((388128.30172025994 / (68)) + (6061.58341272682 / (6))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (68) + (6) - 2, .975) and 0.16247453718879012 = (2835.8653254525166 - 2375.109419169881) / 2835.8653254525166 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
System.Collections.IndexerSet<Int32>.IList(Size: 512)
ETL Files
Histogram
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 469.0882420326446 < 539.7576037250099.
IsChangePoint: Marked as a change because one of 8/10/2023 8:47:51 AM, 8/28/2023 1:23:07 PM, 9/4/2023 7:24:21 PM falls between 8/27/2023 6:19:41 AM and 9/4/2023 7:24:21 PM.
IsImprovementStdDev: Marked as improvement because 13.683529419995152 (T) = (0 -468.711331888094) / Math.Sqrt((2513.310744531282 / (49)) + (3.5379911211176918 / (25))) is greater than 1.9934635666612894 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (49) + (25) - 2, .975) and 0.173123718001227 = (566.8457810340115 - 468.711331888094) / 566.8457810340115 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository











