-
Notifications
You must be signed in to change notification settings - Fork 3
Closed
Description
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | a4223dc25e6c0ff7da1185f0559b40d0ae75d3da |
| Compare | 8ab2e9f5df73b9a348c3753f66ca1fc0b674524f |
| Diff | Diff |
Improvements in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Count - Duration of single invocation | 495.69 ms | 363.27 ms | 0.73 | 0.52 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice*'Details
Payloads
Histogram
System.Text.RegularExpressions.Tests.Perf_Regex_Industry_SliceSlice.Count(Options: Compiled)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 363.2657 < 471.96625416666666.
IsChangePoint: Marked as a change because one of 4/17/2022 10:06:02 AM, 5/30/2022 9:21:47 AM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsImprovementStdDev: Marked as improvement because 13.188255606699308 (T) = (0 -381160066.9811321) / Math.Sqrt((2404778104261292 / (299)) + (599889315934919.8 / (53))) is greater than 1.9667650028636081 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (53) - 2, .975) and 0.1321304248034985 = (439190493.4503903 - 381160066.9811321) / 439190493.4503903 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
