[Perf] Windows/arm64: 45 Regressions on 2/28/2024 10:09:11 PM #30641
Description
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.19041 |
| Queue | SurfaceWindows |
| Baseline | e101ae2bd1c198ba7aaa209d1a4c55d6ce6b4073 |
| Compare | 207f2bb27c188809339eeea6c8405dfc29a35859 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in Exceptions.Handling
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 11.07 μs | 21.13 μs | 1.91 | 0.17 | False | ||||
| 4.15 μs | 9.77 μs | 2.36 | 0.08 | False | ||||
| 4.41 μs | 7.55 μs | 1.71 | 0.09 | False | ||||
| 11.78 μs | 20.55 μs | 1.74 | 0.12 | False | ||||
| 4.74 μs | 7.59 μs | 1.60 | 0.12 | False | ||||
| 16.12 μs | 23.43 μs | 1.45 | 0.08 | False | ||||
| 4.48 μs | 7.41 μs | 1.65 | 0.09 | False | ||||
| 12.34 μs | 23.10 μs | 1.87 | 0.15 | False | ||||
| 10.48 μs | 22.50 μs | 2.15 | 0.13 | False | ||||
| 4.26 μs | 7.46 μs | 1.75 | 0.08 | False | ||||
| 22.84 μs | 33.06 μs | 1.45 | 0.10 | False | ||||
| 11.09 μs | 23.40 μs | 2.11 | 0.07 | False | ||||
| 16.59 μs | 20.72 μs | 1.25 | 0.09 | False | ||||
| 15.54 μs | 23.57 μs | 1.52 | 0.13 | False | ||||
| 4.41 μs | 7.57 μs | 1.72 | 0.14 | False | ||||
| 11.83 μs | 23.63 μs | 2.00 | 0.14 | False | ||||
| 17.03 μs | 21.01 μs | 1.23 | 0.10 | False | ||||
| 4.34 μs | 9.82 μs | 2.26 | 0.10 | False | ||||
| 4.32 μs | 9.83 μs | 2.28 | 0.13 | False | ||||
| 4.62 μs | 7.65 μs | 1.66 | 0.11 | False | ||||
| 11.86 μs | 20.88 μs | 1.76 | 0.16 | False | ||||
| 4.26 μs | 7.38 μs | 1.73 | 0.11 | False | ||||
| 4.37 μs | 9.70 μs | 2.22 | 0.10 | False | ||||
| 4.16 μs | 9.67 μs | 2.32 | 0.11 | False | ||||
| 23.53 μs | 34.42 μs | 1.46 | 0.10 | False | ||||
| 4.71 μs | 9.98 μs | 2.12 | 0.11 | False | ||||
| 4.50 μs | 7.58 μs | 1.69 | 0.11 | False | ||||
| 4.39 μs | 9.95 μs | 2.27 | 0.10 | False | ||||
| 22.79 μs | 37.20 μs | 1.63 | 0.09 | False | ||||
| 10.97 μs | 19.72 μs | 1.80 | 0.11 | False | ||||
| 4.80 μs | 9.87 μs | 2.06 | 0.10 | False | ||||
| 21.50 μs | 35.86 μs | 1.67 | 0.12 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Exceptions.Handling*'Details
Payloads
Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchFinally(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchWhenFinally(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.TryAndFinallyDeep(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.MultipleNestedTryFinally(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionHardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchFinally(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.TryAndFinallyDeep(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchDeep(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchDeep(kind: ReflectionSoftware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch(kind: ReflectionSoftware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch(kind: ReflectionHardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchWhen(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionSoftware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchWhenFinally(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchWhen(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.MultipleNestedTryCatch_FirstCatches(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.MultipleNestedTryCatch_FirstCatches(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: ReflectionSoftware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.MultipleNestedTryCatch_LastCatches(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.MultipleNestedTryCatch_LastCatches(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: ReflectionHardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchDeep(kind: Software)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.MultipleNestedTryFinally(kind: Hardware)
ETL Files
Histogram
JIT Disasms
Exceptions.Handling.ThrowAndCatchDeep(kind: ReflectionHardware)
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Name | Value |
|---|---|
| Architecture | arm64 |
| OS | Windows 10.0.19041 |
| Queue | SurfaceWindows |
| Baseline | e101ae2bd1c198ba7aaa209d1a4c55d6ce6b4073 |
| Compare | 207f2bb27c188809339eeea6c8405dfc29a35859 |
| Diff | Diff |
| Configs | CompilationMode:tiered, RunKind:micro |
Regressions in System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives<Single>
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
|---|---|---|---|---|---|---|---|---|
| 31.33 ns | 33.88 ns | 1.08 | 0.02 | True |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives<Single>*'Details
Payloads
System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives<Single>.Distance(BufferLength: 128)
ETL Files
Histogram
JIT Disasms
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository