Skip to content

ConfigurationBinderBenchmarks.Get benchmark failing in "Performance Linux x64 release mono Interpreter micro_mono perftiger NoJS False net8.0" #80141

@cincuranet

Description

@cincuranet

Fails in GlobalSetup. I can replicate it locally on Ubuntu/WSL.

[2022/12/20 23:21:24][INFO] // **************************
[2022/12/20 23:21:24][INFO] // Benchmark: ConfigurationBinderBenchmarks.Get: Job-TDQVES(PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=CoreRun, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1) [ConfigurationProvidersCount=32, KeysCountPerProvider=40]
[2022/12/20 23:21:24][INFO] // *** Execute ***
[2022/12/20 23:21:24][INFO] // Launch: 1 / 1
[2022/12/20 23:21:24][INFO] // Execute: /home/helixbot/work/B7FD098E/p/dotnet-mono/shared/Microsoft.NETCore.App/99e872d5-bd5c-4b27-99d1-11860ab546d6/corerun ab2b1701-43d7-408a-9771-2d483f95db93.dll --anonymousPipes 232 233 --benchmarkName "Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 32, KeysCountPerProvider: 40)" --job "PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=CoreRun, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1" --benchmarkId 11 in /home/helixbot/work/B7FD098E/w/B66509D1/e/performance/artifacts/bin/MicroBenchmarks/Release/net8.0/ab2b1701-43d7-408a-9771-2d483f95db93/bin/Release/net8.0/publish
[2022/12/20 23:21:24][INFO] Failed to set up high priority. Make sure you have the right permissions. Message: Permission denied
[2022/12/20 23:21:24][INFO] // BeforeAnythingElse
[2022/12/20 23:21:24][INFO] 
[2022/12/20 23:21:24][INFO] // Benchmark Process Environment Information:
[2022/12/20 23:21:24][INFO] // Runtime=.NET 8.0.0 (42.42.42.42424) using MonoVM, X64 AOT
[2022/12/20 23:21:24][INFO] // GC=Non-concurrent Workstation
[2022/12/20 23:21:24][INFO] // HardwareIntrinsics=
[2022/12/20 23:21:24][INFO] // Job: Job-NIZOQO(PowerPlanMode=00000000-0000-0000-0000-000000000000, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
[2022/12/20 23:21:24][INFO] 
[2022/12/20 23:21:24][INFO] 
[2022/12/20 23:21:24][INFO] System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
[2022/12/20 23:21:24][INFO]  ---> System.InvalidOperationException: Operation is not valid due to the current state of the object.
[2022/12/20 23:21:24][INFO]    at System.Text.Json.JsonElement.CheckValidInstance() in /_/src/libraries/System.Text.Json/src/System/Text/Json/Document/JsonElement.cs:line 1466
[2022/12/20 23:21:24][INFO]    at System.Text.Json.JsonElement.GetPropertyName() in /_/src/libraries/System.Text.Json/src/System/Text/Json/Document/JsonElement.cs:line 1161
[2022/12/20 23:21:24][INFO]    at System.Text.Json.JsonProperty.get_Name() in /_/src/libraries/System.Text.Json/src/System/Text/Json/Document/JsonProperty.cs:line 30
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.Json.JsonConfigurationFileParser.VisitObjectElement(JsonElement element) in /_/src/libraries/Microsoft.Extensions.Configuration.Json/src/JsonConfigurationFileParser.cs:line 50
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.Json.JsonConfigurationFileParser.ParseStream(Stream input) in /_/src/libraries/Microsoft.Extensions.Configuration.Json/src/JsonConfigurationFileParser.cs:line 37
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.Json.JsonConfigurationFileParser.Parse(Stream input) in /_/src/libraries/Microsoft.Extensions.Configuration.Json/src/JsonConfigurationFileParser.cs:line 20
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.Json.JsonStreamConfigurationProvider.Load(Stream stream) in /_/src/libraries/Microsoft.Extensions.Configuration.Json/src/JsonStreamConfigurationProvider.cs:line 25
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.StreamConfigurationProvider.Load() in /_/src/libraries/Microsoft.Extensions.Configuration/src/StreamConfigurationProvider.cs:line 53
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.ConfigurationRoot..ctor(IList`1 providers) in /_/src/libraries/Microsoft.Extensions.Configuration/src/ConfigurationRoot.cs:line 32
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.ConfigurationBuilder.Build() in /_/src/libraries/Microsoft.Extensions.Configuration/src/ConfigurationBuilder.cs:line 51
[2022/12/20 23:21:24][INFO]    at Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.GlobalSetup() in /home/helixbot/work/B7FD098E/w/B66509D1/e/performance/src/benchmarks/micro/libraries/Microsoft.Extensions.Configuration/ConfigurationBinderBenchmarks.cs:line 41
[2022/12/20 23:21:24][INFO]    at BenchmarkDotNet.Engines.EngineFactory.CreateReadyToRun(EngineParameters engineParameters)
[2022/12/20 23:21:24][INFO]    at BenchmarkDotNet.Autogenerated.Runnable_11.Run(IHost host, String benchmarkName) in /home/helixbot/work/B7FD098E/w/B66509D1/e/performance/artifacts/bin/MicroBenchmarks/Release/net8.0/ab2b1701-43d7-408a-9771-2d483f95db93/ab2b1701-43d7-408a-9771-2d483f95db93.notcs:line 2464
[2022/12/20 23:21:24][INFO]    at System.Reflection.MethodInvoker.InterpretedInvoke(Object obj, IntPtr* args) in /_/src/mono/System.Private.CoreLib/src/System/Reflection/MethodInvoker.Mono.cs:line 30
[2022/12/20 23:21:24][INFO]    at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodInvoker.cs:line 59
[2022/12/20 23:21:24][INFO]    --- End of inner exception stack trace ---
[2022/12/20 23:21:24][INFO]    at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodInvoker.cs:line 64
[2022/12/20 23:21:24][INFO]    at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/RuntimeMethodInfo.cs:line 160
[2022/12/20 23:21:24][INFO]    at System.Reflection.MethodBase.Invoke(Object obj, Object[] parameters) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBase.cs:line 54
[2022/12/20 23:21:24][INFO]    at BenchmarkDotNet.Autogenerated.UniqueProgramName.AfterAssemblyLoadingAttached(String[] args) in /home/helixbot/work/B7FD098E/w/B66509D1/e/performance/artifacts/bin/MicroBenchmarks/Release/net8.0/ab2b1701-43d7-408a-9771-2d483f95db93/ab2b1701-43d7-408a-9771-2d483f95db93.notcs:line 58
[2022/12/20 23:21:24][INFO] // AfterAll
[2022/12/20 23:21:24][INFO] No Workload Results were obtained from the run.
[2022/12/20 23:21:24][INFO] // Benchmark Process 5634 has exited with code 255.

Looks like the offending commit is 200a90a. With that at least 1 out of 3 test runs fails. Previous commit 4dd8a78 is fine.

Adding MONO_ENV_OPTIONS="--interpreter --interp=-cprop" also solves the issue.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions