Skip to content

[ci-scan] Test failure: AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth on osx-arm64 CoreCLR interpreter. #133812

New issue
New issue
Closed
#133854
Closed
[ci-scan] Test failure: AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth on osx-arm64 CoreCLR interpreter.#133812
#133854
Assignees
lateralusX
Labels
Known Build ErrorUse this to report build issues in the .NET Helix tabagentic-workflowsarea-Diagnostics-coreclrblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
Milestone
12.0.0

Description

@github-actions
github-actions
bot
opened on Sep 13, 2026

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1588973
Build error leg or test failing: osx-arm64 Release NoDynamicCodeCompiled - System.Threading.Tasks.Tests (runtime-libraries-interpreter, def 330)

KBE authoring guidance (ci-failure-scan)
  • Error Details is for readers. Paste the full exception, stack trace, or build error excerpt so the failure is understandable without opening the raw log.
  • Build Analysis parses only the single JSON block under Error Message.
  • ErrorMessage is a case-sensitive ordinal String.Contains substring copied verbatim from the failing log.
  • Set BuildRetry to true only for a clear infrastructure retry case. ExcludeConsoleLog disables Helix console-log scanning.

Error Details

AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth fails on the osx-arm64 NoDynamicCodeCompiled (NativeAOT) leg: the async event dump reports fewer resumed frames than expected (Expected 255 / Actual 153), indicating the callstack depth is not preserved. Reproduces in source build 1588973 and the following build 1592661, so the signature is stable across builds. This is a distinct test method from the already-tracked StateMachineAsync_CustomSyncContext (#133108).

System.Threading.Tasks.Tests.AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth [FAIL]
  Assert.Equal() Failure: Values differ
  Expected: 255
  Actual:   153
  ----- BEGIN ASYNC EVENTS (CSV) -----
  ...
    at System.Threading.Tasks.Tests.AsyncProfilerTests.AssertEqual[T](EventDump dump, T expected, T actual)

Error Message

{
  "ErrorMessage": [
    "System.Threading.Tasks.Tests.AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth [FAIL]",
    "at System.Threading.Tasks.Tests.AsyncProfilerTests.AssertEqual[T](EventDump dump, T expected, T actual)"
  ],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
Agentic workflow metadata (ci-failure-scan)

Workflow artifact: ci-failure-scan
Artifact kind: kbe-verification
Verified match count: 1 hits in failure.log

Filed by ci-failure-scan (detection only). ci-failure-fix walks open [ci-scan] KBEs and either opens a small fix PR or comments here to loop in owners — it never disables the test.

Note

This issue was generated by an AI agent (GitHub Copilot / ci-failure-scan workflow).

Generated by CI Outer-Loop Failure Scanner · opus48 · 996.9 AIC · ⌖ 16.7 AIC · ⊞ 19.7K · ◷

Report

Build Repository Test Pull Request
1595619 dotnet/runtime System.Threading.Tasks.Tests.AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth
1588973 dotnet/runtime System.Threading.Tasks.Tests.AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 2 2

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1588973
Error message validated: [System.Threading.Tasks.Tests.AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth [FAIL] at System.Threading.Tasks.Tests.AsyncProfilerTests.AssertEqual[T](EventDump dump, T expected, T actual)]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 9/14/2026 8:24:14 AM UTC

Activity

  1. github-actions
    added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    Known Build ErrorUse this to report build issues in the .NET Helix tab
    agentic-workflows
    on Sep 13, 2026
  2. dotnet-policy-service
    added
    untriagedNew issue has not been triaged by the area owner
    on Sep 13, 2026
  3. jkotas
    added
    area-Diagnostics-coreclr
    on Sep 13, 2026

  4. dotnet-policy-service commented on Sep 13, 2026

    @dotnet-policy-service
    dotnet-policy-serviceBot
    on Sep 13, 2026 – with Dotnet Policy Service
    Contributor

    Tagging subscribers to this area: @steveisok, @tommcdon, @dotnet/dotnet-diag
    See info in area-owners.md if you want to be subscribed.

  5. lateralusX commented on Sep 14, 2026

    @lateralusX
    lateralusX
    on Sep 14, 2026
    Member

    Async Profiler event data:

    ----- BEGIN ASYNC EVENTS (CSV) -----\nseq,delta,thread,event,disp,parent,frames,unwind\n0,0,7052358,AsyncProfilerMetadata,0,0,0,0\n1,19125,7052358,ResetAsyncThreadContext,0,0,0,0\n2,2147000,7052358,ResumeStateMachineAsyncCallstack,285,0,255,0\n3,4644375,7052360,ResetAsyncThreadContext,0,0,0,0\n4,4645750,7052360,ResumeStateMachineAsyncCallstack,286,0,153,0\n5,7614958,7052358,ResumeStateMachineAsyncCallstack,288,0,255,0\n6,8941542,7052360,ResumeStateMachineAsyncCallstack,289,0,153,0\n7,11468833,7052358,ResumeStateMachineAsyncCallstack,290,0,255,0\n8,13257542,7052360,ResumeStateMachineAsyncCallstack,291,0,153,0\n9,16663917,7052358,ResumeStateMachineAsyncCallstack,292,0,255,0\n10,18035417,7052360,ResumeStateMachineAsyncCallstack,293,0,153,0\n11,20682500,7052358,ResumeStateMachineAsyncCallstack,294,0,255,0\n12,22047958,7052360,ResumeStateMachineAsyncCallstack,295,0,153,0\n13,24689458,7052358,ResumeStateMachineAsyncCallstack,296,0,255,0\n14,25981958,7052360,ResumeStateMachineAsyncCallstack,297,0,153,0\n15,28139083,7052358,ResumeStateMachineAsyncCallstack,298,0,255,0\n16,29257333,7052360,ResumeStateMachineAsyncCallstack,299,0,153,0\n17,31422292,7052358,ResumeStateMachineAsyncCallstack,300,0,255,0\n18,32536500,7052360,ResumeStateMachineAsyncCallstack,301,0,153,0\n19,34695125,7052358,ResumeStateMachineAsyncCallstack,302,0,255,0\n20,35659292,7052360,ResumeStateMachineAsyncCallstack,303,0,153,0\n21,37506792,7052358,ResumeStateMachineAsyncCallstack,304,0,255,0\n22,38455333,7052360,ResumeStateMachineAsyncCallstack,305,0,153,0\n23,40319500,7052358,ResumeStateMachineAsyncCallstack,306,0,255,0\n24,41298167,7052360,ResumeStateMachineAsyncCallstack,307,0,153,0\n25,43149583,7052358,ResumeStateMachineAsyncCallstack,308,0,255,0\n26,44099500,7052360,ResumeStateMachineAsyncCallstack,309,0,153,0\n27,45707375,7052358,ResumeStateMachineAsyncCallstack,310,0,255,0\n28,46532875,7052360,ResumeStateMachineAsyncCallstack,311,0,153,0\n29,48130667,7052358,ResumeStateMachineAsyncCallstack,312,0,255,0\n30,48913250,7052360,ResumeStateMachineAsyncCallstack,313,0,153,0\n31,50342833,7052358,ResumeStateMachineAsyncCallstack,314,0,255,0\n32,51078292,7052360,ResumeStateMachineAsyncCallstack,315,0,153,0\n33,52509833,7052358,ResumeStateMachineAsyncCallstack,316,0,255,0\n34,53248542,7052360,ResumeStateMachineAsyncCallstack,317,0,153,0\n35,54680375,7052358,ResumeStateMachineAsyncCallstack,318,0,255,0\n36,55415500,7052360,ResumeStateMachineAsyncCallstack,319,0,153,0\n37,56845958,7052358,ResumeStateMachineAsyncCallstack,320,0,255,0\n38,57581333,7052360,ResumeStateMachineAsyncCallstack,321,0,153,0\n39,58901125,7052358,ResumeStateMachineAsyncCallstack,322,0,255,0\n40,59575833,7052360,ResumeStateMachineAsyncCallstack,323,0,153,0\n41,60887958,7052358,ResumeStateMachineAsyncCallstack,324,0,255,0\n42,61566833,7052360,ResumeStateMachineAsyncCallstack,325,0,153,0\n43,62843042,7052358,ResumeStateMachineAsyncCallstack,326,0,255,0\n44,63476167,7052360,ResumeStateMachineAsyncCallstack,327,0,153,0\n45,64706042,7052358,ResumeStateMachineAsyncCallstack,328,0,255,0\n46,65341833,7052360,ResumeStateMachineAsyncCallstack,329,0,153,0\n47,66568208,7052358,ResumeStateMachineAsyncCallstack,330,0,255,0\n48,67176625,7052360,ResumeStateMachineAsyncCallstack,331,0,153,0\n49,68328792,7052358,ResumeStateMachineAsyncCallstack,332,0,255,0\n50,68922708,7052360,ResumeStateMachineAsyncCallstack,333,0,153,0\n51,70282875,7052358,ResumeStateMachineAsyncCallstack,334,0,255,0\n52,70700667,7052360,ResumeStateMachineAsyncCallstack,335,0,153,0\n53,71836042,7052358,ResumeStateMachineAsyncCallstack,336,0,255,0\n54,72404250,7052360,ResumeStateMachineAsyncCallstack,337,0,153,0\n55,73505917,7052358,ResumeStateMachineAsyncCallstack,338,0,255,0\n56,74070750,7052360,ResumeStateMachineAsyncCallstack,339,0,153,0\n57,75171833,7052358,ResumeStateMachineAsyncCallstack,340,0,255,0\n58,75739208,7052360,ResumeStateMachineAsyncCallstack,341,0,153,0\n59,76812458,705

  6. lateralusX
    self-assigned this
    on Sep 14, 2026
  7. lateralusX
    removed
    untriagedNew issue has not been triaged by the area owner
    on Sep 14, 2026
  8. lateralusX
    added this to the 12.0.0 milestone on Sep 14, 2026

  9. lateralusX commented on Sep 14, 2026

    @lateralusX
    lateralusX
    on Sep 14, 2026
    Member

    Seems to be interpreter related, since its hit on the runtime-libraries-interpreter CI leg.

  10. lateralusX
    changed the title [-][ci-scan] Test failure: AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth on osx-arm64 NativeAOT[/-] [+][ci-scan] Test failure: AsyncProfilerTests.StateMachineAsync_CallstackOverflow_PreservesFullDepth on osx-arm64 CoreCLR interpreter.[/+] on Sep 14, 2026

  11. lateralusX commented on Sep 14, 2026

    @lateralusX
    lateralusX
    on Sep 14, 2026
    Member

    Test doesn't take into account AsyncV1 canInlineContinuations but assume the full suspended continuation chain will be executed in one resume. On interpreter, TryEnsureSufficientExecutionStack have specific checks not just on the physical stack size but also on the interpreter stack and this test will be 300 frames deep and probably run out of interpreter stack space after resuming 150+ AsyncV1 continuations that consume several frames per continuation. Test needs to better handle this AsyncV1 scenario where a resume is split over multiple resumes due to lack of execution stack.

  12. lateralusX
    closed this as completedin #133854on Sep 15, 2026
  13. lateralusX
    added a commit that references this issue on Sep 15, 2026

    Fix async profiler overflow test's full-depth resume filtering. (#133854

    630cdb6
  14. jtschuster
    added a commit that references this issue on Sep 18, 2026

    Fix async profiler overflow test's full-depth resume filtering. (dotn…

    73d4347
  15. github-actions
    locked and limited conversation to collaborators on Oct 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Known Build ErrorUse this to report build issues in the .NET Helix tabagentic-workflowsarea-Diagnostics-coreclrblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions