Skip to content

Enable Remaining Libraries Tests in TestReadyToRun Pipeline #95928

New issue
New issue
Open
#124619
#96721
Open
Enable Remaining Libraries Tests in TestReadyToRun Pipeline#95928
#124619
#96721
Labels
area-ReadyToRundisabled-testThe test is disabled in source code against the issue
Milestone
12.0.0

Description

@ivdiazsa
ivdiazsa
opened on Dec 12, 2023

PR #91229 adds a new pipeline where we build and run the libraries tests with R2R enabled. We spent a lot of time trying to get them all running at once, but it proved to be a neverending task due to the amount of hidden test cases that would fail and crash/halt the entire test runs. So, in order to get the benefits of the coverage these new pipelines provide, we only enabled the assemblies we confirmed worked and passed correctly. Which leads us to the creation of this issue. This is a tracking issue of the necessary work to gradually enable the remaining tests.

Activity

  1. ivdiazsa
    added
    area-Infrastructure-libraries
    on Dec 12, 2023
  2. ivdiazsa
    added this to the 9.0.0 milestone on Dec 12, 2023
  3. ivdiazsa
    self-assigned this
    on Dec 12, 2023
  5. ivdiazsa
    linked a pull request that will close this issueAdd ActiveIssue Annotations to Failing TestReadyToRun Tests and Reenable the Executables #96721on Jan 9, 2024
  6. ivdiazsa
    closed this as completedin #96721on Jan 11, 2024
  7. github-actions
    locked and limited conversation to collaborators on Feb 11, 2024
  8. dotnet-policy-service
    added
    in-prThere is an active PR which will close this issue when it is merged
    on Feb 19, 2026
  9. jtschuster
    added a commit that references this issue on Feb 19, 2026

    Skip unloadable-type tests under ReadyToRun; update ActiveIssue to #1…

    f8ac08f
  10. iremyux
    added a commit that references this issue on Mar 2, 2026

    Skip unloadable-type tests under ReadyToRun; update ActiveIssue to do…

    e9652e3
  11. jkotas
    unassigned
    ivdiazsa
    on Jul 1, 2026

  12. jkotas commented on Jul 1, 2026

    @jkotas
    jkotas
    on Jul 1, 2026
    Member

    Number of tests are still disabled against this issue

    runtime/src/libraries/tests.proj

    Lines 646 to 653 in 240be2a

    Tracking Issue for this work item: https://github.com/dotnet/runtime/issues/95928
    -->
    <ItemGroup Condition="'$(TestReadyToRun)' == 'true'">
    <ProjectExclusions Include="$(MSBuildThisFileDirectory)System.Runtime/tests/System.Reflection.Tests/System.Reflection.Tests.csproj" />
    <ProjectExclusions Include="$(MSBuildThisFileDirectory)System.Reflection.TypeExtensions/tests/System.Reflection.TypeExtensions.Tests.csproj" />
    <ProjectExclusions Include="$(MSBuildThisFileDirectory)System.Runtime.Loader/tests/DefaultContext/System.Runtime.Loader.DefaultContext.Tests.csproj" />
    <ProjectExclusions Include="$(MSBuildThisFileDirectory)System.Runtime.Loader/tests/System.Runtime.Loader.Tests.csproj" />
    <ProjectExclusions Include="$(MSBuildThisFileDirectory)System.Text.RegularExpressions/tests/FunctionalTests/System.Text.RegularExpressions.Tests.csproj" />

  13. jkotas
    reopened this on Jul 1, 2026
  14. jkotas
    added
    disabled-testThe test is disabled in source code against the issue
    on Jul 1, 2026
  15. github-actions
    unlocked this conversation on Jul 1, 2026
  16. jkotas
    added
    area-ReadyToRun
    and removed
    area-Infrastructure-libraries
    in-prThere is an active PR which will close this issue when it is merged
    on Jul 1, 2026
  17. jkotas
    modified the milestones: 9.0.0, 11.0.0 on Jul 1, 2026
  18. jtschuster
    added a commit that references this issue on Jul 21, 2026

    Enable additional library tests in ReadyToRun pipeline (#130821)

    5ffdd75
  19. jtschuster
    modified the milestones: 11.0.0, 12.0.0 on Aug 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area-ReadyToRundisabled-testThe test is disabled in source code against the issue

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions