Skip to content
This repository was archived by the owner on Jan 23, 2023. It is now read-only.

Improve corefx testing#24962

Merged
BruceForstall merged 44 commits intodotnet:masterfrom
BruceForstall:ImproveCoreFxTesting
Jun 11, 2019
Merged

Improve corefx testing#24962
BruceForstall merged 44 commits intodotnet:masterfrom
BruceForstall:ImproveCoreFxTesting

Conversation

@BruceForstall
Copy link

@BruceForstall BruceForstall commented Jun 5, 2019

Add various JIT stress mode variations (scenarios). Enable this currently for Windows/x64 and Linux/x64. Other platform support will come later.

Four new Azure Pipelines are created, to contain various stress scenarios, run against all the CoreFX tests:

  1. coreclr-corefx -- the same testing as coreclr-outerloop
  2. coreclr-corefx-jitstress -- the same testing as coreclr-outerloop-jitstress
  3. coreclr-corefx-jitstressregs -- the same testing as coreclr-outerloop-jitstressregs
  4. coreclr-corefx-jitstress2-jitstressregs -- the same testing as coreclr-outerloop-jitstress2-jitstressregs

A number of additional CoreFX test exclusions have been added to make the tests all run error-free.

The file helixcorefxtests.proj and helixpublishwitharcade.proj are now somewhat similar, and perhaps should be merged. (Note that helixcorefxtests.proj does not have the "payload merging" support.)

@BruceForstall BruceForstall added the * NO MERGE * The PR is not ready for merge yet (see discussion for detailed reasons) label Jun 5, 2019
@BruceForstall BruceForstall reopened this Jun 5, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@BruceForstall BruceForstall force-pushed the ImproveCoreFxTesting branch from a196910 to 3d46abb Compare June 6, 2019 22:07
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 6, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 7, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 7, 2019
@BruceForstall BruceForstall force-pushed the ImproveCoreFxTesting branch from 8b44253 to 9189ba5 Compare June 11, 2019 14:42
@BruceForstall
Copy link
Author

/azp run coreclr-corefx

@BruceForstall
Copy link
Author

/azp run coreclr-corefx-jitstress

@BruceForstall
Copy link
Author

/azp run coreclr-corefx-jitstressregs

@BruceForstall
Copy link
Author

/azp run coreclr-corefx-jitstress2-jitstressregs

@dotnet dotnet deleted a comment from azure-pipelines bot Jun 11, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 11, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 11, 2019
@dotnet dotnet deleted a comment from azure-pipelines bot Jun 11, 2019
@BruceForstall
Copy link
Author

There are still failures. However, there are exciting new failures every run. And coreclr-corefx is now clean; only the "outerloop" jobs have failures. So I'm going to merge this.

@BruceForstall BruceForstall merged commit 96c8a12 into dotnet:master Jun 11, 2019
@BruceForstall BruceForstall deleted the ImproveCoreFxTesting branch June 11, 2019 21:26
picenka21 pushed a commit to picenka21/runtime that referenced this pull request Feb 18, 2022
CoreFX tests are now used to test CoreCLR on Windows/x64 and Linux/x64.
PR testing includes normal and no-tiered modes. CI testing will include
all JIT stress modes that apply to CoreCLR testing. Many tests have been
disabled to allow the jobs to (mostly) run error-free.

Support for other platforms requires fixes to the testhost generation.


Commit migrated from dotnet/coreclr@96c8a12
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants