Skip to content

Allow disabling scenario-tests that don't work in the first build pass#47108

Closed
akoeplinger wants to merge 2 commits intomainfrom
akoeplinger-patch-1
Closed

Allow disabling scenario-tests that don't work in the first build pass#47108
akoeplinger wants to merge 2 commits intomainfrom
akoeplinger-patch-1

Conversation

@akoeplinger
Copy link
Member

@akoeplinger akoeplinger commented Feb 25, 2025

E.g. publishing for browser-wasm from a windows-x64 vertical. Needed for dotnet/scenario-tests#216

@akoeplinger akoeplinger requested review from a team as code owners February 25, 2025 21:14
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 1 out of 1 changed files in this pull request and generated no comments.

@ghost ghost added Area-Infrastructure untriaged Request triage from a team member labels Feb 25, 2025
E.g. publishing for browser-wasm from a windows-x64 vertical.
<TestXmlOutputPath>$(ScenarioTestsResultsDir)$([System.DateTime]::Now.ToString("yyyy-MM-dd_HH_mm_ss")).xml</TestXmlOutputPath>
<ScenarioTestsAdditionalArgs>--xml $(TestXmlOutputPath) --target-rid $(TargetRid) --portable-rid $(PortableRid) --no-cleanup --no-traits Category=MultiTFM</ScenarioTestsAdditionalArgs>
<ScenarioTestsAdditionalArgs Condition="'$(DotNetBuildPass)' != '2'">$(ScenarioTestsAdditionalArgs) --no-traits Category=RequiresNonTargetRidPackages</ScenarioTestsAdditionalArgs>
<ScenarioTestsAdditionalArgs Condition="'$(DotNetBuildPass)' != '2' or '$(DotNetBuildSourceOnly)' == 'true'">$(ScenarioTestsAdditionalArgs) --no-traits Category=RequiresNonTargetRidPackages</ScenarioTestsAdditionalArgs>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Source-only builds use the MSFT upstream packages and should be able to run the test decorated with that trait, at least with the current state in main. CI tells me that the test is run and that it passes.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It currently works because the workload manifests are downloaded from the Microsoft build and reference the versions built there, but that will change once the manifests are built as part of the sdk repo since they will then use the VMR version numbers.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Source-build currently doesn't follow the VMR versioning: dotnet/source-build#4855
Does that make a difference?

FWIW I would prefer to not condition this on source-build until we make the change that requires this to change.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FWIW I would prefer to not condition this on source-build until we make the change that requires this to change.

+1, keep in mind source-build previews unlike UB are shipping. That is to say SB is sensitive to temporary breakages.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, I still expect this will break but we can deal with it at that point so I'll fold this change into my other PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area-Infrastructure untriaged Request triage from a team member

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants