Skip to content

Windows: Start of enabling tests under integration#37715

Merged
thaJeztah merged 3 commits intomoby:masterfrom
salah-khan:windows-enable-integration
Oct 10, 2018
Merged

Windows: Start of enabling tests under integration#37715
thaJeztah merged 3 commits intomoby:masterfrom
salah-khan:windows-enable-integration

Conversation

@salah-khan
Copy link
Contributor

Integration tests on Windows.

This was originally @jhowardmsft's work and then vdemeesters and enables the integration tests on windows CI (see #36748)
This is also a follow up of #35362 — initial description below.
Currently in progress, with a custom job in jenkins.

This change is a requirement for #34226.
This change also brings the windowsRS1 build in line with all the other builds, which have an entry point at hack/ci. The windowsRS1 config has been updated to call this script.
This change is important because currently the configuration in jenkins makes too many assumptions about the repo and artifacts created by the build. We need a minimal interface between our CI configuration and the repo, so that we are free to make changes in a PR without requiring complicated acrobatics to support those changes in CI.

Signed-off-by: John Howard [email protected]

@thaJeztah
Copy link
Member

Looks like build is failing

@thaJeztah thaJeztah added area/testing status/failing-ci Indicates that the PR in its current state fails the test suite labels Aug 30, 2018
@salah-khan salah-khan force-pushed the windows-enable-integration branch 2 times, most recently from 58f146e to 09ca715 Compare September 6, 2018 21:15
@salah-khan salah-khan force-pushed the windows-enable-integration branch 10 times, most recently from 0a16ffc to b1ab76a Compare September 19, 2018 04:13
@codecov
Copy link

codecov bot commented Sep 19, 2018

Codecov Report

❗ No coverage uploaded for pull request base (master@87e7930). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master   #37715   +/-   ##
=========================================
  Coverage          ?    36.3%           
=========================================
  Files             ?      610           
  Lines             ?    45644           
  Branches          ?        0           
=========================================
  Hits              ?    16572           
  Misses            ?    26802           
  Partials          ?     2270

@salah-khan salah-khan force-pushed the windows-enable-integration branch 3 times, most recently from 15f66a5 to 8eb2a8f Compare September 19, 2018 05:29
@lowenna
Copy link
Member

lowenna commented Sep 27, 2018

cc @psftw too. This has knock on effect on CE/EE jobs too on the other Jenkins system.

@lowenna
Copy link
Member

lowenna commented Sep 27, 2018

OK, have verified it doesn't break Invoke-Docker-CI. However, note that none of the integration tests are actually run with this PR, just the integration-cli tests. I would sign-off once the rename is done (and I'll need to update the Jenkins job to match). There's certainly some tidying to do in the CI script as put in this PR (arguably, it doesn't actually need to be in this PR as it's completely unrelated), as well as an update to Invoke-DockerCI to use the checked in script, and also removing the CI script from it's current master source of truth under my GH repo.

@ddebroy
Copy link
Contributor

ddebroy commented Sep 28, 2018

@jhowardmsft Thanks for verifying. I have done the renaming of windowsRS1.ps1 to windows.ps1 as requested. Note that the failure in the janky run below is due to a known flaky test in networking.

@lowenna
Copy link
Member

lowenna commented Oct 8, 2018

Have updated the Jenkins job at https://jenkins.dockerproject.org/job/Docker-PRs-WoW-RS1/configure (you may not have access) to point to windows.ps1 and restarted the job to re-verify again, and ensure the console output contains NEW entrypoint.

Specifically

Old:

if (Test-Path hack\ci\windowsRS1.ps1) {
    Write-Host "NEW entrypoint"
    .\hack\ci\windowsRS1.ps1
    exit $LastExitCode
}

New:

if (Test-Path hack\ci\windows.ps1) {
    Write-Host "NEW entrypoint"
    .\hack\ci\windows.ps1
    exit $LastExitCode
}

Once this is merged, that Write-Host can be removed, along with the rest of the script embedded in the job. I'll also update the RS5 jobs.

@psftw - Have you managed to look at the follow-on impact to other CE/EE jobs?

@lowenna
Copy link
Member

lowenna commented Oct 8, 2018

LGTM. But I'm concerned about the impact to CE/EE jobs still which I don't have access to.

Have verified is running the in-repo script now after reconfiguring jenkins Docker-PRs-WOW-RS1 job. From
https://jenkins.dockerproject.org/job/Docker-PRs-WoW-RS1/22555/console:

00:00:58.114 [docker] $ powershell.exe -NonInteractive -ExecutionPolicy ByPass "& 'C:\Users\jenkins\jenkins2734567844840291984.ps1'"
00:00:58.495 NEW entrypoint
00:00:58.594 

@ddebroy
Copy link
Contributor

ddebroy commented Oct 10, 2018

I synced up with @jhowardmsft offline about his concern around internal CI jobs. The plan is to start syncing up the enhancements made for them (RS3/4/5) into windows.ps1 once the above PR gets merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants