ci(windows): upload test reports with logs by crazy-max · Pull Request #43665 · moby/moby

crazy-max · 2022-05-31T10:06:25Z

As discussed with @thaJeztah, before disabling Windows nodes on Jenkins we need to keep logs in uploaded reports.

Signed-off-by: CrazyMax [email protected]

thaJeztah · 2022-05-31T10:40:11Z

Are we able to do the same for Linux, or are we already doing that?

Note that (especially in Linux CI), there will be multiple logs, and they've been organised (at least for the integration/ tests) to be stored in a directory per-test, per-daemon.

thaJeztah · 2022-05-31T10:43:45Z

Structure is slightly different between some of the Linux stages (as the amd64 one runs some things in parallel, so has subdirectories for those), but here's an example;

Details

.
├── example.txt
└── test-integration
    ├── TestAuthZPluginAPIDenyResponse
    │   └── d48600eadcc04
    │       └── docker.log
    ├── TestAuthZPluginAllowEventStream
    │   └── d873e8682a6e5
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 8458f26b5831853d8e5491a81ba3381ceb3bc924b24be9782b5b8701d70b510d
    │                   └── 8458f26b5831853d8e5491a81ba3381ceb3bc924b24be9782b5b8701d70b510d-json.log
    ├── TestAuthZPluginAllowRequest
    │   └── dc4341ab2c048
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 9442b3fe6b5c2766d3901c10b29d7a7527196ec9f18287f0424274d80dc60189
    │                   └── 9442b3fe6b5c2766d3901c10b29d7a7527196ec9f18287f0424274d80dc60189-json.log
    ├── TestAuthZPluginDenyRequest
    │   └── dda09d628c7ca
    │       └── docker.log
    ├── TestAuthZPluginDenyResponse
    │   └── dc6e2bdb481f9
    │       └── docker.log
    ├── TestAuthZPluginEnsureLoadImportWorking
    │   └── dfef27d2398db
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 3207cc162e65652a1a71fb9fcda0f4d95cbc55d8da5c04118613ae9356ee9699
    │                   └── 3207cc162e65652a1a71fb9fcda0f4d95cbc55d8da5c04118613ae9356ee9699-json.log
    ├── TestAuthZPluginEnsureNoDuplicatePluginRegistration
    │   └── d87267a0838af
    │       └── docker.log
    ├── TestAuthZPluginErrorRequest
    │   └── d65f90bee8b12
    │       └── docker.log
    ├── TestAuthZPluginErrorResponse
    │   └── d1d72b3fcfa00
    │       └── docker.log
    ├── TestAuthZPluginHeader
    │   └── d0bc1d934890d
    │       └── docker.log
    ├── TestAuthZPluginTLS
    │   └── d3056802a0329
    │       └── docker.log
    ├── TestAuthZPluginV2NonexistentFailsDaemonStart
    │   └── da63d2eeb0046
    │       └── docker.log
    ├── TestAuthzPluginEnsureContainerCopyToFrom
    │   └── d64cff18a660e
    │       └── docker.log
    ├── TestBuildUserNamespaceValidateCapabilitiesAreV2
    │   ├── d0350bcd15aad
    │   │   └── docker.log
    │   └── d57007952be28
    │       └── docker.log
    ├── TestCgroupNamespacesBuild
    │   └── de2d2d5fb9fd5
    │       └── docker.log
    ├── TestCgroupNamespacesBuildDaemonHostMode
    │   └── d3e7ca112752e
    │       └── docker.log
    ├── TestCgroupNamespacesRun
    │   └── dda5a788fd26d
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── f4aa191f096241fc0fe11aa7ebedf9cb8a673b141fc5f90f466da74ab696a9ac
    │                   └── f4aa191f096241fc0fe11aa7ebedf9cb8a673b141fc5f90f466da74ab696a9ac-json.log
    ├── TestCgroupNamespacesRunDaemonHostMode
    │   └── db605d25f9728
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── f57666af74c4d78f2fed396998fbfb3052f0ce6c7d584ce628e0b94fcd93e240
    │                   └── f57666af74c4d78f2fed396998fbfb3052f0ce6c7d584ce628e0b94fcd93e240-json.log
    ├── TestCgroupNamespacesRunHostMode
    │   └── d9857a187c491
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 945075adb8056ed15c0953444bd78f5d743b9b3fc0ef20d721add29d67c5e50b
    │                   └── 945075adb8056ed15c0953444bd78f5d743b9b3fc0ef20d721add29d67c5e50b-json.log
    ├── TestCgroupNamespacesRunInvalidMode
    │   └── d1c8a0d7a663a
    │       └── docker.log
    ├── TestCgroupNamespacesRunOlderClient
    │   └── dbc4ccb53d3c8
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 8203ef211878b5c3f6d95c22ace6c7336c65195a04ffc04283b9d48ab5799164
    │                   └── 8203ef211878b5c3f6d95c22ace6c7336c65195a04ffc04283b9d48ab5799164-json.log
    ├── TestCgroupNamespacesRunPrivateMode
    │   └── dd13f61f724af
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── ab1fd345b11121f408a4e179538d88f1517913b7bab18f62abd671f79d8c0d84
    │                   └── ab1fd345b11121f408a4e179538d88f1517913b7bab18f62abd671f79d8c0d84-json.log
    ├── TestCgroupNamespacesRunPrivileged
    │   └── d1127b36d0f6b
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 9e9804bb13cd622183bf5622b1c3fdef0a98a139f6941bb92d726f81ed74c992
    │                   └── 9e9804bb13cd622183bf5622b1c3fdef0a98a139f6941bb92d726f81ed74c992-json.log
    ├── TestCgroupNamespacesRunPrivilegedAndPrivate
    │   └── d827e70242444
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── d271895f334ce8379ba3a9f7561511606d2d4b5ab0f51dc6f7dd68445dc70a9f
    │                   └── d271895f334ce8379ba3a9f7561511606d2d4b5ab0f51dc6f7dd68445dc70a9f-json.log
    ├── TestConfigCreateResolve
    │   └── d4da576d55fea
    │       └── docker.log
    ├── TestConfigDaemonID
    │   └── dd5ddd90a5e5e
    │       └── docker.log
    ├── TestConfigDaemonLibtrustID
    │   └── d8b8e4bdb8723
    │       └── docker.log
    ├── TestConfigDaemonSeccompProfiles
    │   └── dbbc5d68b2ab5
    │       └── docker.log
    ├── TestConfigInspect
    │   └── d6bc6433e0896
    │       └── docker.log
    ├── TestConfigList
    │   └── db5e14c85db8d
    │       └── docker.log
    ├── TestConfigsCreateAndDelete
    │   └── d88b9cb00eef8
    │       └── docker.log
    ├── TestConfigsUpdate
    │   └── dac072d0e45ea
    │       └── docker.log
    ├── TestContainerKillOnDaemonStart
    │   └── df9b68c257929
    │       └── docker.log
    ├── TestContainerStartOnDaemonRestart
    │   └── de9d18e0f4fbe
    │       └── docker.log
    ├── TestContinueAfterPluginCrash
    │   └── d007f5cbb26c1
    │       └── docker.log
    ├── TestCreateJob
    │   └── d7f9d1cbbc077
    │       └── docker.log
    ├── TestCreateServiceCapabilities
    │   └── d6447af8f52ef
    │       └── docker.log
    ├── TestCreateServiceConfigFileMode
    │   └── d34d00b9189a1
    │       └── docker.log
    ├── TestCreateServiceConflict
    │   └── de1629f2be53d
    │       └── docker.log
    ├── TestCreateServiceMaxReplicas
    │   └── df083a0c47853
    │       └── docker.log
    ├── TestCreateServiceMultipleTimes
    │   └── d6e2ceb6206e6
    │       └── docker.log
    ├── TestCreateServiceSecretFileMode
    │   └── d09c6110537ae
    │       └── docker.log
    ├── TestCreateServiceSysctls
    │   └── d6fb4302c5312
    │       └── docker.log
    ├── TestCreateWithDuplicateNetworkNames
    │   └── d5aa8bcaf725f
    │       └── docker.log
    ├── TestDaemonDNSFallback
    │   └── d0a3e1876bea1
    │       └── docker.log
    ├── TestDaemonDefaultNetworkPools
    │   └── de3d11c934073
    │       └── docker.log
    ├── TestDaemonHostGatewayIP
    │   └── db88c05df1184
    │       └── docker.log
    ├── TestDaemonIpcModePrivate
    │   └── dd6f81a8c8ad9
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── e65b053d483815be3cf24a1c62a2a3efcd942eae46d7192e263cfb03f7395736
    │                   └── e65b053d483815be3cf24a1c62a2a3efcd942eae46d7192e263cfb03f7395736-json.log
    ├── TestDaemonIpcModePrivateFromConfig
    │   └── df8722f3049cc
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 3a0822c6a04d391ecd439eabcbf4cfcd3e0d4d55501c76e9c5a3a44caf587c94
    │                   └── 3a0822c6a04d391ecd439eabcbf4cfcd3e0d4d55501c76e9c5a3a44caf587c94-json.log
    ├── TestDaemonIpcModeShareable
    │   └── d41e9ec47fba2
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── b246144741e705ff6ec127aea9f75044b7f8a5b284a00640fe1c45d723cf52c5
    │                   └── b246144741e705ff6ec127aea9f75044b7f8a5b284a00640fe1c45d723cf52c5-json.log
    ├── TestDaemonIpcModeShareableFromConfig
    │   └── d2bae484b8718
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── bb3b862de4b2c4e2e035d44e67af9afa13fb7fbb7522bfd101185fd4382ddc94
    │                   └── bb3b862de4b2c4e2e035d44e67af9afa13fb7fbb7522bfd101185fd4382ddc94-json.log
    ├── TestDaemonProxy
    │   ├── command-line_options
    │   │   └── dc977a98824b9
    │   │       └── docker.log
    │   ├── configuration_file
    │   │   └── d6b2b86993cc9
    │   │       └── docker.log
    │   ├── conflicting_options
    │   │   └── d696598cf3590
    │   │       └── docker.log
    │   ├── environment_variables
    │   │   └── d524caf757d00
    │   │       └── docker.log
    │   └── reload_sanitized
    │       └── d213906fc1287
    │           └── docker.log
    ├── TestDaemonRestartIpcMode
    │   └── d063d6da302c7
    │       └── docker.log
    ├── TestDaemonRestartKillContainers
    │   ├── live-restore=false
    │   │   ├── container_created_should_not_be_restarted
    │   │   │   ├── kill-daemon
    │   │   │   │   └── decf1c4c2c62d
    │   │   │   │       └── docker.log
    │   │   │   └── stop-daemon
    │   │   │       └── db1e6bc167bcf
    │   │   │           └── docker.log
    │   │   ├── container_with_restart=always
    │   │   │   ├── kill-daemon
    │   │   │   │   └── dfe049f1f1179
    │   │   │   │       └── docker.log
    │   │   │   └── stop-daemon
    │   │   │       └── df4efbd48d300
    │   │   │           └── docker.log
    │   │   ├── container_with_restart=always_and_with_healthcheck
    │   │   │   ├── kill-daemon
    │   │   │   │   └── d8f7487bfc776
    │   │   │   │       └── docker.log
    │   │   │   └── stop-daemon
    │   │   │       └── dea8320afc25c
    │   │   │           └── docker.log
    │   │   └── container_without_restart_policy
    │   │       ├── kill-daemon
    │   │       │   └── dd4aa3d592ef3
    │   │       │       └── docker.log
    │   │       └── stop-daemon
    │   │           └── d8cf69f84c766
    │   │               └── docker.log
    │   └── live-restore=true
    │       ├── container_created_should_not_be_restarted
    │       │   ├── kill-daemon
    │       │   │   └── db18f4a8182eb
    │       │   │       └── docker.log
    │       │   └── stop-daemon
    │       │       └── d7c87ffb2dd83
    │       │           └── docker.log
    │       ├── container_with_restart=always
    │       │   ├── kill-daemon
    │       │   │   └── d0b513fcba1ba
    │       │   │       └── docker.log
    │       │   └── stop-daemon
    │       │       └── da7d6bff995a8
    │       │           └── docker.log
    │       ├── container_with_restart=always_and_with_healthcheck
    │       │   ├── kill-daemon
    │       │   │   └── d55ca94064981
    │       │   │       └── docker.log
    │       │   └── stop-daemon
    │       │       └── dc75b6a4c59a7
    │       │           └── docker.log
    │       └── container_without_restart_policy
    │           ├── kill-daemon
    │           │   └── d348cdfc346b9
    │           │       └── docker.log
    │           └── stop-daemon
    │               └── dff81a81b81a8
    │                   └── docker.log
    ├── TestDaemonRestartWithExistingNetwork
    │   └── d858c05a68f09
    │       └── docker.log
    ├── TestDaemonRestartWithExistingNetworkWithDefaultPoolRange
    │   └── df37107a22ca7
    │       └── docker.log
    ├── TestDaemonRestartWithLiveRestore
    │   └── d02c76d38633c
    │       └── docker.log
    ├── TestDaemonStartWithLogOpt
    │   └── ddc37410c666b
    │       └── docker.log
    ├── TestDaemonWithBipAndDefaultNetworkPool
    │   └── d542d6858982a
    │       └── docker.log
    ├── TestDiskUsage
    │   └── d6a3c107e5b3f
    │       └── docker.log
    ├── TestDockerNetworkConnectAlias
    │   └── d74790528f986
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               ├── b6fcc89c4a05faa83c68f5728e703be735f3bca8a1ff0c5bff780d502ce70874
    │               │   └── b6fcc89c4a05faa83c68f5728e703be735f3bca8a1ff0c5bff780d502ce70874-json.log
    │               └── dfe0ef00ad2025c19136529d67369348cd51290f6f414844a6bc3fd3ab85abf8
    │                   └── dfe0ef00ad2025c19136529d67369348cd51290f6f414844a6bc3fd3ab85abf8-json.log
    ├── TestDockerNetworkMacvlan
    │   ├── d69b7fccfc898
    │   │   └── docker.log
    │   ├── d89c599a3b752
    │   │   ├── docker.log
    │   │   └── root
    │   │       └── containers
    │   │           ├── 07b79286e08d457878fe8b0086d519eededb43ee495e09ae626b62ae329608f5
    │   │           │   └── 07b79286e08d457878fe8b0086d519eededb43ee495e09ae626b62ae329608f5-json.log
    │   │           └── 9c485b186a837a6ba168fdf1d79832a3182c4fc9eed9bc234647b8b503f9e2a1
    │   │               └── 9c485b186a837a6ba168fdf1d79832a3182c4fc9eed9bc234647b8b503f9e2a1-json.log
    │   ├── db7cf41e41818
    │   │   ├── docker.log
    │   │   └── root
    │   │       └── containers
    │   │           ├── 726c11b7a3f1415f2a9df8e1b327c9263de5fa1f59c39a32becf6ac33f55dd0e
    │   │           │   └── 726c11b7a3f1415f2a9df8e1b327c9263de5fa1f59c39a32becf6ac33f55dd0e-json.log
    │   │           ├── 86acf024d606f55160aeb37338e8ca54f387d657e44e61e231804af62e3ae878
    │   │           │   └── 86acf024d606f55160aeb37338e8ca54f387d657e44e61e231804af62e3ae878-json.log
    │   │           ├── a3f08c87cf8eb7b2c4dbfcc9bb2afe6c82597982b9b57997795ede8f950ddbcf
    │   │           │   └── a3f08c87cf8eb7b2c4dbfcc9bb2afe6c82597982b9b57997795ede8f950ddbcf-json.log
    │   │           └── ace77dda714def3ce94adb6bfd5f21d1467f98bef4c80212d480edbade50dd7c
    │   │               └── ace77dda714def3ce94adb6bfd5f21d1467f98bef4c80212d480edbade50dd7c-json.log
    │   ├── dca64a9e57ef2
    │   │   ├── docker.log
    │   │   └── root
    │   │       └── containers
    │   │           ├── 051f4e0f98bcf68c5126ff7810577ade72699e179cc1937ec659f7ab0700a631
    │   │           │   └── 051f4e0f98bcf68c5126ff7810577ade72699e179cc1937ec659f7ab0700a631-json.log
    │   │           └── a5389d41b61bb6d8a6fd466bd7004a6eadaa41d4f9ffe532562993325aaa0189
    │   │               └── a5389d41b61bb6d8a6fd466bd7004a6eadaa41d4f9ffe532562993325aaa0189-json.log
    │   ├── de3e63c179327
    │   │   ├── docker.log
    │   │   └── root
    │   │       └── containers
    │   │           └── adf4c24a2bfbbbb44f86c51ed938744f0f422a7f2b69183141f0cca7d8571e61
    │   │               └── adf4c24a2bfbbbb44f86c51ed938744f0f422a7f2b69183141f0cca7d8571e61-json.log
    │   └── dfd79e36a808a
    │       └── docker.log
    ├── TestDockerNetworkMacvlanPersistance
    │   └── ddac376c68399
    │       └── docker.log
    ├── TestDockerNetworkReConnect
    │   └── dac197e34c39c
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 193f9d324aa88ae7da9d27bb0311fd51b96adce6ddddc2a1e87500a59ac9426e
    │                   └── 193f9d324aa88ae7da9d27bb0311fd51b96adce6ddddc2a1e87500a59ac9426e-json.log
    ├── TestExportContainerAfterDaemonRestart
    │   └── dbe4df8e6cb5b
    │       └── docker.log
    ├── TestExternalGraphDriver
    │   └── d5754eef6f194
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── ebc75575029ac594d2e5bc0152595531924961d1e5f519fb286dc42be5c51806
    │                   └── ebc75575029ac594d2e5bc0152595531924961d1e5f519fb286dc42be5c51806-json.log
    ├── TestHostIPv4BridgeLabel
    │   └── d636b30ecfbd8
    │       └── docker.log
    ├── TestInfoAPIWarnings
    │   └── d53dfbbc2b0a7
    │       └── docker.log
    ├── TestInfoDebug
    │   └── dfb39208030e8
    │       └── docker.log
    ├── TestInfoInsecureRegistries
    │   └── d38c73da9f2fd
    │       └── docker.log
    ├── TestInfoRegistryMirrors
    │   └── dd7f58ff9c9c4
    │       └── docker.log
    ├── TestInspect
    │   └── df476dbd03add
    │       └── docker.log
    ├── TestInspectNetwork
    │   └── d9e9e1b1c2198
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               ├── 7a03024b3d12f28d61efcd57552915499434d9200424714f0d123f006eb0666a
    │               │   └── 7a03024b3d12f28d61efcd57552915499434d9200424714f0d123f006eb0666a-json.log
    │               └── db47fd11defc3eb9382573c939ac41be34f5452bfda9e17e4466faa53aa5445f
    │                   └── db47fd11defc3eb9382573c939ac41be34f5452bfda9e17e4466faa53aa5445f-json.log
    ├── TestPingBuilderHeader
    │   └── dca41185097b8
    │       └── docker.log
    ├── TestPingSwarmHeader
    │   └── d52591e81f513
    │       └── docker.log
    ├── TestPluginInstall
    │   └── with_insecure
    │       └── dcafe0858cf90
    │           └── docker.log
    ├── TestPluginWithDevMounts
    │   └── d8b8ddb5ccfdf
    │       └── docker.log
    ├── TestPluginsWithRuntimes
    │   └── d46cd5f996e0e
    │       └── docker.log
    ├── TestReadPluginNoRead
    │   └── da45693b7f46c
    │       └── docker.log
    ├── TestReplicatedJob
    │   └── de048f07b5ee2
    │       └── docker.log
    ├── TestRestartDaemonWithRestartingContainer
    │   └── df160ca16ceb7
    │       └── docker.log
    ├── TestRunContainerWithBridgeNone
    │   └── db2f7c21b823c
    │       └── docker.log
    ├── TestSecretCreateResolve
    │   └── d0c4d1905f76f
    │       └── docker.log
    ├── TestSecretInspect
    │   └── d09faee509bac
    │       └── docker.log
    ├── TestSecretList
    │   └── d3229c16a3f09
    │       └── docker.log
    ├── TestSecretsCreateAndDelete
    │   └── dc1bad4f31e27
    │       └── docker.log
    ├── TestSecretsUpdate
    │   └── d6be7d74a5aee
    │       └── docker.log
    ├── TestServiceCreateInit
    │   ├── daemonInitDisabled
    │   │   └── d176f0b67e60c
    │   │       └── docker.log
    │   └── daemonInitEnabled
    │       └── ddc0edee86b61
    │           └── docker.log
    ├── TestServiceUpdateConfigs
    │   └── d77cf01a01791
    │       └── docker.log
    ├── TestServiceUpdateLabel
    │   └── d6e10ce2b0a31
    │       └── docker.log
    ├── TestServiceUpdateNetwork
    │   └── d128bbd91a9f5
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 2d27b16b3c0ae2bd96039e1a0e1bee8ec9522df7eaecf13e2d73bb6301d660f0
    │                   └── 2d27b16b3c0ae2bd96039e1a0e1bee8ec9522df7eaecf13e2d73bb6301d660f0-json.log
    ├── TestServiceUpdatePidsLimit
    │   └── dcf256880604d
    │       └── docker.log
    ├── TestServiceUpdateSecrets
    │   └── dd282bb31b1c4
    │       └── docker.log
    ├── TestServiceWithDataPathPortInit
    │   ├── dab7422e63a60
    │   │   ├── docker.log
    │   │   └── root
    │   │       └── containers
    │   │           └── 28f5915a883e3a3ec931cb6b9cec49d6488c9ecaf8af5709ac58bc17a61de70b
    │   │               └── 28f5915a883e3a3ec931cb6b9cec49d6488c9ecaf8af5709ac58bc17a61de70b-json.log
    │   └── dc38a1c16c3e8
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 8987017f66514ccbd8b1bef6115c1bc1a138b068000970c982d9ad73a65fe5e5
    │                   └── 8987017f66514ccbd8b1bef6115c1bc1a138b068000970c982d9ad73a65fe5e5-json.log
    ├── TestServiceWithDefaultAddressPoolInit
    │   └── d33b2b072cf3f
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── 484b6c257b290de09d71f35c127db9fc434b663accc9d7953dcf17f97c3a0208
    │                   └── 484b6c257b290de09d71f35c127db9fc434b663accc9d7953dcf17f97c3a0208-json.log
    ├── TestServiceWithPredefinedNetwork
    │   └── d0dcca583904a
    │       ├── docker.log
    │       └── root
    │           └── containers
    │               └── e8b5b783b2c12d3475d4d0f030a92ba8f0299f152229516a1cfc3ee2950a5ddc
    │                   └── e8b5b783b2c12d3475d4d0f030a92ba8f0299f152229516a1cfc3ee2950a5ddc-json.log
    ├── TestTemplatedConfig
    │   └── d19557f79e9b0
    │       └── docker.log
    ├── TestTemplatedSecret
    │   └── d67d5c2c05ee1
    │       └── docker.log
    ├── TestUpdateReplicatedJob
    │   └── dd026e1e66fb2
    │       └── docker.log
    ├── arm64-integration-build-go-test-report.json
    ├── arm64-integration-build-junit-report.xml
    ├── arm64-integration-config-go-test-report.json
    ├── arm64-integration-config-junit-report.xml
    ├── arm64-integration-container-go-test-report.json
    ├── arm64-integration-container-junit-report.xml
    ├── arm64-integration-daemon-go-test-report.json
    ├── arm64-integration-daemon-junit-report.xml
    ├── arm64-integration-image-go-test-report.json
    ├── arm64-integration-image-junit-report.xml
    ├── arm64-integration-network-go-test-report.json
    ├── arm64-integration-network-ipvlan-go-test-report.json
    ├── arm64-integration-network-ipvlan-junit-report.xml
    ├── arm64-integration-network-junit-report.xml
    ├── arm64-integration-network-macvlan-go-test-report.json
    ├── arm64-integration-network-macvlan-junit-report.xml
    ├── arm64-integration-plugin-authz-go-test-report.json
    ├── arm64-integration-plugin-authz-junit-report.xml
    ├── arm64-integration-plugin-common-go-test-report.json
    ├── arm64-integration-plugin-common-junit-report.xml
    ├── arm64-integration-plugin-go-test-report.json
    ├── arm64-integration-plugin-graphdriver-go-test-report.json
    ├── arm64-integration-plugin-graphdriver-junit-report.xml
    ├── arm64-integration-plugin-junit-report.xml
    ├── arm64-integration-plugin-logging-cmd-discard-go-test-report.json
    ├── arm64-integration-plugin-logging-cmd-discard-junit-report.xml
    ├── arm64-integration-plugin-logging-go-test-report.json
    ├── arm64-integration-plugin-logging-junit-report.xml
    ├── arm64-integration-plugin-volumes-go-test-report.json
    ├── arm64-integration-plugin-volumes-junit-report.xml
    ├── arm64-integration-secret-go-test-report.json
    ├── arm64-integration-secret-junit-report.xml
    ├── arm64-integration-service-go-test-report.json
    ├── arm64-integration-service-junit-report.xml
    ├── arm64-integration-session-go-test-report.json
    ├── arm64-integration-session-junit-report.xml
    ├── arm64-integration-system-go-test-report.json
    ├── arm64-integration-system-junit-report.xml
    ├── arm64-integration-volume-go-test-report.json
    ├── arm64-integration-volume-junit-report.xml
    ├── docker.log
    └── test.log

348 directories, 203 files

crazy-max · 2022-05-31T11:03:48Z

Are we able to do the same for Linux, or are we already doing that?

Note that (especially in Linux CI), there will be multiple logs, and they've been organised (at least for the integration/ tests) to be stored in a directory per-test, per-daemon.

Linux tests with GitHub Actions would be for a follow-up of #43529. See crazy-max/moby@cross...crazy-max:cross-test-workflow. For arm64, ppc64le and s390x we would need self-hosted runners.

But yes it will have the same layout in GHA too.

thaJeztah · 2022-05-31T11:15:44Z

Thanks! Sorry for asking (didn't take the time to dig in the results 😅, and thought you'd know from the top of your head)

crazy-max · 2022-05-31T13:18:58Z

@thaJeztah Ready for review, let me know if reports lgty: https://github.com/moby/moby/actions/runs/2414212763

thaJeztah · 2022-05-31T14:03:14Z

Looking good! I found two minor issues;

Looks like we're uploading coverage-report-int-cli-tests.txt, but there's no corresponding go-test-report-int-cli-tests.json or junit-report-int-cli-tests.json
I noticed the old bundles had separate .out and .err files for containerd and dockerd. Given; on Windows, everything is logged to stdout, but when looking at the bundle from this test, the CID.out actually had something written to it;

2022/05/31 10:32:25 http: superfluous response.WriteHeader call from github.com/docker/docker/api/server/httputils.WriteJSON (httputils.go:92)

So perhaps we need to have an .err (or xxx-stderr.log) file as well

thaJeztah · 2022-05-31T14:07:58Z

I guess this is missing some lines

moby/.github/workflows/windows.yml

Lines 351 to 355 in 235f862

    
                     & gotestsum --format=standard-verbose --packages="./integration-cli/..." -- ` 
        
                       "-coverprofile" "./bundles/coverage-report-int-cli-tests.txt" ` 
        
                       "-covermode" "atomic" ` 
        
                       "-tags" "autogen" ` 
        
                       "-test.timeout" "200m"

if I compare it with

moby/hack/make/.integration-test-helpers

Lines 86 to 89 in 7b9275c

    
           test_env gotestsum \ 
        
           	--format=standard-verbose \ 
        
           	--jsonfile="${ABS_DEST}/${pkgname//./-}-go-test-report.json" \ 
        
           	--junitfile="${ABS_DEST}/${pkgname//./-}-junit-report.xml" \

(-jsonfile and --junitfile are missing); that would explain the missing reports I guess

crazy-max · 2022-05-31T15:11:06Z

Given; on Windows, everything is logged to stdout, but when looking at the bundle from this test, the CID.out actually had something written to it;

Don't think we can as containerd is now started as a service and not as a process:

moby/hack/ci/windows.ps1

Lines 637 to 640 in 4e09933

    
           Start-Process "$env:TEMP\binary\containerd.exe" ` 
        
                       -ArgumentList "--log-level debug" ` 
        
                       -RedirectStandardOutput "$env:TEMP\containerd.out" ` 
        
                       -RedirectStandardError "$env:TEMP\containerd.err"

For daemon logs I think we can tweak the windows events filter to split logs. We could do that for containerd too but I don't think containerd manifests message table entries for Windows Event Logging yet like dockerd.

I guess this is missing some lines

Yes indeed looks missing for Test CLI stage.

thaJeztah · 2022-05-31T15:25:10Z

Don't think we can as containerd is now started as a service and not as a process:

Ah, right, hm.. yeah, guess that's a "meh" then

.github/workflows/windows.yml

thaJeztah

LGTM

thaJeztah

🤐 🙈 😂

looks like you reverted the rename of those files 😅

.github/workflows/windows.yml

thaJeztah · 2022-05-31T20:18:08Z

Let me push a quick fix for those so that Ci can run

Signed-off-by: CrazyMax <[email protected]> Signed-off-by: Sebastiaan van Stijn <[email protected]>

thaJeztah

LGTM

.github/workflows/windows.yml

thaJeztah · 2022-06-01T09:01:49Z

Thanks for answering the question! (Good question, @samuelkarp!)

Test failures are in Jenkins, and unrelated to this PR; let's get this one in 👍

crazy-max marked this pull request as ready for review May 31, 2022 13:16

crazy-max force-pushed the win-test-logs branch from e08c6dd to 10c0e27 Compare May 31, 2022 15:20

thaJeztah added status/2-code-review area/testing labels May 31, 2022

thaJeztah added this to the 22.06.0 milestone May 31, 2022

thaJeztah reviewed May 31, 2022

View reviewed changes

.github/workflows/windows.yml Outdated Show resolved Hide resolved

crazy-max force-pushed the win-test-logs branch 2 times, most recently from bb99c58 to 3a2c348 Compare May 31, 2022 18:06

thaJeztah approved these changes May 31, 2022

View reviewed changes

crazy-max force-pushed the win-test-logs branch from 3a2c348 to 67a1c2f Compare May 31, 2022 18:32

thaJeztah requested changes May 31, 2022

View reviewed changes

.github/workflows/windows.yml Outdated Show resolved Hide resolved

thaJeztah mentioned this pull request May 31, 2022

Jenkinsfile: remove Windows stages, remove hack/ci/windows.ps1 #43672

Merged

ci(windows): upload test reports with logs

6ecbd07

Signed-off-by: CrazyMax <[email protected]> Signed-off-by: Sebastiaan van Stijn <[email protected]>

thaJeztah force-pushed the win-test-logs branch from 67a1c2f to 6ecbd07 Compare May 31, 2022 20:19

thaJeztah approved these changes May 31, 2022

View reviewed changes

samuelkarp reviewed May 31, 2022

View reviewed changes

.github/workflows/windows.yml Show resolved Hide resolved

.github/workflows/windows.yml Show resolved Hide resolved

tianon approved these changes May 31, 2022

View reviewed changes

thaJeztah merged commit ea3d0f3 into moby:master Jun 1, 2022

crazy-max deleted the win-test-logs branch June 1, 2022 09:23

Conversation

crazy-max commented May 31, 2022

Uh oh!

thaJeztah commented May 31, 2022

Uh oh!

thaJeztah commented May 31, 2022

Uh oh!

crazy-max commented May 31, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

thaJeztah commented May 31, 2022

Uh oh!

crazy-max commented May 31, 2022

Uh oh!

thaJeztah commented May 31, 2022

Uh oh!

thaJeztah commented May 31, 2022

Uh oh!

crazy-max commented May 31, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

thaJeztah commented May 31, 2022

Uh oh!

Uh oh!

thaJeztah left a comment

Choose a reason for hiding this comment

Uh oh!

thaJeztah left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

thaJeztah commented May 31, 2022

Uh oh!

thaJeztah left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

thaJeztah commented Jun 1, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

crazy-max commented May 31, 2022 •

edited

Loading

crazy-max commented May 31, 2022 •

edited

Loading