Skip to content

Conversation

@nitkon
Copy link
Contributor

@nitkon nitkon commented May 10, 2019

Enable travis CI for ppc64le arch

Signed-off-by: Nitesh Konkar [email protected]

@nitkon
Copy link
Contributor Author

nitkon commented May 10, 2019

/test

@estesp
Copy link
Member

estesp commented May 10, 2019

Looks like a few problems

  • whatever hw Travis is using for ppc64le seems to be underpowered/slow; both overall test timeouts and other parts of the CI are running much slower
  • the new os: list conflicts with the other setting to run on darwin and tries to run a darwin/ppc64le pair, which obviously doesn't work.

@estesp estesp mentioned this pull request May 10, 2019
@nitkon nitkon force-pushed the patch-2 branch 2 times, most recently from 676e1d0 to 4b3d517 Compare May 12, 2019 06:53
@nitkon
Copy link
Contributor Author

nitkon commented May 12, 2019

@estesp: Updated the PR to exclude darwin/ppc64le pair. However one of the Travis CI is terminated because of The job exceeded the maximum time limit for jobs, and has been terminated. Should we exceed the timeout limits for ppc64le if incase the CI continues to exceed the time limit?

@mkumatag
Copy link

Looks like a few problems

  • whatever hw Travis is using for ppc64le seems to be underpowered/slow; both overall test timeouts and other parts of the CI are running much slower

@estesp in the logs, I see that the following step is taking more time on ppc64le compare to x86:

Step Time on x86 Time on ppc64le
sudo PATH=$PATH GOPATH=$GOPATH script/setup/install-protobuf 0.7s 1284.61s(~21mins)

The difference what I see in that particular script is that for x86 it is just download of the package from release section vs actual probuf compilation from the source which is causing the more delay here.

I see the recent version of protobuf publishing the package for the ppc64le architecture as well: https://github.com/protocolbuffers/protobuf/releases/download/v3.7.1/protoc-3.7.1-linux-ppcle_64.zip, so I'm wondering whether we can just bump up the protobuf version to v3.7.1 so same those ~21mins straightaway.

@theopenlab-ci
Copy link

theopenlab-ci bot commented May 15, 2019

Build succeeded.

@nitkon nitkon force-pushed the patch-2 branch 2 times, most recently from 4b3d517 to c219696 Compare May 15, 2019 06:14
@theopenlab-ci
Copy link

theopenlab-ci bot commented May 15, 2019

Build succeeded.

@nitkon
Copy link
Contributor Author

nitkon commented May 15, 2019

With the current code setup, the Travis CI is timing out on ppc64le at approx 50min
travis-CI

However on bumping the protobuf version to v3.7.1 , all CI's fail as recipe for target 'check-api-descriptors' fails

+ check-protos
+ check-api-descriptors
 M api/next.pb.txt
diff --git a/api/next.pb.txt b/api/next.pb.txt
index bd201ad..1f6d374 100755
--- a/api/next.pb.txt
+++ b/api/next.pb.txt
@@ -840,6 +840,7 @@ file {
     java_outer_classname: "FieldMaskProto"
     java_multiple_files: true
     go_package: "google.golang.org/genproto/protobuf/field_mask;field_mask"
+    cc_enable_arenas: true
     objc_class_prefix: "GPB"
     csharp_namespace: "Google.Protobuf.WellKnownTypes"
   }
- please run 'make protos' when making changes to proto files and check-in the generated descriptor file changes
Makefile:146: recipe for target 'check-api-descriptors' failed
make: *** [check-api-descriptors] Error 1

@estesp
Copy link
Member

estesp commented May 15, 2019

Would have to get @stevvooe's input on the 3.7.1 bump and whether that is possible with some simple changes, or recommended as a solution.

@nitkon
Copy link
Contributor Author

nitkon commented May 15, 2019

ping @stevvooe for input.

@crosbymichael
Copy link
Member

We can try the proto bump and to test, use a current client on the new daemon to make sure compatibility is there

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jun 6, 2019

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jun 6, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jun 6, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jun 6, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jul 25, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jul 25, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jul 25, 2019

Build succeeded.

@estesp
Copy link
Member

estesp commented Jul 25, 2019

Looks like this made much more progress than before; but a cgroup test problem, and looking ahead (since the CRI tests went ahead and ran) there were 3 failures there.. one with portforward and a socat problem..maybe within the ppc64le vm setup?, and two others, which were the positive and negative tests of NoNewPrivs.

This is the cgroup failing test during make integration:

--- FAIL: TestDaemonCustomCgroup (0.16s)
    daemon_config_linux_test.go:251: custom cgroup path /sys/fs/cgroup/hugetlb/673537132 should exist, actually not
FAIL

@theopenlab-ci
Copy link

theopenlab-ci bot commented Jul 31, 2019

Build succeeded.

@crosbymichael
Copy link
Member

I bumped the builds for you

@nitkon
Copy link
Contributor Author

nitkon commented Jul 31, 2019

Thanks @crosbymichael and @estesp All checks have passed.

api/next.pb.txt Outdated
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is this change from?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@crosbymichael:
This change is from make protos without which all the Travis CI's fail.

- please run 'make protos' when making changes to proto files and check-in the generated descriptor file changes
1030
Makefile:146: recipe for target 'check-api-descriptors' failed
1031
make: *** [check-api-descriptors] Error 1
1032
The command "if [ "$GOOS" = "linux" ]; then make check-protos check-api-descriptors; fi" exited with 2.

@crosbymichael
Copy link
Member

LGTM

@theopenlab-ci
Copy link

theopenlab-ci bot commented Aug 1, 2019

Build succeeded.

Bump Protobuf version to 3.7.0

Signed-off-by: Nitesh Konkar <[email protected]>
@theopenlab-ci
Copy link

theopenlab-ci bot commented Aug 1, 2019

Build succeeded.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Aug 1, 2019

Build succeeded.

@nitkon
Copy link
Contributor Author

nitkon commented Aug 1, 2019

@crosbymichael could you please restart the CI or if I could get the permissions to do so, it would be more convenient. Thnx!

@crosbymichael
Copy link
Member

@nitkon i bumped the CI but the tests are still timing out so it looks like a real issue.

@theopenlab-ci
Copy link

theopenlab-ci bot commented Aug 3, 2019

Build succeeded.

Enable travis CI for ppc64le arch

Signed-off-by: Nitesh Konkar <[email protected]>
@theopenlab-ci
Copy link

theopenlab-ci bot commented Aug 4, 2019

Build succeeded.

@codecov-io
Copy link

Codecov Report

Merging #3272 into master will decrease coverage by 4.32%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #3272      +/-   ##
==========================================
- Coverage   44.18%   39.86%   -4.33%     
==========================================
  Files         124       86      -38     
  Lines       13751    11635    -2116     
==========================================
- Hits         6076     4638    -1438     
+ Misses       6744     6336     -408     
+ Partials      931      661     -270
Flag Coverage Δ
#linux ?
#windows 39.86% <ø> (+0.06%) ⬆️
Impacted Files Coverage Δ
cio/io.go 1.4% <0%> (-45.08%) ⬇️
snapshots/native/native.go 1.79% <0%> (-41.26%) ⬇️
archive/tar.go 16.99% <0%> (-26.8%) ⬇️
metadata/snapshot.go 23.86% <0%> (-24.05%) ⬇️
gc/scheduler/scheduler.go 66.34% <0%> (-0.97%) ⬇️
content/local/writer.go 57.69% <0%> (-0.97%) ⬇️
remotes/docker/resolver.go 53.53% <0%> (-0.44%) ⬇️
oci/spec_opts.go 29.06% <0%> (-0.24%) ⬇️
remotes/docker/pusher.go 0% <0%> (ø) ⬆️
pkg/encryption/gpg.go 0% <0%> (ø) ⬆️
... and 39 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f082134...d1b9ee5. Read the comment docs.

@nitkon
Copy link
Contributor Author

nitkon commented Aug 4, 2019

@crosbymichael @estesp: Finally all green! All the Travis CI tests have passed. It was failing due to some issues with Travis CI like the tests getting timed out due to networking issues, unrelated test failures etc. Apologies for so many re-pushes.

@crosbymichael
Copy link
Member

Times look good on the CI now, is it stable?

@nitkon
Copy link
Contributor Author

nitkon commented Aug 5, 2019

@crosbymichael
Copy link
Member

LGTM

Copy link
Member

@estesp estesp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@estesp estesp merged commit 24e3848 into containerd:master Aug 5, 2019
tussennet pushed a commit to tussennet/containerd that referenced this pull request Sep 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants