Skip to content

Bump golang 1.16.5#40353

Merged
thaJeztah merged 3 commits intomoby:masterfrom
thaJeztah:bump_golang_1.14
Jun 17, 2021
Merged

Bump golang 1.16.5#40353
thaJeztah merged 3 commits intomoby:masterfrom
thaJeztah:bump_golang_1.14

Conversation

@thaJeztah
Copy link
Member

@thaJeztah thaJeztah commented Jan 7, 2020

Just testing if there's regressions / issues with Go 1.14 1.15

depends on:

@thaJeztah

This comment has been minimized.

@eclipseo

This comment has been minimized.

@AkihiroSuda

This comment has been minimized.

@thaJeztah thaJeztah changed the title [Do not merge] Bump golang 1.14beta1 [Do not merge] Bump golang 1.14rc1 Feb 7, 2020
@thaJeztah
Copy link
Member Author

thaJeztah commented Feb 7, 2020

Some more test-changes are needed looks like;


[2020-02-07T14:16:21.129Z] === FAIL: arm64.integration.system TestLoginFailsWithBadCredentials (0.27s)
[2020-02-07T14:16:21.129Z]     TestLoginFailsWithBadCredentials: login_test.go:27: assertion failed: expected error "Error response from daemon: Get https://registry-1.docker.io/v2/: unauthorized: incorrect username or password", got "Error response from daemon: Get \"https://registry-1.docker.io/v2/\": unauthorized: incorrect username or password"
[2020-02-07T14:16:21.129Z]         Error response from daemon: Get "https://registry-1.docker.io/v2/": unauthorized: incorrect username or password

Interesting; validation somehow failed;


[2020-02-07T13:59:00.597Z] + docker run --rm -t --privileged -v /home/ubuntu/workspace/moby_PR-40353/bundles:/go/src/github.com/docker/docker/bundles -v /home/ubuntu/workspace/moby_PR-40353/.git:/go/src/github.com/docker/docker/.git --name docker-pr3 -e DOCKER_EXPERIMENTAL -e DOCKER_GITCOMMIT=da46849f4f5f4458aba8bf49a85c92473c0956d9 -e DOCKER_GRAPHDRIVER -e TEST_FORCE_VALIDATE -e VALIDATE_REPO=https://github.com/moby/moby.git -e VALIDATE_BRANCH=master docker:da46849f4f5f4458aba8bf49a85c92473c0956d9 hack/validate/default
[2020-02-07T13:59:01.522Z] Congratulations!  All commits are properly signed with the DCO!
[2020-02-07T13:59:01.777Z] Congratulations!  Packages in "./pkg/..." are safely isolated from internal code.
script returned exit code 1

@thaJeztah
Copy link
Member Author

Ok, problem looks to be with swagger-gen;

root@b5beaed18589:/go/src/github.com/docker/docker# ./hack/generate-swagger-api.sh
2020/02/07 15:12:01 trying to read config from /go/src/github.com/docker/docker/api/swagger-gen.yaml
2020/02/07 15:12:02 rendering 1 templates for model ErrorResponse
2020/02/07 15:12:02 name field ErrorResponse
2020/02/07 15:12:02 package field types
2020/02/07 15:12:02 creating "error_response.go" in "api/types" as definition
model: template: schematype:2:18: executing "schemaType" at <(len .AllOf) gt 0>: can't give argument to non-function len .AllOf

@thaJeztah
Copy link
Member Author

@thaJeztah
Copy link
Member Author

hm why is it still failing on this one? Or do we have two tests with this problem?

=== RUN   TestLoginFailsWithBadCredentials
    TestLoginFailsWithBadCredentials: login_test.go:27: assertion failed: expected error "Error response from daemon: Get https://registry-1.docker.io/v2/: unauthorized: incorrect username or password", got "Error response from daemon: Get \"https://registry-1.docker.io/v2/\": unauthorized: incorrect username or password"
        Error response from daemon: Get "https://registry-1.docker.io/v2/": unauthorized: incorrect username or password
--- FAIL: TestLoginFailsWithBadCredentials (0.20s)

@thaJeztah thaJeztah force-pushed the bump_golang_1.14 branch 2 times, most recently from 57808d7 to 91cac41 Compare February 10, 2020 17:52
@thaJeztah
Copy link
Member Author

thaJeztah commented Feb 10, 2020

Interesting failure in a unit test;

=== RUN   TestCatchAll
    TestCatchAll: signal_linux_test.go:38: assertion failed: urgent I/O condition (string) != continued (string)
    TestCatchAll: signal_linux_test.go:38: assertion failed: continued (string) != hangup (string)
    TestCatchAll: signal_linux_test.go:38: assertion failed: hangup (string) != child exited (string)
    TestCatchAll: signal_linux_test.go:38: assertion failed: child exited (string) != illegal instruction (string)
    TestCatchAll: signal_linux_test.go:38: assertion failed: illegal instruction (string) != floating point exception (string)
--- FAIL: TestCatchAll (0.01s)

opened #40496

@thaJeztah
Copy link
Member Author

Whoop, green!

So, final step would be to fix swagger-get (or find out if it's a regression/bug in Go 1.14)

@thaJeztah thaJeztah force-pushed the bump_golang_1.14 branch 2 times, most recently from 263f119 to dbd8865 Compare February 11, 2020 01:08
@thaJeztah
Copy link
Member Author

One failure in a unit test;


[2020-02-11T01:17:02.729Z] === Failed
[2020-02-11T01:17:02.729Z] === FAIL: daemon/logger/loggerutils TestFollowLogsProducerGone (30.00s)
[2020-02-11T01:17:02.729Z]     TestFollowLogsProducerGone: logfile_test.go:133: logDecode() closed after sending 1 messages
[2020-02-11T01:17:02.729Z]     TestFollowLogsProducerGone: logfile_test.go:186: timeout waiting for log messages to be read (sent: 1, received: 1

@SamWhited
Copy link
Contributor

SamWhited commented Feb 13, 2020

The test failure sounds like the following change in Go 1.14:

The text/template package now correctly reports errors when a parenthesized argument is used as a function. This most commonly shows up in erroneous cases like {{if (eq .F "a") or (eq .F "b")}}. This should be written as {{if or (eq .F "a") (eq .F "b")}}. The erroneous case never worked as expected, and will now be reported with an error can't give argument to non-function.

The CL is here: https://golang.org/cl/206124

EDIT: this appears to be fixed in upstream swagger (see the order of the "gt" in https://github.com/go-swagger/go-swagger/blob/master/generator/templates/schematype.gotmpl)

@thaJeztah thaJeztah force-pushed the bump_golang_1.14 branch 2 times, most recently from 1348193 to bcbd787 Compare February 13, 2020 20:19
@thaJeztah thaJeztah force-pushed the bump_golang_1.14 branch 2 times, most recently from 8fee344 to 8ae23d7 Compare June 7, 2021 07:49
@thaJeztah thaJeztah changed the title Bump golang 1.16.4 Bump golang 1.16.5 Jun 7, 2021
@thaJeztah
Copy link
Member Author

Rebased, and updated to golang 1.16.5

@thaJeztah
Copy link
Member Author

More flakiness? failures in TestParallel1, TestParallel2, TestParallel3 tests (libnetwork) https://ci-next.docker.com/public/job/moby/job/PR-40353/72/execution/node/298/log/?consoleFull

Details
=== �[31mFailed�[0m
 === �[31mFAIL�[0m: libnetwork TestParallel2 (unknown)
 time="2021-06-07T14:49:53Z" level=info msg=" does not exist, we create an empty resolv.conf for container"
 coverage: 41.0% of statements
 panic: test timed out after 5m0s
 
 goroutine 338 [running]:
 testing.(*M).startAlarm.func1()
 	/usr/local/go/src/testing/testing.go:1700 +0xc8
 created by time.goFunc
 	/usr/local/go/src/time/sleep.go:180 +0x40
 
 goroutine 1 [chan receive]:
 testing.tRunner.func1(0x400008a900)
 	/usr/local/go/src/testing/testing.go:1159 +0x210
 testing.tRunner(0x400008a900, 0x40000cbcc8)
 	/usr/local/go/src/testing/testing.go:1197 +0x10c
 testing.runTests(0x400000e858, 0xfdfe80, 0x34, 0x34, 0xc027aa6695f6f0f5, 0x45db2ca4d3, 0xfe9b60, 0x995748)
 	/usr/local/go/src/testing/testing.go:1509 +0x29c
 testing.(*M).Run(0x400021a380, 0x0)
 	/usr/local/go/src/testing/testing.go:1417 +0x1b4
 github.com/docker/docker/libnetwork_test.TestMain(0x400021a380)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_test.go:46 +0x100
 main.main()
 	_testmain.go:247 +0x1d4
 
 goroutine 309 [IO wait]:
 internal/poll.runtime_pollWait(0xffff6426cd10, 0x72, 0x28)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x40008a0498, 0x72, 0x200, 0x200, 0x400102e0f0)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).ReadMsg(0x40008a0480, 0x4000f22600, 0x200, 0x200, 0x400102e0f0, 0x28, 0x28, 0x0, 0x0, 0x0, ...)
 	/usr/local/go/src/internal/poll/fd_unix.go:249 +0x19c
 net.(*netFD).readMsg(0x40008a0480, 0x4000f22600, 0x200, 0x200, 0x400102e0f0, 0x28, 0x28, 0x66804, 0x400082eba8, 0x77a44, ...)
 	/usr/local/go/src/net/fd_posix.go:67 +0x5c
 net.(*UDPConn).readMsg(0x40001205b0, 0x4000f22600, 0x200, 0x200, 0x400102e0f0, 0x28, 0x28, 0xffff8cf0b108, 0x30, 0x400102e0f0, ...)
 	/usr/local/go/src/net/udpsock_posix.go:59 +0x5c
 net.(*UDPConn).ReadMsgUDP(0x40001205b0, 0x4000f22600, 0x200, 0x200, 0x400102e0f0, 0x28, 0x28, 0x9d8628, 0x400082ed38, 0x387de0, ...)
 	/usr/local/go/src/net/udpsock.go:139 +0x60
 github.com/docker/docker/vendor/github.com/miekg/dns.ReadFromSessionUDP(0x40001205b0, 0x4000f22600, 0x200, 0x200, 0x0, 0x0, 0xfe9b60, 0xffff55f57690)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/udp.go:42 +0x88
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).readUDP(0x40006597a0, 0x40001205b0, 0x77359400, 0x386cf8, 0x1018580, 0xffff55f57690, 0x1018580, 0x8c0b01, 0x4000bbc001)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:645 +0xd0
 github.com/docker/docker/vendor/github.com/miekg/dns.defaultReader.ReadUDP(0x40006597a0, 0x40001205b0, 0x77359400, 0xffff55f563a0, 0x4000bbc050, 0x1, 0x0, 0xaaa138, 0x4000bbc050)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:153 +0x38
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).serveUDP(0x40006597a0, 0x40001205b0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:462 +0x114
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).ActivateAndServe(0x40006597a0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:331 +0x1dc
 github.com/docker/docker/libnetwork.(*resolver).Start.func2(0x40006597a0)
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:160 +0x4c
 created by github.com/docker/docker/libnetwork.(*resolver).Start
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:159 +0x2a0
 
 goroutine 8 [select]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b2200)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 9 [select, 5 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b2300, 0xac1b38, 0x4000211440, 0x4000102900)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 10 [IO wait, 5 minutes]:
 internal/poll.runtime_pollWait(0xffff64069418, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x400021ab18, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x400021ab00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x400021ab00, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x4000720210, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x4000720210, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b2200, 0x400020a840, 0x28, 0xabe1e0, 0x4000720210)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 12 [select, 5 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b2400)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 13 [select, 5 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b2500, 0xac1b38, 0x40002118c0, 0x4000102e40)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 14 [IO wait, 5 minutes]:
 internal/poll.runtime_pollWait(0xffff64069330, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x400021b398, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x400021b380, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x400021b380, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x4000721b00, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x4000721b00, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b2400, 0x400020af00, 0x28, 0xabe1e0, 0x4000721b00)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 94 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000810400, 0xac1b38, 0x400026f900, 0x400025de00)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 324 [chan receive]:
 testing.runTests.func1.1(0x400008a900)
 	/usr/local/go/src/testing/testing.go:1516 +0x30
 created by testing.runTests.func1
 	/usr/local/go/src/testing/testing.go:1516 +0xa8
 
 goroutine 52 [select, 5 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000810000)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 42 [select]:
 github.com/docker/docker/libnetwork/osl.removeUnusedPaths()
 	/go/src/github.com/docker/docker/libnetwork/osl/namespace_linux.go:107 +0x294
 created by github.com/docker/docker/libnetwork/osl.createBasePath
 	/go/src/github.com/docker/docker/libnetwork/osl/namespace_linux.go:92 +0xa8
 
 goroutine 46 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64069160, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x400027a698, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x400027a680, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x400027a680, 0x4000219344, 0x4000526708, 0x386508)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x400026d4a0, 0x9d86f0, 0x4000526778, 0x7a430c)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x400026d4a0, 0x1, 0x0, 0x4000213180, 0x4000010528)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x4000810000, 0x40000f4750, 0x28, 0xabe1e0, 0x400026d4a0)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 45 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000810100, 0xac1b38, 0x400026e100, 0x400025c0c0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 137 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068f90, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x400027a918, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x400027a900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x400027a900, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x40007c1e00, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x40007c1e00, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x4000654400, 0x40000f4c00, 0x28, 0xabe1e0, 0x40007c1e00)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 100 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000654200)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 93 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000810300)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 249 [runnable, locked to thread]:
 sync.runtime_SemacquireMutex(0x400020b010, 0x100, 0x1)
 	/usr/local/go/src/runtime/sema.go:71 +0x40
 sync.(*Mutex).lockSlow(0x400020b00c)
 	/usr/local/go/src/sync/mutex.go:138 +0xf4
 sync.(*Mutex).Lock(...)
 	/usr/local/go/src/sync/mutex.go:81
 github.com/docker/docker/vendor/github.com/vishvananda/netlink/nl.(*NetlinkRequest).Execute(0x400111f488, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/vishvananda/netlink/nl/nl_linux.go:408 +0x688
 github.com/docker/docker/vendor/github.com/vishvananda/netlink.execGetLink(0x400111f488, 0x4000f60ce0, 0x2, 0x2, 0x3)
 	/go/src/github.com/docker/docker/vendor/github.com/vishvananda/netlink/link_linux.go:1480 +0x30
 github.com/docker/docker/vendor/github.com/vishvananda/netlink.(*Handle).LinkByName(0x4000066ab0, 0x4000f008d0, 0xb, 0x3, 0x400084d678, 0x40008cff3a, 0x5)
 	/go/src/github.com/docker/docker/vendor/github.com/vishvananda/netlink/link_linux.go:1415 +0x2c8
 github.com/docker/docker/libnetwork/osl.(*networkNamespace).AddInterface(0x4000138370, 0x4000f008d0, 0xb, 0x993887, 0x3, 0x4000f60cc0, 0x3, 0x4, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/osl/interface_linux.go:259 +0xc34
 github.com/docker/docker/libnetwork.(*sandbox).populateNetworkResources(0x4000a48800, 0x4000e422c0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/sandbox.go:872 +0x630
 github.com/docker/docker/libnetwork.(*endpoint).sbJoin(0x4000e429a0, 0x4000a48800, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/endpoint.go:523 +0xc28
 github.com/docker/docker/libnetwork.(*endpoint).Join(0x4000e429a0, 0xacdd18, 0x4000a48800, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/endpoint.go:439 +0x104
 github.com/docker/docker/libnetwork_test.parallelJoin(0x4000107380, 0xacdd18, 0x4000a48800, 0xac9110, 0x4000e429a0, 0x3)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:919 +0x78
 github.com/docker/docker/libnetwork_test.runParallelTests(0x4000107380, 0x3)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:1042 +0x47c
 github.com/docker/docker/libnetwork_test.TestParallel3(0x4000107380)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:1167 +0x30
 testing.tRunner(0x4000107380, 0x9d73f0)
 	/usr/local/go/src/testing/testing.go:1193 +0xdc
 created by testing.(*T).Run
 	/usr/local/go/src/testing/testing.go:1238 +0x244
 
 goroutine 101 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000654300, 0xac1b38, 0x40000a7240, 0x40001035c0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 245 [runnable, locked to thread]:
 syscall.Syscall6(0xce, 0x1b, 0x4000273200, 0x38, 0x0, 0x400020a250, 0xc, 0x38, 0x4000273200, 0x0)
 	/usr/local/go/src/syscall/asm_linux_arm64.s:35 +0x10
 github.com/docker/docker/vendor/golang.org/x/sys/unix.sendto(0x1b, 0x4000273200, 0x38, 0x38, 0x0, 0x400020a250, 0xc, 0x4000273200, 0x4000868360)
 	/go/src/github.com/docker/docker/vendor/golang.org/x/sys/unix/zsyscall_linux_arm64.go:540 +0x6c
 github.com/docker/docker/vendor/golang.org/x/sys/unix.Sendto(0x1b, 0x4000273200, 0x38, 0x38, 0x0, 0xaa9eb8, 0x400020a244, 0x4e75c4, 0x4000fcf1d8)
 	/go/src/github.com/docker/docker/vendor/golang.org/x/sys/unix/syscall_unix.go:321 +0x90
 github.com/docker/docker/vendor/github.com/vishvananda/netlink/nl.(*NetlinkSocket).Send(0x400020a240, 0x4000fcf488, 0x0, 0x4000bba048)
 	/go/src/github.com/docker/docker/vendor/github.com/vishvananda/netlink/nl/nl_linux.go:619 +0x64
 github.com/docker/docker/vendor/github.com/vishvananda/netlink/nl.(*NetlinkRequest).Execute(0x4000fcf488, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/vishvananda/netlink/nl/nl_linux.go:412 +0xc4
 github.com/docker/docker/vendor/github.com/vishvananda/netlink.execGetLink(0x4000fcf488, 0x4000153ce0, 0x2, 0x2, 0x3)
 	/go/src/github.com/docker/docker/vendor/github.com/vishvananda/netlink/link_linux.go:1480 +0x30
 github.com/docker/docker/vendor/github.com/vishvananda/netlink.(*Handle).LinkByName(0x4000186000, 0x4000f002b0, 0xb, 0x18, 0x0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/vishvananda/netlink/link_linux.go:1415 +0x2c8
 github.com/docker/docker/libnetwork/osl.(*networkNamespace).AddInterface(0x40000e2d10, 0x4000f002b0, 0xb, 0x993887, 0x3, 0x4000f60a00, 0x3, 0x4, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/osl/interface_linux.go:280 +0x23c
 github.com/docker/docker/libnetwork.(*sandbox).populateNetworkResources(0x4000d2c600, 0x4000e42160, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/sandbox.go:872 +0x630
 github.com/docker/docker/libnetwork.(*endpoint).sbJoin(0x4000e426e0, 0x4000d2c600, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/endpoint.go:523 +0xc28
 github.com/docker/docker/libnetwork.(*endpoint).Join(0x4000e426e0, 0xacdd18, 0x4000d2c600, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/libnetwork/endpoint.go:439 +0x104
 github.com/docker/docker/libnetwork_test.parallelJoin(0x4000b45800, 0xacdd18, 0x4000d2c600, 0xac9110, 0x4000e426e0, 0x2)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:919 +0x78
 github.com/docker/docker/libnetwork_test.runParallelTests(0x4000b45800, 0x2)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:1042 +0x47c
 github.com/docker/docker/libnetwork_test.TestParallel2(0x4000b45800)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:1074 +0x30
 testing.tRunner(0x4000b45800, 0x9d73e8)
 	/usr/local/go/src/testing/testing.go:1193 +0xdc
 created by testing.(*T).Run
 	/usr/local/go/src/testing/testing.go:1238 +0x244
 
 goroutine 190 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b2600, 0xac1b38, 0x40007182c0, 0x400061aea0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 136 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000654500, 0xac1b38, 0x4000968480, 0x40009d2a20)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 65 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000654100, 0xac1b38, 0x40000a6c00, 0x4000103080)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 64 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000654000)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 244 [chan receive, locked to thread]:
 github.com/docker/docker/libnetwork_test.runParallelTests(0x4000b45680, 0x1)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:1054 +0x564
 github.com/docker/docker/libnetwork_test.TestParallel1(0x4000b45680)
 	/go/src/github.com/docker/docker/libnetwork/libnetwork_linux_test.go:1070 +0x30
 testing.tRunner(0x4000b45680, 0x9d73e0)
 	/usr/local/go/src/testing/testing.go:1193 +0xdc
 created by testing.(*T).Run
 	/usr/local/go/src/testing/testing.go:1238 +0x244
 
 goroutine 189 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b2100)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 135 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000654400)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 191 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068ea8, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x400021a898, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x400021a880, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x400021a880, 0x400026a044, 0x400026a080, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x40002fc600, 0xabe1d8, 0x4000b7cf78, 0x7a446c)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x40002fc600, 0x1, 0xabe1b0, 0x4000152160, 0x4000b39c20)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b2100, 0x400011a6c0, 0x28, 0xabe1e0, 0x40002fc600)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 192 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b2900)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 133 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40008deb00, 0xac1b38, 0x4000a4c5c0, 0x4000a452c0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 115 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000811700)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 116 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000811800, 0xac1b38, 0x4000719e00, 0x4000289f20)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 119 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000927200)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 120 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000927300, 0xac1b38, 0x4000969b80, 0x40009a1c80)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 132 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40008dea00)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 148 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000926800)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 149 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000926900, 0xac1b38, 0x40009dc200, 0x40009d2780)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 152 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000926b00)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 153 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000926c00, 0xac1b38, 0x40009dd140, 0x40009d34a0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 150 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64069248, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000580818, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x4000580800, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x4000580800, 0xacae48, 0x4000216270, 0x77359400)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x40002693e0, 0x40001d10e0, 0x0, 0x7cb64)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x40002693e0, 0x998b2f, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x4000926800, 0x40009b5170, 0x28, 0xabe1e0, 0x40002693e0)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 154 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068dc0, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000581518, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x4000581500, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x4000581500, 0x40002120a0, 0x400004f708, 0x3864bc)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x400026de60, 0x40005f4e80, 0x400004f778, 0x7a430c)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x400026de60, 0x1, 0x400004f788, 0x4000212080, 0x4000010710)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x4000926b00, 0x40009b5aa0, 0x28, 0xabe1e0, 0x400026de60)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 23 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64069078, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000a26598, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x4000a26580, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x4000a26580, 0x16650, 0x400007b978, 0x4000067c40)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x40008dc360, 0x0, 0x4000abbf88, 0x400007b978)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x40008dc360, 0x0, 0x4000abbf88, 0x33a180, 0x400007b920)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40007ecc00, 0x400072cb10, 0x28, 0xabe1e0, 0x40008dc360)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 22 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40007ecd00, 0xac1b38, 0x40008683c0, 0x40008da840)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 21 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40007ecc00)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 310 [IO wait]:
 internal/poll.runtime_pollWait(0xffff6426cdf8, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x40008a0598, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x40008a0580, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x40008a0580, 0xffff8cf0ba68, 0x10, 0x4000f00a80)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*TCPListener).accept(0x4000c4c510, 0x386970, 0xc, 0x8d5c40)
 	/usr/local/go/src/net/tcpsock_posix.go:139 +0x2c
 net.(*TCPListener).Accept(0x4000c4c510, 0x4000f00a01, 0x4000f00a64, 0x1, 0x0)
 	/usr/local/go/src/net/tcpsock.go:261 +0x5c
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).serveTCP(0x4000659b00, 0xabe1b0, 0x4000c4c510, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:419 +0xd8
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).ActivateAndServe(0x4000659b00, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:337 +0xf0
 github.com/docker/docker/libnetwork.(*resolver).Start.func3(0x4000659b00)
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:168 +0x4c
 created by github.com/docker/docker/libnetwork.(*resolver).Start
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:167 +0x340
 
 goroutine 299 [select]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40008def00, 0xac1b38, 0x40000a67c0, 0x4000c72f60)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 176 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x4000810800)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 177 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x4000810900, 0xac1b38, 0x400066af40, 0x40001c9920)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 193 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b2a00, 0xac1b38, 0x4000718ac0, 0x4000882000)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 210 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068cd8, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x400021be18, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x400021be00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x400021be00, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x4000996420, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x4000996420, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b2900, 0x400011b110, 0x28, 0xabe1e0, 0x4000996420)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 211 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b2c00)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 212 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b2d00, 0xac1b38, 0x4000719340, 0x4000882f60)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 213 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068b08, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000796918, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x4000796900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x4000796900, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x4000997dd0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x4000997dd0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b2c00, 0x400011b860, 0x28, 0xabe1e0, 0x4000997dd0)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 214 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b3300)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 215 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b3400, 0xac1b38, 0x400026e240, 0x40008da000)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 216 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068bf0, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000970498, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x4000970480, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x4000970480, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x40008ddb30, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x40008ddb30, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b3300, 0x400072c420, 0x28, 0xabe1e0, 0x40008ddb30)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 218 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b3600)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 219 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b3700, 0xac1b38, 0x400026ec40, 0x40008db5c0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 220 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068a20, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000970e98, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x4000970e80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x4000970e80, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x4000a11650, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x4000a11650, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b3600, 0x400072ce10, 0x28, 0xabe1e0, 0x4000a11650)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 222 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b3800)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 223 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b3900, 0xac1b38, 0x400026f000, 0x40008dbec0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 202 [IO wait]:
 internal/poll.runtime_pollWait(0xffff6426cc28, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000580918, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x4000580900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x4000580900, 0xffff8cf0bf18, 0x10, 0x40007f24f0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*TCPListener).accept(0x400077a990, 0x386970, 0xc, 0x8d5c40)
 	/usr/local/go/src/net/tcpsock_posix.go:139 +0x2c
 net.(*TCPListener).Accept(0x400077a990, 0x40007f2401, 0x40007f24d4, 0x1, 0x0)
 	/usr/local/go/src/net/tcpsock.go:261 +0x5c
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).serveTCP(0x40007c8d80, 0xabe1b0, 0x400077a990, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:419 +0xd8
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).ActivateAndServe(0x40007c8d80, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:337 +0xf0
 github.com/docker/docker/libnetwork.(*resolver).Start.func3(0x40007c8d80)
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:168 +0x4c
 created by github.com/docker/docker/libnetwork.(*resolver).Start
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:167 +0x340
 
 goroutine 225 [select, 4 minutes]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40001b3a00)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 226 [select, 4 minutes]:
 github.com/docker/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0x40001b3b00, 0xac1b38, 0x400026f400, 0x4000a441e0)
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/peerdb.go:281 +0xa0
 created by github.com/docker/docker/libnetwork/drivers/overlay.Init
 	/go/src/github.com/docker/docker/libnetwork/drivers/overlay/overlay.go:79 +0x158
 
 goroutine 227 [IO wait, 4 minutes]:
 internal/poll.runtime_pollWait(0xffff64068850, 0x72, 0x0)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x40008a0518, 0x72, 0x0, 0x0, 0x995518)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).Accept(0x40008a0500, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x1b0
 net.(*netFD).accept(0x40008a0500, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/fd_unix.go:172 +0x2c
 net.(*UnixListener).accept(0x4000a69560, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock_posix.go:162 +0x2c
 net.(*UnixListener).Accept(0x4000a69560, 0x0, 0x0, 0x0, 0x0)
 	/usr/local/go/src/net/unixsock.go:260 +0x5c
 github.com/docker/docker/libnetwork.(*controller).acceptClientConnections(0x40001b3a00, 0x400072dfb0, 0x28, 0xabe1e0, 0x4000a69560)
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x7c
 created by github.com/docker/docker/libnetwork.(*controller).startExternalKeyListener
 	/go/src/github.com/docker/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x48c
 
 goroutine 298 [select]:
 github.com/docker/docker/libnetwork.(*controller).watchLoop(0x40008dee00)
 	/go/src/github.com/docker/docker/libnetwork/store.go:430 +0xc4
 created by github.com/docker/docker/libnetwork.(*controller).startWatch
 	/go/src/github.com/docker/docker/libnetwork/store.go:447 +0x150
 
 goroutine 201 [IO wait]:
 internal/poll.runtime_pollWait(0xffff6426cb40, 0x72, 0x28)
 	/usr/local/go/src/runtime/netpoll.go:222 +0x44
 internal/poll.(*pollDesc).wait(0x4000580798, 0x72, 0x200, 0x200, 0x400102e0c0)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x38
 internal/poll.(*pollDesc).waitRead(...)
 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
 internal/poll.(*FD).ReadMsg(0x4000580780, 0x4000f22400, 0x200, 0x200, 0x400102e0c0, 0x28, 0x28, 0x0, 0x0, 0x0, ...)
 	/usr/local/go/src/internal/poll/fd_unix.go:249 +0x19c
 net.(*netFD).readMsg(0x4000580780, 0x4000f22400, 0x200, 0x200, 0x400102e0c0, 0x28, 0x28, 0x66804, 0x400082dba8, 0x77a44, ...)
 	/usr/local/go/src/net/fd_posix.go:67 +0x5c
 net.(*UDPConn).readMsg(0x4000216370, 0x4000f22400, 0x200, 0x200, 0x400102e0c0, 0x28, 0x28, 0xffff8cf0b108, 0x30, 0x400102e0c0, ...)
 	/usr/local/go/src/net/udpsock_posix.go:59 +0x5c
 net.(*UDPConn).ReadMsgUDP(0x4000216370, 0x4000f22400, 0x200, 0x200, 0x400102e0c0, 0x28, 0x28, 0x9d8628, 0x400082dd38, 0x387de0, ...)
 	/usr/local/go/src/net/udpsock.go:139 +0x60
 github.com/docker/docker/vendor/github.com/miekg/dns.ReadFromSessionUDP(0x4000216370, 0x4000f22400, 0x200, 0x200, 0x0, 0x0, 0xfe9b60, 0xffff55f57690)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/udp.go:42 +0x88
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).readUDP(0x40007c86c0, 0x4000216370, 0x77359400, 0x386cf8, 0x1018580, 0xffff55f57690, 0x1018580, 0x8c0b01, 0x4000bbc001)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:645 +0xd0
 github.com/docker/docker/vendor/github.com/miekg/dns.defaultReader.ReadUDP(0x40007c86c0, 0x4000216370, 0x77359400, 0xffff55f563a0, 0x4000bbc000, 0x1, 0x0, 0xaaa138, 0x4000bbc000)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:153 +0x38
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).serveUDP(0x40007c86c0, 0x4000216370, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:462 +0x114
 github.com/docker/docker/vendor/github.com/miekg/dns.(*Server).ActivateAndServe(0x40007c86c0, 0x0, 0x0)
 	/go/src/github.com/docker/docker/vendor/github.com/miekg/dns/server.go:331 +0x1dc
 github.com/docker/docker/libnetwork.(*resolver).Start.func2(0x40007c86c0)
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:160 +0x4c
 created by github.com/docker/docker/libnetwork.(*resolver).Start
 	/go/src/github.com/docker/docker/libnetwork/resolver.go:159 +0x2a0
 
 === �[31mFAIL�[0m: libnetwork TestParallel3 (unknown)
 
 === �[31mFAIL�[0m: libnetwork TestParallel1 (unknown)
 
 === �[31mFAIL�[0m: libnetwork/iptables TestConcurrencyNoWait (0.09s)
     iptables_test.go:217:  (iptables failed: iptables -t nat -A DOCKEREST -p tcp -d 192.168.1.1 --dport 1234 -j DNAT --to-destination 172.17.0.1:4321 ! -i lo: Another app is currently holding the xtables lock. Perhaps you want to use the -w option?
          (exit status 4))
 
 
 DONE 2654 tests, 35 skipped, 4 failures in 492.114s

@thaJeztah
Copy link
Member Author

thaJeztah commented Jun 7, 2021

Failing again (but only on arm64). Wondering if it's a change in Go 1.16.5 revealing an issue (I saw @cpuguy83 made some changes to the test, but already commented the test is "dubious")

[2021-06-07T21:04:30.958Z] === Failed
[2021-06-07T21:04:30.958Z] === FAIL: libnetwork TestParallel3 (unknown)
[2021-06-07T21:04:30.958Z] 
[2021-06-07T21:04:30.958Z] === FAIL: libnetwork TestParallel1 (unknown)
[2021-06-07T21:04:30.958Z] 
[2021-06-07T21:04:30.958Z] === FAIL: libnetwork TestParallel2 (unknown)
[2021-06-07T21:04:30.958Z] time="2021-06-07T21:03:57Z" level=info msg=" does not exist, we create an empty resolv.conf for container"
[2021-06-07T21:04:30.958Z] coverage: 41.0% of statements
[2021-06-07T21:04:30.958Z] panic: test timed out after 5m0s

Screenshot 2021-06-08 at 00 52 46

@thaJeztah
Copy link
Member Author

Wondering if the TestParallel failures are related to Go 1.16.5; golang/go@go1.16.4...go1.16.5

Trying reverting to Go 1.16.4 (temporary commit)

@thaJeztah
Copy link
Member Author

Nope.. same failures on Go 1.16.4

Signed-off-by: Sebastiaan van Stijn <[email protected]>
Signed-off-by: Sebastiaan van Stijn <[email protected]>
result of: `hack/vendor.sh archive/tar`

Signed-off-by: Sebastiaan van Stijn <[email protected]>
Copy link
Member

@cpuguy83 cpuguy83 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@samuelkarp samuelkarp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@samuelkarp
Copy link
Member

TestNetworkDBIslands - #42459

TestBuildWithHugeFile - new failure?

There is not enough space on the disk.
[2021-06-10T19:08:59.094Z] === RUN   TestBuildWithHugeFile
[2021-06-10T19:10:40.150Z]     build_test.go:523: assertion failed: string "{\"stream\":\"Step 1/2 : FROM busybox\"}\r\n{\"stream\":\"\\n\"}\r\n{\"stream\":\" ---\\u003e e357c98d2ebc\\n\"}\r\n{\"stream\":\"Step 2/2 : RUN powershell \\\"fsutil.exe file createnew bigfile.txt 8589934592 ; dir bigfile.txt\\\"\"}\r\n{\"stream\":\"\\n\"}\r\n{\"stream\":\" ---\\u003e Running in 572fa075cf77\\n\"}\r\n{\"stream\":\"File C:\\\\bigfile.txt is created\\r\\n\"}\r\n{\"stream\":\"\\r\\n\"}\r\n{\"stream\":\"\\r\\n\"}\r\n{\"stream\":\"    Directory: C:\\\\\\r\\n\"}\r\n{\"stream\":\"\\r\\n\"}\r\n{\"stream\":\"\\r\\n\"}\r\n{\"stream\":\"Mode                 LastWriteTime         Length Name                         \\r\\n\"}\r\n{\"stream\":\"----                 -------------         ------ ----                         \\r\\n\"}\r\n{\"stream\":\"-a----         6/10/2021   7:09 PM     8589934592 bigfile.txt                  \\r\\n\"}\r\n{\"stream\":\"\\r\\n\"}\r\n{\"stream\":\"\\r\\n\"}\r\n{\"stream\":\"Removing intermediate container 572fa075cf77\\n\"}\r\n{\"errorDetail\":{\"message\":\"re-exec error: exit status 1: output: write \\\\\\\\?\\\\D:\\\\CI\\\\PR-40353\\\\78\\\\daemon\\\\tmp\\\\hcs187086419\\\\Files\\\\bigfile.txt: There is not enough space on the disk.\"},\"error\":\"re-exec error: exit status 1: output: write \\\\\\\\?\\\\D:\\\\CI\\\\PR-40353\\\\78\\\\daemon\\\\tmp\\\\hcs187086419\\\\Files\\\\bigfile.txt: There is not enough space on the disk.\"}\r\n" does not contain "Successfully built"
[2021-06-10T19:10:40.150Z] --- FAIL: TestBuildWithHugeFile (96.77s)

TestBuildWCOWSandboxSize - new failure?

There is not enough space on the disk.
[2021-06-10T19:10:40.150Z] === RUN   TestBuildWCOWSandboxSize
[2021-06-10T19:12:06.038Z]     build_test.go:571: assertion failed: value "{\"stream\":\"Step 1/8 : FROM busybox AS intermediate\"}\r\n{\"stream\":\"\\n\"}\r\n{\"stream\":\" ---\\u003e e357c98d2ebc\\n\"}\r\n{\"stream\":\"Step 2/8 : WORKDIR C:\\\\\\\\stuff\"}\r\n{\"stream\":\"\\n\"}\r\n{\"stream\":\" ---\\u003e Running in f1cd9456d8a2\\n\"}\r\n{\"stream\":\"Removing intermediate container f1cd9456d8a2\\n\"}\r\n{\"stream\":\" ---\\u003e eb967c3b15cf\\n\"}\r\n{\"stream\":\"Step 3/8 : RUN fsutil file createnew C:\\\\\\\\stuff\\\\\\\\bigfile_0.txt 22548578304 \\u0026\\u0026 del bigfile_0.txt\"}\r\n{\"stream\":\"\\n\"}\r\n{\"stream\":\" ---\\u003e Running in 028c488c2aac\\n\"}\r\n{\"stream\":\"File C:\\\\stuff\\\\bigfile_0.txt is created\\r\\n\"}\r\n{\"stream\":\"Removing intermediate container 028c488c2aac\\n\"}\r\n{\"stream\":\" ---\\u003e 914f7627fcdb\\n\"}\r\n{\"stream\":\"Step 4/8 : RUN fsutil file createnew C:\\\\\\\\stuff\\\\\\\\bigfile_1.txt 7516192768\"}\r\n{\"stream\":\"\\n\"}\r\n{\"stream\":\" ---\\u003e Running in 2d46478fce31\\n\"}\r\n{\"stream\":\"File C:\\\\stuff\\\\bigfile_1.txt is created\\r\\n\"}\r\n{\"stream\":\"Removing intermediate container 2d46478fce31\\n\"}\r\n{\"errorDetail\":{\"message\":\"re-exec error: exit status 1: output: write \\\\\\\\?\\\\D:\\\\CI\\\\PR-40353\\\\78\\\\daemon\\\\tmp\\\\hcs852328715\\\\Files\\\\stuff\\\\bigfile_1.txt: There is not enough space on the disk.\"},\"error\":\"re-exec error: exit status 1: output: write \\\\\\\\?\\\\D:\\\\CI\\\\PR-40353\\\\78\\\\daemon\\\\tmp\\\\hcs852328715\\\\Files\\\\stuff\\\\bigfile_1.txt: There is not enough space on the disk.\"}\r\n" does not match regexp "Successfully built|COPY --from=intermediate"
[2021-06-10T19:12:06.038Z] --- FAIL: TestBuildWCOWSandboxSize (90.37s)

@thaJeztah
Copy link
Member Author

@thaJeztah thaJeztah merged commit 085dc34 into moby:master Jun 17, 2021
@thaJeztah thaJeztah deleted the bump_golang_1.14 branch June 17, 2021 08:19
sir-xw pushed a commit to openkylin/docker.io that referenced this pull request Apr 22, 2025
Issue mentioned upstream at <moby/moby#40353>,
there was a tentative fix at <moby/moby#40496>,
but the issue is still present.

    === Failed
    === FAIL: pkg/signal TestCatchAll (0.00s)
      signal_linux_test.go:32: assertion failed: urgent I/O condition (string) != hangup (string)
      signal_linux_test.go:32: assertion failed: hangup (string) != child exited (string)
      signal_linux_test.go:32: assertion failed: child exited (string) != illegal instruction (string)
      signal_linux_test.go:32: assertion failed: illegal instruction (string) != floating point exception (string)
      signal_linux_test.go:32: assertion failed: floating point exception (string) != child exited (string)


Gbp-Pq: Name test--skip-pkg-signal-flaky-tests.patch
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants