Skip to content

Unable to locate plugin: private #33052

@simonferquel

Description

@simonferquel

Description

On Windows, sometimes HNS seem to report unsupported networks, and that makes daemon start delayed by 15 seconds because of failing network plugins lookups.

Steps to reproduce the issue:

  1. Install Docker for Windows
  2. Launch it on Linux mode
  3. Switch to Windows Containers

Describe the results you received:
Windows Containers takes much more time than expected to start. Debug logs of the daemon actually show that the DockerNat virtual switch, which is used by Docker for Windows for Samba shares with the Linux VM and has nothing to do with the Windows Daemon, is actually reported by HNS with network type private. After that, Docker tries to find a plugin supporting this kind of Network, and fails, after having waited for 15 secs:

time="2017-05-05T17:37:10.553789700+02:00" level=debug msg="Option Experimental: true"
time="2017-05-05T17:37:10.553789700+02:00" level=debug msg="Option DefaultDriver: nat"
time="2017-05-05T17:37:10.553789700+02:00" level=debug msg="Option DefaultNetwork: nat"
time="2017-05-05T17:37:10.553789700+02:00" level=info msg="Restoring existing overlay networks from HNS into docker"
time="2017-05-05T17:37:10.561774300+02:00" level=debug msg="Network Response : [ { \"ComputedPolicies\" : [ { } ], \"CurrentEndpointCount\" : 0, \"ID\" : \"9d9c25ae-d3d3-459d-98e9-6964d10d2afa\", \"LayeredOn\" : \"9af0e1ff-6e10-4407-ac70-863ca084cd05\", \"MacPools\" : [ { \"EndMacAddress\" : \"00-15-5D-51-9F-FF\", \"StartMacAddress\" : \"00-15-5D-51-90-00\"} ], \"MaxConcurrentEndpoints\" : 4, \"NATName\" : \"H9d9c25ae-d3d3-459d-98e9-6964d10d2afa\", \"Name\" : \"nat\", \"Policies\" : [  ], \"Subnets\" : [ { \"AddressPrefix\" : \"172.24.240.0/20\", \"GatewayAddress\" : \"172.24.240.1\" } ], \"TotalEndpoints\" : 382, \"Type\" : \"nat\", \"Version\" : 4294967297 }, { \"ComputedPolicies\" : [ { } ], \"CurrentEndpointCount\" : 0, \"ID\" : \"b5099502-c8ee-4b1b-b7b9-047fcf39ab93\", \"MacPools\" : [ { \"EndMacAddress\" : \"00-15-5D-91-DF-FF\", \"StartMacAddress\" : \"00-15-5D-91-D0-00\" } ], \"MaxConcurrentEndpoints\" : 0, \"Name\" : \"DockerNAT\", \"Policies\" : [  ], \"Subnets\" : [ { \"AddressPrefix\" : \"172.28.112.0/20\" } ], \"TotalEndpoints\" : 0, \"Type\" : \"Private\", \"Version\" : 4294967297 } ]"
time="2017-05-05T17:37:10.610276900+02:00" level=debug msg="Network Response : [ { \"ComputedPolicies\" : [ { } ], \"CurrentEndpointCount\" : 0, \"ID\" : \"9d9c25ae-d3d3-459d-98e9-6964d10d2afa\", \"LayeredOn\" : \"9af0e1ff-6e10-4407-ac70-863ca084cd05\", \"MacPools\" : [ { \"EndMacAddress\" : \"00-15-5D-51-9F-FF\", \"StartMacAddress\" : \"00-15-5D-51-90-00\"} ], \"MaxConcurrentEndpoints\" : 4, \"NATName\" : \"H9d9c25ae-d3d3-459d-98e9-6964d10d2afa\", \"Name\" : \"nat\", \"Policies\" : [  ], \"Subnets\" : [ { \"AddressPrefix\" : \"172.24.240.0/20\", \"GatewayAddress\" : \"172.24.240.1\" } ], \"TotalEndpoints\" : 382, \"Type\" : \"nat\", \"Version\" : 4294967297 }, { \"ComputedPolicies\" : [ { } ], \"CurrentEndpointCount\" : 0, \"ID\" : \"b5099502-c8ee-4b1b-b7b9-047fcf39ab93\", \"MacPools\" : [ { \"EndMacAddress\" : \"00-15-5D-91-DF-FF\", \"StartMacAddress\" : \"00-15-5D-91-D0-00\" } ], \"MaxConcurrentEndpoints\" : 0, \"Name\" : \"DockerNAT\", \"Policies\" : [  ], \"Subnets\" : [ { \"AddressPrefix\" : \"172.28.112.0/20\" } ], \"TotalEndpoints\" : 0, \"Type\" : \"Private\", \"Version\" : 4294967297 } ]"
time="2017-05-05T17:37:10.619276000+02:00" level=debug msg="Launching DNS server for network%!(EXTRA string=none)"
time="2017-05-05T17:37:10.658783000+02:00" level=debug msg="releasing IPv4 pools from network nat (bb4d06d21abce02d89206d68b79aeee607ff06c04fd4c97a1399c24ed9e54a8f)"
time="2017-05-05T17:37:10.658783000+02:00" level=debug msg="ReleaseAddress(172.24.240.0/20, 172.24.240.1)"
time="2017-05-05T17:37:10.660782400+02:00" level=debug msg="ReleasePool(172.24.240.0/20)"
time="2017-05-05T17:37:10.735798400+02:00" level=debug msg="Allocating IPv4 pools for network nat (fd8c628d4287171b39a068ecd515189af8ea833a19e6645148975a6c9707ab8b)"
time="2017-05-05T17:37:10.735798400+02:00" level=debug msg="RequestPool(LocalDefault, 172.24.240.0/20, , map[], false)"
time="2017-05-05T17:37:10.737797400+02:00" level=debug msg="RequestAddress(172.24.240.0/20, 172.24.240.1, map[RequestAddressType:com.docker.network.gateway])"
time="2017-05-05T17:37:10.737797400+02:00" level=debug msg="Launching DNS server for network%!(EXTRA string=nat)"
time="2017-05-05T17:37:10.743793300+02:00" level=debug msg="Network Response : { \"ComputedPolicies\" : [ { } ], \"CurrentEndpointCount\" : 0, \"ID\" : \"9d9c25ae-d3d3-459d-98e9-6964d10d2afa\", \"LayeredOn\" : \"9af0e1ff-6e10-4407-ac70-863ca084cd05\", \"MacPools\" : [ { \"EndMacAddress\" : \"00-15-5D-51-9F-FF\", \"StartMacAddress\" : \"00-15-5D-51-90-00\" }], \"MaxConcurrentEndpoints\" : 4, \"NATName\" : \"H9d9c25ae-d3d3-459d-98e9-6964d10d2afa\", \"Name\" : \"nat\", \"Policies\" : [  ], \"Subnets\" : [ { \"AddressPrefix\" : \"172.24.240.0/20\", \"GatewayAddress\" : \"172.24.240.1\" } ], \"TotalEndpoints\" : 382, \"Type\" : \"nat\", \"Version\" : 4294967297 }"
time="2017-05-05T17:37:10.743793300+02:00" level=debug msg="Binding a resolver on network nat gateway 172.24.240.1"
time="2017-05-05T17:37:10.744793900+02:00" level=debug msg="Resolver bound successfully for network nat"
time="2017-05-05T17:37:10.818861000+02:00" level=warning msg="Unable to locate plugin: private, retrying in 1s"
time="2017-05-05T17:37:11.820618600+02:00" level=warning msg="Unable to locate plugin: private, retrying in 2s"
time="2017-05-05T17:37:13.822311800+02:00" level=warning msg="Unable to locate plugin: private, retrying in 4s"
time="2017-05-05T17:37:17.822518500+02:00" level=warning msg="Unable to locate plugin: private, retrying in 8s"
time="2017-05-05T17:37:25.822716800+02:00" level=error msg="Error occurred when creating network plugin not found"

Describe the results you expected:

HNS should not report this network, or as a workaround, Docker daemon should ignore "private" networks

Additional information you deem important (e.g. issue happens only occasionally):

My current docker version is a master one, but it also occurs on current Edge (and probably on stable as well)

Output of docker version:

Client:
 Version:      17.06.0-dev
 API version:  1.30
 Go version:   go1.7.5
 Git commit:   c43f06bae
 Built:        05/05/2017 13:42:33
 OS/Arch:      windows/amd64

Server:
 Version:      17.06.0-dev
 API version:  1.30 (minimum version 1.24)
 Go version:   go1.7.5
 Git commit:   c43f06bae
 Built:        05/05/2017 13:42:33
 OS/Arch:      windows/amd64
 Experimental: true

Output of docker info:

Containers: 0
 Running: 0
 Paused: 0
 Stopped: 0
Images: 20
Server Version: 17.06.0-dev
Storage Driver: windowsfilter
 Windows:
Logging Driver: json-file
Plugins:
 Volume: local
 Network: l2bridge l2tunnel nat null overlay transparent
 Log: awslogs etwlogs fluentd json-file logentries splunk syslog
Swarm: inactive
Default Isolation: hyperv
Kernel Version: 10.0 15063 (15063.0.amd64fre.rs2_release.170317-1834)
Operating System: Windows 10 Pro
OSType: windows
Architecture: x86_64
CPUs: 8
Total Memory: 15.83GiB
Name: SIMONXPS
ID: BDPW:YB3Q:MJ5J:VNQB:XXYJ:CCBA:FOFV:ISWJ:K6VN:4JOE:AY6Q:OOC5
Docker Root Dir: C:\ProgramData\Docker
Debug Mode (client): false
Debug Mode (server): true
 File Descriptors: -1
 Goroutines: 17
 System Time: 2017-05-05T17:52:11.0113253+02:00
 EventsListeners: 0
Username: simonferquel
Registry: https://index.docker.io/v1/
Experimental: true
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions