Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create container failed #2462

Closed
hmtai opened this issue Jul 13, 2018 · 3 comments
Closed

Create container failed #2462

hmtai opened this issue Jul 13, 2018 · 3 comments

Comments

@hmtai
Copy link

hmtai commented Jul 13, 2018

When I create containers with containerd,it can't create container.

# crictl runp my-sandbox.yaml
f2b4bb08874a84cf69d80521a509727b15d1df6bb047daf09175226dcef05095
# crictl create f2b4bb08874a84cf69d80521a509727b15d1df6bb047daf09175226dcef05095 my-containerd.yaml my-sandbox.yaml

Debug info:

# containerd -l debug
containerd: unmounting temp mounts: failed to unmount target /var/lib/containerd/tmpmounts/containerd-mount980710714: device or resource busy

The OS info

# cat /etc/*release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04.4 LTS"
NAME="Ubuntu"
VERSION="16.04.4 LTS (Xenial Xerus)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 16.04.4 LTS"
VERSION_ID="16.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
VERSION_CODENAME=xenial
UBUNTU_CODENAME=xenial

# cat /proc/version
Linux version 4.4.0-36-generic (buildd@lcy01-01) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.2) ) #55-Ubuntu SMP Thu Aug 11 18:01:55 UTC 2016

contaienrd version

# crictl version
Version:  0.1.0
RuntimeName:  containerd
RuntimeVersion:  v1.1.0
RuntimeApiVersion:  v1alpha2

containerd --version
containerd github.com/containerd/containerd v1.1.0 209a7fc
@crosbymichael crosbymichael mentioned this issue Jul 13, 2018
Merged
@crosbymichael
Copy link
Member

Is there anything in the containerd logs that would signal that an error happened or something was stuck?

crosbymichael added a commit to crosbymichael/containerd that referenced this issue Jul 13, 2018
@crosbymichael
Don't prevent boot on temp cleanup
0105959 
Fixes containerd#2462
Fixes containerd#2455

Signed-off-by: Michael Crosby <[email protected]>
@hmtai
Copy link
Author

hmtai commented Jul 16, 2018 •
edited
Loading

@crosbymichael some logs for containerd but there is no error:

journalctl -u containerd -l
Jul 16 01:33:27 mjli containerd[2521]: time="2018-07-16T01:33:27Z" level=info msg="RunPodSandbox with config &PodSandboxConfig{Metadata:&PodSandboxMetadata{Name:kubelet-sandbox,Uid:hdishd83djdsssfd
Jul 16 01:33:27 mjli containerd[2521]: time="2018-07-16T01:33:27Z" level=info msg="shim containerd-shim started" address="/containerd-shim/k8s.io/751eae226d1b59cefdfaceea4e3154ee20d27e6fc4dec8d1862
Jul 16 01:33:28 mjli containerd[2521]: time="2018-07-16T01:33:28Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kubelet-sandbox,Uid:hdishd83djdsssfdsfsdfs,Namespace:default,Attempt:1,
Jul 16 01:33:50 mjli containerd[2521]: time="2018-07-16T01:33:50Z" level=info msg="CreateContainer within sandbox "751eae226d1b59cefdfaceea4e3154ee20d27e6fc4dec8d186280b66eb5fee5b" with container c

When I restart containerd,it can't start now,the logs:

Jul 16 01:45:26 mjli containerd[17924]: containerd: unmounting temp mounts: failed to unmount target /var/lib/containerd/tmpmounts/containerd-mount980710714: device or resource busy
Jul 16 01:45:26 mjli systemd[1]: containerd.service: Main process exited, code=exited, status=1/FAILURE
Jul 16 01:45:26 mjli systemd[1]: containerd.service: Unit entered failed state.
Jul 16 01:45:26 mjli systemd[1]: containerd.service: Failed with result 'exit-code'.
Jul 16 01:45:31 mjli systemd[1]: containerd.service: Service hold-off time over, scheduling restart.
Jul 16 01:45:31 mjli systemd[1]: Stopped containerd container runtime.
Jul 16 01:45:31 mjli systemd[1]: Starting containerd container runtime...
Jul 16 01:45:31 mjli systemd[1]: Started containerd container runtime.
Jul 16 01:45:34 mjli containerd[18018]: containerd: unmounting temp mounts: failed to unmount target /var/lib/containerd/tmpmounts/containerd-mount980710714: device or resource busy
Jul 16 01:45:34 mjli systemd[1]: containerd.service: Main process exited, code=exited, status=1/FAILURE
Jul 16 01:45:34 mjli systemd[1]: containerd.service: Unit entered failed state.
Jul 16 01:45:34 mjli systemd[1]: containerd.service: Failed with result 'exit-code'.
Jul 16 01:45:39 mjli systemd[1]: containerd.service: Service hold-off time over, scheduling restart.
Jul 16 01:45:39 mjli systemd[1]: Stopped containerd container runtime.
Jul 16 01:45:39 mjli systemd[1]: Starting containerd container runtime...
Jul 16 01:45:39 mjli systemd[1]: Started containerd container runtime.
Jul 16 01:45:41 mjli containerd[18044]: containerd: unmounting temp mounts: failed to unmount target /var/lib/containerd/tmpmounts/containerd-mount980710714: device or resource busy
Jul 16 01:45:41 mjli systemd[1]: containerd.service: Main process exited, code=exited, status=1/FAILURE
Jul 16 01:45:41 mjli systemd[1]: containerd.service: Unit entered failed state.
Jul 16 01:45:41 mjli systemd[1]: containerd.service: Failed with result 'exit-code'.
Jul 16 01:45:47 mjli systemd[1]: containerd.service: Service hold-off time over, scheduling restart.
Jul 16 01:45:47 mjli systemd[1]: Stopped containerd container runtime.
Jul 16 01:45:47 mjli systemd[1]: Starting containerd container runtime...
Jul 16 01:45:47 mjli systemd[1]: Started containerd container runtime.
Jul 16 01:45:49 mjli containerd[18065]: containerd: unmounting temp mounts: failed to unmount target /var/lib/containerd/tmpmounts/containerd-mount980710714: device or resource busy
Jul 16 01:45:49 mjli systemd[1]: containerd.service: Main process exited, code=exited, status=1/FAILURE
Jul 16 01:45:49 mjli systemd[1]: containerd.service: Unit entered failed state.
Jul 16 01:45:49 mjli systemd[1]: containerd.service: Failed with result 'exit-code'.
Jul 16 01:45:54 mjli systemd[1]: containerd.service: Service hold-off time over, scheduling restart.

@hmtai
Copy link
Author

hmtai commented Jul 16, 2018

When I reboot my host,containerd can run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@crosbymichael @hmtai