Skip to content

[Debian] Rootless Docker 20.10.6 overlay2 error: ApplyLayer exit status 1 stdout #42302

Description

@gymnae

<EDIT> (by @AkihiroSuda)

Workaround: use fuse-overlayfs

curl -o $HOME/bin/fuse-overlayfs -fsSL https://github.com/containers/fuse-overlayfs/releases/download/v1.4.0/fuse-overlayfs-$(uname -m)

chmod +x $HOME/bin/fuse-overlayfs

echo '{"storage-driver": "fuse-overlayfs"}' > ~/.config/docker/daemon.json

systemctl --user restart docker

</EDIT>


Description

Even with #42188 in place, I'm facing issues with overlay2 fs driver in a docker rootless environment

Steps to reproduce the issue:

  1. Install docker rootless via package management - in my case debian 10
  2. $ docker pull ghost:latest
  3. See error: failed to register layer: ApplyLayer exit status 1 stdout: stderr: unlinkat /tmp/v8-compile-cache-0/8.4.371.19-node.18: input/output error

Describe the results you received:

Every time I try, I receive the error describe above:
failed to register layer: ApplyLayer exit status 1 stdout: stderr: unlinkat /tmp/v8-compile-cache-0/8.4.371.19-node.18: input/output error

Describe the results you expected:
Pulling and extracting the image without error

Additional information you deem important (e.g. issue happens only occasionally):
Issue is reproducable with fs overlay2 it does not appear with fs fuse-overlayfs

Output of docker version:

Docker version 20.10.6

Output of docker info:

Client:
 Context:    default
 Debug Mode: false
 Plugins:
  app: Docker App (Docker Inc., v0.9.1-beta3)
  buildx: Build with BuildKit (Docker Inc., v0.5.1-docker)

Server:
 Containers: 8
  Running: 8
  Paused: 0
  Stopped: 0
 Images: 18
 Server Version: 20.10.6
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: false
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: none
 Cgroup Version: 1
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 05f951a3781f4f2c1911b05e61c160e9c30eaa8e
 runc version: 12644e614e25b05da6fd08a38ffa0cfe1903fdec
 init version: de40ad0
 Security Options:
  seccomp
   Profile: default
  rootless
 Kernel Version: 5.10.0-0.bpo.4-amd64
 Operating System: Debian GNU/Linux 10 (buster) (error determining if containerized)
 OSType: linux
 Architecture: x86_64
 CPUs: 10
 Total Memory: 9.728GiB
 Name: <hostname>
 ID: Y5Z7:5PCZ:P5VR:DQFO:JJDD:RAC3:X4BR:CQ4U:4LTE:KFTO:HAET:IWCA
 Docker Root Dir: /home/<username>/.local/share/docker
 Debug Mode: false
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

Additional environment details (AWS, VirtualBox, physical, etc.):
Running on a Debian 10 VPS with kernel 5.10 from back ports, host OS unknown

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions