Skip to content

Failed to pull images in rootless mode with overlayfs: "createDirWithOverlayOpaque(...) ... input/output error" #1055

@zhsj

Description

@zhsj
  • This is a bug report
  • This is a feature request
  • I searched existing issues before opening this one

Expected behavior

docker pull tianon/qemu:4.2.0 runs without error.

Actual behavior

docker pull tianon/qemu:4.2.0
4.2.0: Pulling from tianon/qemu
8559a31e96f4: Pull complete 
d0a08dac0f9e: Extracting [==================================================>]  2.649MB/2.649MB
3d5d935425ee: Download complete 
28e8494117e5: Download complete 
7efb9a3b2392: Download complete 
failed to register layer: Error processing tar file(exit status 1): replaceDirWithOverlayOpaque("/usr/share/OVMF") failed: createDirWithOverlayOpaque("/usr/share/rdwoo592232176") failed: failed to mkdir /usr/share/rdwoo592232176/m/d: mkdir /usr/share/rdwoo592232176/m/d: input/output error

Steps to reproduce the behavior

Output of docker version:

Client: Docker Engine - Community
 Version:           19.03.12
 API version:       1.40
 Go version:        go1.13.10
 Git commit:        48a66213fe
 Built:             Mon Jun 22 15:45:50 2020
 OS/Arch:           linux/amd64
 Experimental:      false

Server: Docker Engine - Community
 Engine:
  Version:          19.03.12
  API version:      1.40 (minimum version 1.12)
  Go version:       go1.13.10
  Git commit:       48a66213fe
  Built:            Mon Jun 22 15:49:35 2020
  OS/Arch:          linux/amd64
  Experimental:     true
 containerd:
  Version:          v1.2.13
  GitCommit:        7ad184331fa3e55e52b890ea95e65ba581ae3429
 runc:
  Version:          1.0.0-rc10
  GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
 docker-init:
  Version:          0.18.0
  GitCommit:        fec3683

Output of docker info:

Client:
 Debug Mode: false

Server:
 Containers: 0
  Running: 0
  Paused: 0
  Stopped: 0
 Images: 1
 Server Version: 19.03.12
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: false
 Logging Driver: json-file
 Cgroup Driver: none
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 7ad184331fa3e55e52b890ea95e65ba581ae3429
 runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
 init version: fec3683
 Security Options:
  seccomp
   Profile: default
  rootless
 Kernel Version: 5.6.0-2-amd64
 Operating System: Debian GNU/Linux bullseye/sid
 OSType: linux
 Architecture: x86_64
 CPUs: 4
 Total Memory: 23.44GiB
 Name: zhsj-debian
 ID: 6LCF:LYQ4:NBWK:PDSU:CKAN:MS6T:4KPX:DVSS:CI2H:OB64:FY3L:MLA7
 Docker Root Dir: /home/zhsj/.local/share/docker
 Debug Mode: false
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: true
 Insecure Registries:
  127.0.0.0/8
 Registry Mirrors:
  https://reg-mirror.qiniu.com/
 Live Restore Enabled: false
 Product License: Community Engine

WARNING: No swap limit support

Additional environment details (AWS, VirtualBox, physical, etc.)

This is on Debian/testing. With overlay in userns enabled.

$ cat /sys/module/overlay/parameters/permit_mounts_in_userns 
Y

dockerd started with dockerd-rootless.sh --experimental --storage-driver=overlay2

I can pull some base images like debian:buster.

Workaround: use fuse-overlayfs

curl -o $HOME/bin/fuse-overlayfs -fsSL https://github.com/containers/fuse-overlayfs/releases/download/v1.4.0/fuse-overlayfs-$(uname -m)

chmod +x $HOME/bin/fuse-overlayfs

echo '{"storage-driver": "fuse-overlayfs"}' > ~/.config/docker/daemon.json

systemctl --user restart docker

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions