mnt: Can't remove the directory ... Device or resource busy #1778
Comments
|
Cc: @Snorch |
|
Could you show content of /proc/self/mountinfo from the container? |
[container]# cat /proc/self/mountinfo |
|
Another problem is that I find there are a lot of directories mounted that I can't umount or delete. none on /export/sine/dump/.criu.cgyard.JERpQV type tmpfs (rw,relatime) I tried to umount... |
|
On restore, you use --external mnt[xxx]:yyy incorrectly. yyy should point on a host directory that will be bind-mounted into a container. For example, mydbmount has to be annotated like this mnt[mydbmount]:[host path to /Logs/mydb]. |
You need to find what process holds them.
umount -l /export/sine/dump/.criu.cgyard.JERpQV/ should work. |
I agree with @avagin. The error "Error (criu/mount.c:2324): mnt: Can't mount at /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb: No such file or directory" happens when bind-mounting the external mount source ("/var/log/mydb") provided to criu in options. And it is caused by the absence of this source path on host. Please read how external mounts work and in which cases they are applicable here https://criu.org/External_bind_mounts |
Oh yes! You are all right, thank you very much! I followed your clues to solve all the problems. @Snorch @avagin |
|
Excuse me, I also encountered the same problem when using runc for checkpoint/restore. How should I solve it? |
Hello, everyone
I have a problem with a restore failure related to mount namespace.
I dumped the init process of a container on the host, the dump command is as follows:
./criu dump --ghost-limit=500M -D /export/sine/dump -j -R -t 15643 --tcp-close --skip-in-flight --external mnt[/etc/hosts]:hostsmount --external mnt[/etc/hostname]:hostnamemount --external mnt[/etc/resolv.conf]:reslovemount --external mnt[/var/log/mydb]:mydbmount -v4 -o /export/sine/sinedump.log
The pid(15643) is a init process of a container, Using the docker command, you can see the following information:
[host]# docker top abf103e20085e
UID PID PPID C STIME TTY TIME CMD
root 10486 15643 0 Mar15 ? 00:00:00 ./test
root 15643 21537 0 2021 ? 01:58:31 /opt/mydb/server
[host]# docker exec -it abf103e20085e ps -ef
UID PID PPID C STIME TTY TIME CMD
root 1 0 0 2021 ? 01:58:31 /opt/mydb/server
root 139 1 0 Mar15 ? 00:00:00 ./test
root 436 0 0 15:10 ? 00:00:00 ps -ef
I used the --external option because there are several mount points in the container that cause dump to fail：
Error (criu/mount.c:663): mnt: 239:./etc/hosts doesn't have a proper root mount
tips: the mount info of the container is as follows:
[container]# mount
/dev/sda5 on / type xfs (rw,relatime,attr2,inode64,logbsize=256k,sunit=512,swidth=1536,noquota)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev type tmpfs (rw,nosuid,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=666)
shm on /dev/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=65536k)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
sysfs on /sys type sysfs (ro,nosuid,nodev,noexec,relatime)
tmpfs on /run/secrets type tmpfs (rw,nosuid,nodev,noexec,relatime)
/dev/sda5 on /var/log/mydb type xfs (rw,relatime,attr2,inode64,logbsize=256k,sunit=512,swidth=1536,noquota)
/dev/sda5 on /etc/resolv.conf type xfs (rw,relatime,attr2,inode64,logbsize=256k,sunit=512,swidth=1536,noquota)
/dev/sda5 on /etc/hostname type xfs (rw,relatime,attr2,inode64,logbsize=256k,sunit=512,swidth=1536,noquota)
/dev/sda5 on /etc/hosts type xfs (rw,relatime,attr2,inode64,logbsize=256k,sunit=512,swidth=1536,noquota)
proc on /proc/bus type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/fs type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/irq type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/sys type proc (ro,nosuid,nodev,noexec,relatime)
proc on /proc/sysrq-trigger type proc (ro,nosuid,nodev,noexec,relatime)
tmpfs on /proc/kcore type tmpfs (rw,nosuid,mode=755)
tmpfs on /proc/timer_stats type tmpfs (rw,nosuid,mode=755)
When I successfully dump, I run restore tests on the original host, the restore cmd is as follows:
./criu restore --ghost-limit=500M -D /export/sine/dump -j -d --tcp-close --external mnt[hostsmount]:/etc/hosts --external mnt[hostnamemount]:/etc/hostname --external mnt[reslovemount]:/etc/resolv.conf --external mnt[mydbmount]:/var/log/mydb -v4 -o /export/sine/sinerestore.log
An error was reported after the restore command was executed.
Error (criu/mount.c:2538): mnt: The --root option is required to restore a mount namespace
So I added the --root option and re-executed the restore command：
mkdir -p /export/sine/tmproot
./criu restore --ghost-limit=500M -D /export/sine/dump -j -d --tcp-close --root /export/sine/tmproot --external mnt[hostsmount]:/etc/hosts --external mnt[hostnamemount]:/etc/hostname --external mnt[reslovemount]:/etc/resolv.conf --external mnt[mydbmount]:/var/log/mydb -v4 -o /export/sine/sinerestore.log
But a new error has emerged：
Error (criu/mount.c:2324): mnt: Can't mount at /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb: No such file or directory
Error (criu/mount.c:2582): mnt: Unable to statfs /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb: No such file or directory
Error (criu/mount.c:3396): mnt: Can't remove the directory /tmp/.criu.mntns.0YG63d: Device or resource busy
So please help see if there is a solution to this problem.
CRIU logs and information:
(00.000000) Will drop all TCP connections on restore
(00.000067) Version: 3.15 (gitid a6e65a23)
(00.000081) Running on Linux 3.10.0-327.28.3.el7.x86_64 #1 SMP Thu Aug 18 19:05:49 UTC 2016 x86_64
...
(00.000476) Add a helper 106 for restoring SID 106
(00.000478) Attach 139 to the temporary task 106
(00.000509) Collecting 50/56 (flags 3)
(00.000519) No memfd.img image
(00.000522)
- ... done (00.000527) Collecting 40/54 (flags 2) (00.000552) Collected [opt/mydb/server] ID 0x1 (00.000558) Collected [usr/lib64/libfreebl3.so] ID 0x2 (00.000562) Collected [usr/lib64/liblzma.so.5.0.99] ID 0x3 (00.000566) Collected [usr/lib64/libpcre.so.1.2.0] ID 0x4 (00.000579) Collected [usr/lib64/libcrypt-2.17.so] ID 0x5 (00.000587) Collected [usr/lib64/libselinux.so.1] ID 0x6 (00.000591) Collected [usr/lib64/libsasl2.so.3.0.0] ID 0x7 (00.000594) Collected [usr/lib64/libresolv-2.17.so] ID 0x8 (00.000598) Collected [usr/lib64/libkeyutils.so.1.5] ID 0x9 (00.000602) Collected [usr/lib64/libkrb5support.so.0.1] ID 0xa (00.000606) Collected [usr/lib64/librt-2.17.so] ID 0xb (00.000609) Collected [usr/lib64/libcrypto.so.1.0.1e] ID 0xc (00.000613) Collected [usr/lib64/libssl.so.1.0.1e] ID 0xd (00.000622) Collected [usr/lib64/libz.so.1.2.7] ID 0xe (00.000626) Collected [usr/lib64/libldap-2.4.so.2.10.2] ID 0xf (00.000630) Collected [usr/lib64/liblber-2.4.so.2.10.2] ID 0x10 (00.000634) Collected [usr/lib64/libcom_err.so.2.1] ID 0x11 (00.000637) Collected [usr/lib64/libk5crypto.so.3.1] ID 0x12 (00.000641) Collected [usr/lib64/libkrb5.so.3.3] ID 0x13 (00.000645) Collected [usr/lib64/libgssapi_krb5.so.2.2] ID 0x14 (00.000649) Collected [usr/lib64/libnspr4.so] ID 0x15 (00.000652) Collected [usr/lib64/libplc4.so] ID 0x16 (00.000659) Collected [usr/lib64/libplds4.so] ID 0x17 (00.000663) Collected [usr/lib64/libnssutil3.so] ID 0x18 (00.000667) Collected [usr/lib64/libnss3.so] ID 0x19 (00.000671) Collected [usr/lib64/libsmime3.so] ID 0x1a (00.000675) Collected [usr/lib64/libssl3.so] ID 0x1b (00.000683) Collected [usr/lib64/libssh2.so.1.0.1] ID 0x1c (00.000687) Collected [usr/lib64/libidn.so.11.6.11] ID 0x1d (00.000691) Collected [usr/lib64/libc-2.17.so] ID 0x1e (00.000698) Collected [usr/lib64/libpthread-2.17.so] ID 0x1f (00.000702) Collected [usr/lib64/libdl-2.17.so] ID 0x20 (00.000706) Collected [usr/lib64/libcurl.so.4.3.0] ID 0x21 (00.000709) Collected [usr/lib64/libm-2.17.so] ID 0x22 (00.000713) Collected [usr/lib64/ld-2.17.so] ID 0x23 (00.000717) Collected [dev/null] ID 0x24 (00.000720) Collected [var/log/mydb/6624.log] ID 0x25 (00.000734) epoll: Collected eventpoll: id 0x000026 flags 0x02 (00.000746) epoll: Collected eventpoll: id 0x000027 flags 0x02 (00.000810) Collected [opt/mydb/data] ID 0x32 (00.000814) Collected [.] ID 0x33 (00.000818) Collected [opt/mydb/test] ID 0x34 (00.000821) Collected [dev/null] ID 0x35 (00.000824) Collected [opt/mydb/nohup.out] ID 0x36 (00.000828) Collected [opt/mydb] ID 0x37 (00.000832)- ... done(00.000836) Collecting 46/67 (flags 0)
(00.000840) No remap-fpath.img image
(00.000842)
- ... done (00.000845) Collecting 56/50 (flags 0) (00.000849) No binfmt-misc.img image (00.000851)- ... done(00.001035) cg: Preparing cgroups yard (cgroups restore mode 0x4)
(00.001303) cg: Opening .criu.cgyard.Q7fKZY as cg yard
(00.001317) cg: Making controller dir .criu.cgyard.Q7fKZY/memory (memory)
(00.001437) cg: Determined cgroup dir memory/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope already exist
(00.001440) cg: Skip restoring properties on cgroup dir memory/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope
(00.001453) cg: Making controller dir .criu.cgyard.Q7fKZY/devices (devices)
(00.001553) cg: Determined cgroup dir devices/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope already exist
(00.001556) cg: Skip restoring properties on cgroup dir devices/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope
(00.001564) cg: Making controller dir .criu.cgyard.Q7fKZY/freezer (freezer)
(00.001678) cg: Determined cgroup dir freezer/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope already exist
(00.001683) cg: Skip restoring properties on cgroup dir freezer/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope
(00.001692) cg: Making controller dir .criu.cgyard.Q7fKZY/blkio (blkio)
(00.001795) cg: Determined cgroup dir blkio/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope already exist
(00.001797) cg: Skip restoring properties on cgroup dir blkio/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope
(00.001805) cg: Making controller dir .criu.cgyard.Q7fKZY/net_cls (net_cls)
(00.001903) cg: Determined cgroup dir net_cls/ already exist
(00.001905) cg: Skip restoring properties on cgroup dir net_cls/
(00.001913) cg: Determined cgroup dir net_cls//plugin150 already exist
(00.001915) cg: Skip restoring properties on cgroup dir net_cls//plugin150
(00.001921) cg: Determined cgroup dir net_cls//tiger1 already exist
(00.001923) cg: Skip restoring properties on cgroup dir net_cls//tiger1
(00.001930) cg: Making controller dir .criu.cgyard.Q7fKZY/hugetlb (hugetlb)
(00.002030) cg: Determined cgroup dir hugetlb/ already exist
(00.002032) cg: Skip restoring properties on cgroup dir hugetlb/
(00.002039) cg: Determined cgroup dir hugetlb//plugin150 already exist
(00.002041) cg: Skip restoring properties on cgroup dir hugetlb//plugin150
(00.002048) cg: Determined cgroup dir hugetlb//tiger1 already exist
(00.002050) cg: Skip restoring properties on cgroup dir hugetlb//tiger1
(00.002057) cg: Making controller dir .criu.cgyard.Q7fKZY/cpuset (cpuset)
(00.002163) cg: Determined cgroup dir cpuset/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope already exist
(00.002165) cg: Skip restoring properties on cgroup dir cpuset/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope
(00.002175) cg: Making controller dir .criu.cgyard.Q7fKZY/cpuacct,cpu (cpuacct,cpu)
(00.002275) cg: Determined cgroup dir cpuacct,cpu/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope already exist
(00.002277) cg: Skip restoring properties on cgroup dir cpuacct,cpu/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope
(00.002285) cg: Making controller dir .criu.cgyard.Q7fKZY/perf_event (perf_event)
(00.002387) cg: Determined cgroup dir perf_event/ already exist
(00.002389) cg: Skip restoring properties on cgroup dir perf_event/
(00.002396) cg: Determined cgroup dir perf_event//plugin150 already exist
(00.002398) cg: Skip restoring properties on cgroup dir perf_event//plugin150
(00.002405) cg: Determined cgroup dir perf_event//tiger1 already exist
(00.002407) cg: Skip restoring properties on cgroup dir perf_event//tiger1
(00.002415) cg: Making controller dir .criu.cgyard.Q7fKZY/systemd (none,name=systemd)
(00.005420) cg: Determined cgroup dir systemd/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope already exist
(00.005433) cg: Skip restoring properties on cgroup dir systemd/system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope
(00.005442) cg: Determined cgroup dir systemd/system.slice/docker.service already exist
(00.005444) cg: Skip restoring properties on cgroup dir systemd/system.slice/docker.service
(00.005465) Running pre-restore scripts, scripts_mode = 0
(00.011282) mnt: Reading mountpoint images (id 12 pid 1)
(00.011298) mnt: Will mount 168 from /null
(00.011303) mnt: Will mount 168 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/timer_stats
(00.011305) mnt: Read 168 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/timer_stats
(00.011309) mnt: Will mount 167 from /null
(00.011311) mnt: Will mount 167 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/kcore
(00.011313) mnt: Read 167 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/kcore
(00.011317) mnt: Will mount 165 from /sysrq-trigger
(00.011319) mnt: Will mount 165 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/sysrq-trigger
(00.011321) mnt: Read 165 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/sysrq-trigger
(00.011324) mnt: Will mount 164 from /sys
(00.011327) mnt: Will mount 164 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/sys
(00.011328) mnt: Read 164 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/sys
(00.011332) mnt: Will mount 163 from /irq
(00.011334) mnt: Will mount 163 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/irq
(00.011336) mnt: Read 163 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/irq
(00.011339) mnt: Will mount 162 from /fs
(00.011341) mnt: Will mount 162 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/fs
(00.011343) mnt: Read 162 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/fs
(00.011347) mnt: Will mount 161 from /bus
(00.011349) mnt: Will mount 161 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/bus
(00.011351) mnt: Read 161 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc/bus
(00.011362) mnt: Will mount 239 from /etc/hosts (E)
(00.011364) mnt: Will mount 239 @ /tmp/.criu.mntns.0YG63d/12-0000000000/etc/hosts
(00.011366) mnt: Read 239 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/etc/hosts
(00.011372) mnt: Will mount 238 from /etc/hostname (E)
(00.011374) mnt: Will mount 238 @ /tmp/.criu.mntns.0YG63d/12-0000000000/etc/hostname
(00.011376) mnt: Read 238 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/etc/hostname
(00.011380) mnt: Will mount 237 from /etc/resolv.conf (E)
(00.011382) mnt: Will mount 237 @ /tmp/.criu.mntns.0YG63d/12-0000000000/etc/resolv.conf
(00.011384) mnt: Read 237 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/etc/resolv.conf
(00.011392) mnt: Will mount 236 from /var/log/mydb (E)
(00.011395) mnt: Will mount 236 @ /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb
(00.011397) mnt: Read 236 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb
(00.011400) mnt: Will mount 235 from /
(00.011402) mnt: Will mount 235 @ /tmp/.criu.mntns.0YG63d/12-0000000000/run/secrets
(00.011404) mnt: Read 235 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/run/secrets
(00.011408) mnt: Will mount 234 from /
(00.011410) mnt: Will mount 234 @ /tmp/.criu.mntns.0YG63d/12-0000000000/sys
(00.011412) mnt: Read 234 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/sys
(00.011415) mnt: Will mount 233 from /
(00.011417) mnt: Will mount 233 @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev/mqueue
(00.011419) mnt: Read 233 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev/mqueue
(00.011423) mnt: Will mount 232 from /
(00.011425) mnt: Will mount 232 @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev/shm
(00.011427) mnt: Read 232 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev/shm
(00.011434) mnt: Will mount 231 from /
(00.011436) mnt: Will mount 231 @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev/pts
(00.011438) mnt: Read 231 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev/pts
(00.011441) mnt: Will mount 230 from /
(00.011443) mnt: Will mount 230 @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev
(00.011445) mnt: Read 230 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/dev
(00.011449) mnt: Will mount 229 from /
(00.011457) mnt: Will mount 229 @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc
(00.011459) mnt: Read 229 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/proc
(00.011463) mnt: Will mount 228 from /Data/docker/vfs/dir/abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c
(00.011465) mnt: Will mount 228 @ /tmp/.criu.mntns.0YG63d/12-0000000000/
(00.011467) mnt: Read 228 mp @ /tmp/.criu.mntns.0YG63d/12-0000000000/
(00.011472) mnt: Building mountpoints tree
(00.011475) mnt: Building plain mount tree
(00.011477) mnt: Working on 228->151
(00.011479) mnt: Working on 229->228
(00.011481) mnt: Working on 230->228
(00.011483) mnt: Working on 231->230
(00.011485) mnt: Working on 232->230
(00.011487) mnt: Working on 233->230
(00.011489) mnt: Working on 234->228
(00.011491) mnt: Working on 235->228
(00.011492) mnt: Working on 236->228
(00.011494) mnt: Working on 237->228
(00.011496) mnt: Working on 238->228
(00.011498) mnt: Working on 239->228
(00.011500) mnt: Working on 161->229
(00.011502) mnt: Working on 162->229
(00.011503) mnt: Working on 163->229
(00.011505) mnt: Working on 164->229
(00.011507) mnt: Working on 165->229
(00.011509) mnt: Working on 167->229
(00.011511) mnt: Working on 168->229
(00.011513) mnt: Resorting children of 228 in mount order
(00.011517) mnt: Resorting children of 236 in mount order
(00.011519) mnt: Resorting children of 235 in mount order
(00.011521) mnt: Resorting children of 237 in mount order
(00.011523) mnt: Resorting children of 238 in mount order
(00.011524) mnt: Resorting children of 239 in mount order
(00.011526) mnt: Resorting children of 229 in mount order
(00.011530) mnt: Resorting children of 161 in mount order
(00.011532) mnt: Resorting children of 162 in mount order
(00.011534) mnt: Resorting children of 163 in mount order
(00.011536) mnt: Resorting children of 164 in mount order
(00.011537) mnt: Resorting children of 165 in mount order
(00.011539) mnt: Resorting children of 167 in mount order
(00.011541) mnt: Resorting children of 168 in mount order
(00.011543) mnt: Resorting children of 230 in mount order
(00.011545) mnt: Resorting children of 231 in mount order
(00.011547) mnt: Resorting children of 232 in mount order
(00.011549) mnt: Resorting children of 233 in mount order
(00.011550) mnt: Resorting children of 234 in mount order
(00.011552) mnt: Done:
(00.011554) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/
(00.011556) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb
(00.011559) mnt: <--
(00.011560) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/run/secrets
(00.011563) mnt: <--
(00.011564) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/etc/resolv.conf
(00.011566) mnt: <--
(00.011568) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/etc/hostname
(00.011570) mnt: <--
(00.011580) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/etc/hosts
(00.011584) mnt: <--
(00.011586) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc
(00.011588) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc/bus
(00.011590) mnt: <--
(00.011592) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc/fs
(00.011594) mnt: <--
(00.011595) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc/irq
(00.011597) mnt: <--
(00.011599) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc/sys
(00.011601) mnt: <--
(00.011603) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc/sysrq-trigger
(00.011605) mnt: <--
(00.011607) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc/kcore
(00.011609) mnt: <--
(00.011611) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/proc/timer_stats
(00.011613) mnt: <--
(00.011614) mnt: <--
(00.011616) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/dev
(00.011618) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/dev/pts
(00.011620) mnt: <--
(00.011622) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/dev/shm
(00.011624) mnt: <--
(00.011630) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/dev/mqueue
(00.011633) mnt: <--
(00.011634) mnt: <--
(00.011636) mnt: /tmp/.criu.mntns.0YG63d/12-0000000000/sys
(00.011638) mnt: <--
(00.011640) mnt: <--
(00.011647) No pidns-9.img image
(00.011751) Forking task with 1 pid (flags 0x2c020000)
(00.012533) PID: real 16992 virt 1
(00.018299) Wait until namespaces are created
(00.018306) Running setup-namespaces scripts, scripts_mode = 0
(00.018367) 1: cg: Move into 2
(00.018402) 1: cg:
-> blkio//system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope/cgroup.procs (00.018436) 1: cg:-> cpuacct,cpu//system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope/cgroup.procs(00.018456) 1: cg:
-> cpuset//system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope/cgroup.procs (00.018475) 1: cg:-> devices//system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope/cgroup.procs(00.018488) 1: cg:
-> freezer//system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope/cgroup.procs (00.018500) 1: cg:-> hugetlb///cgroup.procs(00.018509) 1: cg:
-> memory//system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope/cgroup.procs (00.018524) 1: cg:-> systemd//system.slice/docker-abf103e20085e180c13cf82e303872c8d2b8789fdd3ae965d99786b1aa2e7d8c.scope/cgroup.procs(00.018537) 1: cg:
-> net_cls///cgroup.procs (00.018545) 1: cg:-> perf_event///cgroup.procs(00.018554) 1: Calling restore_sid() for init
(00.018559) 1: Restoring 1 to 1 sid
(00.018866) 1: Mount procfs in /tmp/crtools-proc.rEXx9s
(00.019028) 1: Collecting 44/37 (flags 2)
(00.019049) 1: No tty-info.img image
(00.019056) 1:
- ... done (00.019058) 1: Collecting 45/51 (flags 0) (00.019062) 1: No tty-data.img image (00.019067) 1:- ... done(00.019069) 1: Restoring namespaces 1 flags 0x2c020000
(00.019419) 1: kernel/hostname nr 33
(00.019489) 1: kernel/domainname nr 6
(00.019854) 1: Restoring IPC namespace
(00.019869) 1: Restoring IPC variables
(00.020639) 1: Restoring IPC shared memory
(00.020659) 1: No ipcns-shm-10.img image
(00.020665) 1: Restoring IPC message queues
(00.020669) 1: No ipcns-msg-10.img image
(00.020671) 1: Restoring IPC semaphores sets
(00.020677) 1: No ipcns-sem-10.img image
(00.020682) 1: mnt: Restoring mount namespace
(00.020697) 1: mnt: Mountpoint 228 (@/tmp/.criu.mntns.0YG63d/12-0000000000/) moved to the root yard
(00.020701) 1: mnt: Inspecting sharing on 228 shared_id 0 master_id -1 (@/tmp/.criu.mntns.0YG63d/12-0000000000/)
(00.020711) 1: mnt: The mount 236 is bind for 228 (@/tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb -> @/tmp/.criu.mntns.0YG63d/12-0000000000/)
(00.020714) 1: mnt: The mount 237 is bind for 228 (@/tmp/.criu.mntns.0YG63d/12-0000000000/etc/resolv.conf -> @/tmp/.criu.mntns.0YG63d/12-0000000000/)
(00.020717) 1: mnt: The mount 238 is bind for 228 (@/tmp/.criu.mntns.0YG63d/12-0000000000/etc/hostname -> @/tmp/.criu.mntns.0YG63d/12-0000000000/)
(00.020720) 1: mnt: The mount 239 is bind for 228 (@/tmp/.criu.mntns.0YG63d/12-0000000000/etc/hosts -> @/tmp/.criu.mntns.0YG63d/12-0000000000/)
(00.020723) 1: mnt: Inspecting sharing on 229 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc)
(00.020728) 1: mnt: The mount 161 is bind for 229 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/bus -> @/tmp/.criu.mntns.0YG63d/12-0000000000/proc)
(00.020731) 1: mnt: The mount 162 is bind for 229 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/fs -> @/tmp/.criu.mntns.0YG63d/12-0000000000/proc)
(00.020738) 1: mnt: The mount 163 is bind for 229 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/irq -> @/tmp/.criu.mntns.0YG63d/12-0000000000/proc)
(00.020740) 1: mnt: The mount 164 is bind for 229 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/sys -> @/tmp/.criu.mntns.0YG63d/12-0000000000/proc)
(00.020755) 1: mnt: The mount 165 is bind for 229 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/sysrq-trigger -> @/tmp/.criu.mntns.0YG63d/12-0000000000/proc)
(00.020758) 1: mnt: Inspecting sharing on 230 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/dev)
(00.020761) 1: mnt: The mount 167 is bind for 230 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/kcore -> @/tmp/.criu.mntns.0YG63d/12-0000000000/dev)
(00.020763) 1: mnt: The mount 168 is bind for 230 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/timer_stats -> @/tmp/.criu.mntns.0YG63d/12-0000000000/dev)
(00.020765) 1: mnt: Inspecting sharing on 231 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/dev/pts)
(00.020768) 1: mnt: Inspecting sharing on 232 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/dev/shm)
(00.020770) 1: mnt: Inspecting sharing on 233 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/dev/mqueue)
(00.020773) 1: mnt: Inspecting sharing on 234 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/sys)
(00.020775) 1: mnt: Inspecting sharing on 235 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/run/secrets)
(00.020777) 1: mnt: Inspecting sharing on 236 shared_id 0 master_id -1 (@/tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb)
(00.020779) 1: mnt: Inspecting sharing on 237 shared_id 0 master_id -1 (@/tmp/.criu.mntns.0YG63d/12-0000000000/etc/resolv.conf)
(00.020781) 1: mnt: Inspecting sharing on 238 shared_id 0 master_id -1 (@/tmp/.criu.mntns.0YG63d/12-0000000000/etc/hostname)
(00.020784) 1: mnt: Inspecting sharing on 239 shared_id 0 master_id -1 (@/tmp/.criu.mntns.0YG63d/12-0000000000/etc/hosts)
(00.020786) 1: mnt: Inspecting sharing on 161 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/bus)
(00.020788) 1: mnt: Inspecting sharing on 162 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/fs)
(00.020790) 1: mnt: Inspecting sharing on 163 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/irq)
(00.020792) 1: mnt: Inspecting sharing on 164 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/sys)
(00.020795) 1: mnt: Inspecting sharing on 165 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/sysrq-trigger)
(00.020797) 1: mnt: Inspecting sharing on 167 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/kcore)
(00.020799) 1: mnt: Inspecting sharing on 168 shared_id 0 master_id 0 (@/tmp/.criu.mntns.0YG63d/12-0000000000/proc/timer_stats)
(00.020806) 1: mnt: Start with 0:/tmp/.criu.mntns.0YG63d
(00.020826) 1: mnt: Start with 0:/tmp/.criu.mntns.0YG63d
(00.020970) 1: mnt: Start with 0:/tmp/.criu.mntns.0YG63d
(00.020975) 1: mnt: Mounting unsupported @/tmp/.criu.mntns.0YG63d/12-0000000000/ (0)
(00.020992) 1: mnt: 228:/tmp/.criu.mntns.0YG63d/12-0000000000/ private 0 shared 0 slave 1
(00.021013) 1: mnt: Mounting unsupported @/tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb (0)
(00.021016) 1: mnt: Bind /var/log/mydb to /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb
(00.021049) 1: Error (criu/mount.c:2324): mnt: Can't mount at /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb: No such file or directory
(00.021053) 1: Error (criu/mount.c:2582): mnt: Unable to statfs /tmp/.criu.mntns.0YG63d/12-0000000000/var/log/mydb: No such file or directory
(00.021056) 1: mnt: Start with 0:/tmp/.criu.mntns.0YG63d
(00.022180) Error (criu/mount.c:3396): mnt: Can't remove the directory /tmp/.criu.mntns.0YG63d: Device or resource busy
(00.022191) Error (criu/cr-restore.c:2639): Restoring FAILED.
The text was updated successfully, but these errors were encountered: