`TestUsernsCheckpoint` and `TestCheckpoint` fail on master on fresh ubuntu droplet #1745

tiborvass · 2018-02-27T23:11:21Z

Here are the logs of the tests, let me know if you need more information.

OS: Ubuntu 16.04.3
Kernel: 4.4.0-77-generic but also tried on ubuntu's hwe kernel: 4.13.0-36-generic
Commit: 4bb1fe4

=== RUN   TestUsernsCheckpoint
--- FAIL: TestUsernsCheckpoint (1.06s)
	checkpoint_test.go:20: === /tmp/criu419606320/dump.log ===
	checkpoint_test.go:31: (00.000128) ========================================
	checkpoint_test.go:31: (00.000161) Dumping processes (pid: 1551)
	checkpoint_test.go:31: (00.000173) ========================================
	checkpoint_test.go:31: (00.000189) Running pre-dump scripts
	checkpoint_test.go:31: (00.000198) 	RPC
	checkpoint_test.go:31: (00.000552) irmap: Searching irmap cache in work dir
	checkpoint_test.go:31: (00.000593) No irmap-cache image
	checkpoint_test.go:31: (00.000606) irmap: Searching irmap cache in parent
	checkpoint_test.go:31: (00.000633) irmap: No irmap cache
	checkpoint_test.go:31: (00.000694) cpu: fpu:1 fxsr:1 xsave:1
	checkpoint_test.go:31: (00.001095) cg-prop: Parsing controller "cpu"
	checkpoint_test.go:31: (00.001114) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001129) cg-prop: 	Property "cpu.shares"
	checkpoint_test.go:31: (00.001141) cg-prop: 	Property "cpu.cfs_period_us"
	checkpoint_test.go:31: (00.001149) cg-prop: 	Property "cpu.cfs_quota_us"
	checkpoint_test.go:31: (00.001157) cg-prop: 	Property "cpu.rt_period_us"
	checkpoint_test.go:31: (00.001165) cg-prop: 	Property "cpu.rt_runtime_us"
	checkpoint_test.go:31: (00.001173) cg-prop: Parsing controller "memory"
	checkpoint_test.go:31: (00.001182) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001192) cg-prop: 	Property "memory.limit_in_bytes"
	checkpoint_test.go:31: (00.001201) cg-prop: 	Property "memory.memsw.limit_in_bytes"
	checkpoint_test.go:31: (00.001210) cg-prop: 	Property "memory.swappiness"
	checkpoint_test.go:31: (00.001220) cg-prop: 	Property "memory.soft_limit_in_bytes"
	checkpoint_test.go:31: (00.001229) cg-prop: 	Property "memory.move_charge_at_immigrate"
	checkpoint_test.go:31: (00.001238) cg-prop: 	Property "memory.oom_control"
	checkpoint_test.go:31: (00.001248) cg-prop: 	Property "memory.use_hierarchy"
	checkpoint_test.go:31: (00.001256) cg-prop: 	Property "memory.kmem.limit_in_bytes"
	checkpoint_test.go:31: (00.001265) cg-prop: 	Property "memory.kmem.tcp.limit_in_bytes"
	checkpoint_test.go:31: (00.001275) cg-prop: Parsing controller "cpuset"
	checkpoint_test.go:31: (00.001365) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001386) cg-prop: 	Property "cpuset.cpus"
	checkpoint_test.go:31: (00.001397) cg-prop: 	Property "cpuset.mems"
	checkpoint_test.go:31: (00.001406) cg-prop: 	Property "cpuset.memory_migrate"
	checkpoint_test.go:31: (00.001416) cg-prop: 	Property "cpuset.cpu_exclusive"
	checkpoint_test.go:31: (00.001425) cg-prop: 	Property "cpuset.mem_exclusive"
	checkpoint_test.go:31: (00.001434) cg-prop: 	Property "cpuset.mem_hardwall"
	checkpoint_test.go:31: (00.001443) cg-prop: 	Property "cpuset.memory_spread_page"
	checkpoint_test.go:31: (00.001452) cg-prop: 	Property "cpuset.memory_spread_slab"
	checkpoint_test.go:31: (00.001461) cg-prop: 	Property "cpuset.sched_load_balance"
	checkpoint_test.go:31: (00.001470) cg-prop: 	Property "cpuset.sched_relax_domain_level"
	checkpoint_test.go:31: (00.001479) cg-prop: Parsing controller "blkio"
	checkpoint_test.go:31: (00.001488) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001497) cg-prop: 	Property "blkio.weight"
	checkpoint_test.go:31: (00.001506) cg-prop: Parsing controller "freezer"
	checkpoint_test.go:31: (00.001515) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001525) cg-prop: Parsing controller "perf_event"
	checkpoint_test.go:31: (00.001535) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001545) cg-prop: Parsing controller "net_cls"
	checkpoint_test.go:31: (00.001554) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001563) cg-prop: 	Property "net_cls.classid"
	checkpoint_test.go:31: (00.001572) cg-prop: Parsing controller "net_prio"
	checkpoint_test.go:31: (00.001593) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001604) cg-prop: 	Property "net_prio.ifpriomap"
	checkpoint_test.go:31: (00.001614) cg-prop: Parsing controller "pids"
	checkpoint_test.go:31: (00.001623) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001632) cg-prop: 	Property "pids.max"
	checkpoint_test.go:31: (00.001641) cg-prop: Parsing controller "devices"
	checkpoint_test.go:31: (00.001650) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001659) cg-prop: 	Property "devices.list"
	checkpoint_test.go:31: (00.001844) Perparing image inventory (version 1)
	checkpoint_test.go:31: (00.001955) Add pid ns 1 pid 1597
	checkpoint_test.go:31: (00.001993) Add net ns 2 pid 1597
	checkpoint_test.go:31: (00.002029) Add ipc ns 3 pid 1597
	checkpoint_test.go:31: (00.002063) Add uts ns 4 pid 1597
	checkpoint_test.go:31: (00.002097) Add mnt ns 5 pid 1597
	checkpoint_test.go:31: (00.002132) Add user ns 6 pid 1597
	checkpoint_test.go:31: (00.002166) Add cgroup ns 7 pid 1597
	checkpoint_test.go:31: (00.002178) cg: Dumping cgroups for 1597
	checkpoint_test.go:31: (00.002290) cg:  `- New css ID 1
	checkpoint_test.go:31: (00.002303) cg:     `- [blkio] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002313) cg:     `- [cpu,cpuacct] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002321) cg:     `- [cpuset] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002330) cg:     `- [devices] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002339) cg:     `- [freezer] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002348) cg:     `- [hugetlb] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002356) cg:     `- [memory] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002364) cg:     `- [name=systemd] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002384) cg:     `- [net_cls,net_prio] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002393) cg:     `- [perf_event] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002402) cg:     `- [pids] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002411) cg:     `- [rdma] -> [/] [0]
	checkpoint_test.go:31: (00.002419) cg: Set 1 is criu one
	checkpoint_test.go:31: (00.002449) freezing processes: 100000 attempst with 100 ms steps
	checkpoint_test.go:31: (00.002510) freezer.state=THAWED
	checkpoint_test.go:31: (00.002586) freezer.state=FROZEN
	checkpoint_test.go:31: (00.002598) freezing processes: 0 attempts done
	checkpoint_test.go:31: (00.002699) SEIZE 1551: success
	checkpoint_test.go:31: (00.003075) Seized task 1551, state 1
	checkpoint_test.go:31: (00.003134) Collected (0 attempts, 0 in_progress)
	checkpoint_test.go:31: (00.003198) Collected (0 attempts, 0 in_progress)
	checkpoint_test.go:31: (00.003217) Collected 1551 in 1 state
	checkpoint_test.go:31: (00.003311) Will take pid namespace in the image
	checkpoint_test.go:31: (00.003326) Add pid ns 8 pid 1551
	checkpoint_test.go:31: (00.003360) Will take net namespace in the image
	checkpoint_test.go:31: (00.003372) Add net ns 9 pid 1551
	checkpoint_test.go:31: (00.003437) Will take ipc namespace in the image
	checkpoint_test.go:31: (00.003452) Add ipc ns 10 pid 1551
	checkpoint_test.go:31: (00.003488) Will take uts namespace in the image
	checkpoint_test.go:31: (00.003501) Add uts ns 11 pid 1551
	checkpoint_test.go:31: (00.003535) Will take mnt namespace in the image
	checkpoint_test.go:31: (00.003548) Add mnt ns 12 pid 1551
	checkpoint_test.go:31: (00.003582) Will take user namespace in the image
	checkpoint_test.go:31: (00.003594) Add user ns 13 pid 1551
	checkpoint_test.go:31: (00.003629) Lock network
	checkpoint_test.go:31: (00.003641) Running network-lock scripts
	checkpoint_test.go:31: (00.003650) 	RPC
	checkpoint_test.go:31: iptables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore v1.6.0: ip6tables-restore: unable to initialize table 'filter'
	checkpoint_test.go:31:
	checkpoint_test.go:31: Error occurred at line: 1
	checkpoint_test.go:31: Try `ip6tables-restore -h' or 'ip6tables-restore --help' for more information.
	checkpoint_test.go:31: (00.076417) Error (criu/util.c:714): exited, status=2
	checkpoint_test.go:31: (00.076488) Error (criu/net.c:2019): Locking network failed: iptables-restore returned -1. This may be connected to disabled CONFIG_NETFILTER_XT_MARK kernel build config option.
	checkpoint_test.go:31: (00.076554) Unlock network
	checkpoint_test.go:31: (00.076568) Running network-unlock scripts
	checkpoint_test.go:31: (00.076576) 	RPC
	checkpoint_test.go:31: iptables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore v1.6.0: ip6tables-restore: unable to initialize table 'filter'
	checkpoint_test.go:31:
	checkpoint_test.go:31: Error occurred at line: 1
	checkpoint_test.go:31: Try `ip6tables-restore -h' or 'ip6tables-restore --help' for more information.
	checkpoint_test.go:31: (00.122114) Error (criu/util.c:714): exited, status=2
	checkpoint_test.go:31: (00.122153) Unfreezing tasks into 1
	checkpoint_test.go:31: (00.122181) Error (criu/cr-dump.c:1709): Dumping FAILED.
	checkpoint_test.go:38: === END ===
	checkpoint_test.go:175: criu failed: type NOTIFY errno 0
		log file: /tmp/criu419606320/dump.log
=== RUN   TestCheckpoint
--- FAIL: TestCheckpoint (0.72s)
	checkpoint_test.go:20: === /tmp/criu822063972/dump.log ===
	checkpoint_test.go:31: (00.000149) ========================================
	checkpoint_test.go:31: (00.000184) Dumping processes (pid: 1619)
	checkpoint_test.go:31: (00.000195) ========================================
	checkpoint_test.go:31: (00.000209) Running pre-dump scripts
	checkpoint_test.go:31: (00.000220) 	RPC
	checkpoint_test.go:31: (00.000551) irmap: Searching irmap cache in work dir
	checkpoint_test.go:31: (00.000614) No irmap-cache image
	checkpoint_test.go:31: (00.000629) irmap: Searching irmap cache in parent
	checkpoint_test.go:31: (00.000657) irmap: No irmap cache
	checkpoint_test.go:31: (00.000710) cpu: fpu:1 fxsr:1 xsave:1
	checkpoint_test.go:31: (00.001064) cg-prop: Parsing controller "cpu"
	checkpoint_test.go:31: (00.001084) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001099) cg-prop: 	Property "cpu.shares"
	checkpoint_test.go:31: (00.001110) cg-prop: 	Property "cpu.cfs_period_us"
	checkpoint_test.go:31: (00.001120) cg-prop: 	Property "cpu.cfs_quota_us"
	checkpoint_test.go:31: (00.001131) cg-prop: 	Property "cpu.rt_period_us"
	checkpoint_test.go:31: (00.001139) cg-prop: 	Property "cpu.rt_runtime_us"
	checkpoint_test.go:31: (00.001149) cg-prop: Parsing controller "memory"
	checkpoint_test.go:31: (00.001159) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001168) cg-prop: 	Property "memory.limit_in_bytes"
	checkpoint_test.go:31: (00.001178) cg-prop: 	Property "memory.memsw.limit_in_bytes"
	checkpoint_test.go:31: (00.001187) cg-prop: 	Property "memory.swappiness"
	checkpoint_test.go:31: (00.001197) cg-prop: 	Property "memory.soft_limit_in_bytes"
	checkpoint_test.go:31: (00.001207) cg-prop: 	Property "memory.move_charge_at_immigrate"
	checkpoint_test.go:31: (00.001216) cg-prop: 	Property "memory.oom_control"
	checkpoint_test.go:31: (00.001226) cg-prop: 	Property "memory.use_hierarchy"
	checkpoint_test.go:31: (00.001235) cg-prop: 	Property "memory.kmem.limit_in_bytes"
	checkpoint_test.go:31: (00.001244) cg-prop: 	Property "memory.kmem.tcp.limit_in_bytes"
	checkpoint_test.go:31: (00.001254) cg-prop: Parsing controller "cpuset"
	checkpoint_test.go:31: (00.001264) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001273) cg-prop: 	Property "cpuset.cpus"
	checkpoint_test.go:31: (00.001283) cg-prop: 	Property "cpuset.mems"
	checkpoint_test.go:31: (00.001292) cg-prop: 	Property "cpuset.memory_migrate"
	checkpoint_test.go:31: (00.001302) cg-prop: 	Property "cpuset.cpu_exclusive"
	checkpoint_test.go:31: (00.001311) cg-prop: 	Property "cpuset.mem_exclusive"
	checkpoint_test.go:31: (00.001320) cg-prop: 	Property "cpuset.mem_hardwall"
	checkpoint_test.go:31: (00.001330) cg-prop: 	Property "cpuset.memory_spread_page"
	checkpoint_test.go:31: (00.001338) cg-prop: 	Property "cpuset.memory_spread_slab"
	checkpoint_test.go:31: (00.001347) cg-prop: 	Property "cpuset.sched_load_balance"
	checkpoint_test.go:31: (00.001357) cg-prop: 	Property "cpuset.sched_relax_domain_level"
	checkpoint_test.go:31: (00.001367) cg-prop: Parsing controller "blkio"
	checkpoint_test.go:31: (00.001376) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001386) cg-prop: 	Property "blkio.weight"
	checkpoint_test.go:31: (00.001396) cg-prop: Parsing controller "freezer"
	checkpoint_test.go:31: (00.001405) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001416) cg-prop: Parsing controller "perf_event"
	checkpoint_test.go:31: (00.001426) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001436) cg-prop: Parsing controller "net_cls"
	checkpoint_test.go:31: (00.001447) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001456) cg-prop: 	Property "net_cls.classid"
	checkpoint_test.go:31: (00.001465) cg-prop: Parsing controller "net_prio"
	checkpoint_test.go:31: (00.001489) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001501) cg-prop: 	Property "net_prio.ifpriomap"
	checkpoint_test.go:31: (00.001511) cg-prop: Parsing controller "pids"
	checkpoint_test.go:31: (00.001522) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001531) cg-prop: 	Property "pids.max"
	checkpoint_test.go:31: (00.001540) cg-prop: Parsing controller "devices"
	checkpoint_test.go:31: (00.001550) cg-prop: 	Strategy "replace"
	checkpoint_test.go:31: (00.001560) cg-prop: 	Property "devices.list"
	checkpoint_test.go:31: (00.001740) Perparing image inventory (version 1)
	checkpoint_test.go:31: (00.001850) Add pid ns 1 pid 1664
	checkpoint_test.go:31: (00.001895) Add net ns 2 pid 1664
	checkpoint_test.go:31: (00.001937) Add ipc ns 3 pid 1664
	checkpoint_test.go:31: (00.001975) Add uts ns 4 pid 1664
	checkpoint_test.go:31: (00.002014) Add mnt ns 5 pid 1664
	checkpoint_test.go:31: (00.002054) Add user ns 6 pid 1664
	checkpoint_test.go:31: (00.002094) Add cgroup ns 7 pid 1664
	checkpoint_test.go:31: (00.002109) cg: Dumping cgroups for 1664
	checkpoint_test.go:31: (00.002222) cg:  `- New css ID 1
	checkpoint_test.go:31: (00.002237) cg:     `- [blkio] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002247) cg:     `- [cpu,cpuacct] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002256) cg:     `- [cpuset] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002264) cg:     `- [devices] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002272) cg:     `- [freezer] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002281) cg:     `- [hugetlb] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002289) cg:     `- [memory] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002297) cg:     `- [name=systemd] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002318) cg:     `- [net_cls,net_prio] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002329) cg:     `- [perf_event] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002338) cg:     `- [pids] -> [/docker/266858243be529150dd4a8e298ad8ba4646b0d79463297ab201450e0c04de00b] [0]
	checkpoint_test.go:31: (00.002346) cg:     `- [rdma] -> [/] [0]
	checkpoint_test.go:31: (00.002355) cg: Set 1 is criu one
	checkpoint_test.go:31: (00.002387) freezing processes: 100000 attempst with 100 ms steps
	checkpoint_test.go:31: (00.002449) freezer.state=THAWED
	checkpoint_test.go:31: (00.002630) freezer.state=FROZEN
	checkpoint_test.go:31: (00.002651) freezing processes: 0 attempts done
	checkpoint_test.go:31: (00.002761) SEIZE 1619: success
	checkpoint_test.go:31: (00.003240) Seized task 1619, state 1
	checkpoint_test.go:31: (00.003288) Collected (0 attempts, 0 in_progress)
	checkpoint_test.go:31: (00.003354) Collected (0 attempts, 0 in_progress)
	checkpoint_test.go:31: (00.003376) Collected 1619 in 1 state
	checkpoint_test.go:31: (00.003458) Will take pid namespace in the image
	checkpoint_test.go:31: (00.003473) Add pid ns 8 pid 1619
	checkpoint_test.go:31: (00.003508) Will take net namespace in the image
	checkpoint_test.go:31: (00.003518) Add net ns 9 pid 1619
	checkpoint_test.go:31: (00.003541) Will take ipc namespace in the image
	checkpoint_test.go:31: (00.003546) Add ipc ns 10 pid 1619
	checkpoint_test.go:31: (00.003565) Will take uts namespace in the image
	checkpoint_test.go:31: (00.003571) Add uts ns 11 pid 1619
	checkpoint_test.go:31: (00.003587) Will take mnt namespace in the image
	checkpoint_test.go:31: (00.003593) Add mnt ns 12 pid 1619
	checkpoint_test.go:31: (00.003624) Lock network
	checkpoint_test.go:31: (00.003630) Running network-lock scripts
	checkpoint_test.go:31: (00.003634) 	RPC
	checkpoint_test.go:31: iptables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore v1.6.0: ip6tables-restore: unable to initialize table 'filter'
	checkpoint_test.go:31:
	checkpoint_test.go:31: Error occurred at line: 1
	checkpoint_test.go:31: Try `ip6tables-restore -h' or 'ip6tables-restore --help' for more information.
	checkpoint_test.go:31: (00.047914) Error (criu/util.c:714): exited, status=2
	checkpoint_test.go:31: (00.047971) Error (criu/net.c:2019): Locking network failed: iptables-restore returned -1. This may be connected to disabled CONFIG_NETFILTER_XT_MARK kernel build config option.
	checkpoint_test.go:31: (00.048012) Unlock network
	checkpoint_test.go:31: (00.048019) Running network-unlock scripts
	checkpoint_test.go:31: (00.048023) 	RPC
	checkpoint_test.go:31: iptables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore: invalid option -- 'w'
	checkpoint_test.go:31: ip6tables-restore v1.6.0: ip6tables-restore: unable to initialize table 'filter'
	checkpoint_test.go:31:
	checkpoint_test.go:31: Error occurred at line: 1
	checkpoint_test.go:31: Try `ip6tables-restore -h' or 'ip6tables-restore --help' for more information.
	checkpoint_test.go:31: (00.084478) Error (criu/util.c:714): exited, status=2
	checkpoint_test.go:31: (00.084542) Unfreezing tasks into 1
	checkpoint_test.go:31: (00.084602) Error (criu/cr-dump.c:1709): Dumping FAILED.
	checkpoint_test.go:38: === END ===
	checkpoint_test.go:175: criu failed: type NOTIFY errno 0
		log file: /tmp/criu822063972/dump.log

Using overlay2 backed by extfs.

What is super weird is that @estesp tried it as well on his laptop, running Ubuntu 16.04 with 4.13.0-32-generic, same docker version, same storage driver and it passed for him. I'm gonna try different cloud vendors, but what else could be the problem technically?

The text was updated successfully, but these errors were encountered:

tiborvass · 2018-02-27T23:44:46Z

I updated the issue because I had pasted logs from a run on a different branch than master. I just ran make integration on master and tests 8 and 9 (also about criu) are failing.

tiborvass · 2018-02-27T23:46:12Z

@avagin Do you know anything about what the problem could be?

avagin · 2018-02-28T03:31:53Z

Could you show output for "sysctl -a | grep disable_ipv6"?

avagin · 2018-02-28T03:37:07Z

and for this one "unshare -n ip6tables -t filter -I INPUT --protocol tcp --sport 80 && echo ok || echo fail"

tiborvass · 2018-02-28T21:20:53Z

@avagin sure!

On the 4.13 kernel:

# uname -a
Linux tibor-ubuntu-s-2vcpu-4gb-sfo1-01 4.13.0-36-generic #40~16.04.1-Ubuntu SMP Fri Feb 16 23:25:58 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
# sysctl -a | grep disable_ipv6
net.ipv6.conf.all.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.all.stable_secret"
net.ipv6.conf.default.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.default.stable_secret"
net.ipv6.conf.docker0.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.docker0.stable_secret"
net.ipv6.conf.eth0.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.eth0.stable_secret"
net.ipv6.conf.lo.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.lo.stable_secret"

On the 4.4 kernel:

# uname -a
Linux tibor-git 4.4.0-77-generic #98-Ubuntu SMP Wed Apr 26 08:34:02 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
# sysctl -a | grep disable_ipv6
sysctl: reading key "net.ipv6.conf.all.stable_secret"
net.ipv6.conf.all.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.br-48586e9a5b79.stable_secret"
net.ipv6.conf.br-48586e9a5b79.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.br-e2abd2267c81.stable_secret"
net.ipv6.conf.br-e2abd2267c81.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.default.stable_secret"
net.ipv6.conf.default.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.docker0.stable_secret"
net.ipv6.conf.docker0.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.docker_gwbridge.stable_secret"
net.ipv6.conf.docker_gwbridge.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.eth0.stable_secret"
net.ipv6.conf.eth0.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.lo.stable_secret"
net.ipv6.conf.lo.disable_ipv6 = 0
sysctl: reading key "net.ipv6.conf.veth47378c6.stable_secret"
net.ipv6.conf.veth47378c6.disable_ipv6 = 0

On both:

# unshare -n ip6tables -t filter -I INPUT --protocol tcp --sport 80 && echo ok || echo fail
ok

avagin · 2018-02-28T21:31:35Z

@tiborvass do you run tests on the host or in a docker container?

tiborvass · 2018-02-28T21:39:00Z

@avagin in a docker container, I ran make test but it fails at unit tests, so doesn't even start the integration tests (which I also tried with make integration and fails with 8 and 9).

Here is the result of the sysctl inside the docker container (after make shell):

On the 4.13 kernel:

sysctl: net.ipv6.conf.all.disable_ipv6 = 1
reading key "net.ipv6.conf.all.stable_secret"
net.ipv6.conf.default.disable_ipv6 = 1
sysctl: reading key "net.ipv6.conf.default.stable_secret"
net.ipv6.conf.eth0.disable_ipv6 = 1
sysctl: reading key "net.ipv6.conf.eth0.stable_secret"
net.ipv6.conf.lo.disable_ipv6 = 1
sysctl: reading key "net.ipv6.conf.lo.stable_secret"

On the 4.4 kernel:

sysctl: reading key "net.ipv6.conf.all.stable_secret"
net.ipv6.conf.all.disable_ipv6 = 1
sysctl: reading key "net.ipv6.conf.default.stable_secret"
net.ipv6.conf.default.disable_ipv6 = 1
sysctl: reading key "net.ipv6.conf.eth0.stable_secret"
net.ipv6.conf.eth0.disable_ipv6 = 1
sysctl: reading key "net.ipv6.conf.lo.stable_secret"
net.ipv6.conf.lo.disable_ipv6 = 1

avagin · 2018-02-28T22:11:28Z

@tiborvass Could you try to run a container with "-v /lib/modules:/lib/modules"?

avagin · 2018-02-28T22:54:02Z

@tiborvass I reproduced this issue on my host.

CRIU needs to load a few modules to checkpoint/resume containers. opencontainers#1745 Signed-off-by: Andrei Vagin <avagin@virtuozzo.com>

mattbonnell · 2020-08-26T13:26:04Z

Just experienced this same issue running make test

tiborvass changed the title ~~TestExecInTTY and TestCheckpoint fail on master on fresh ubuntu droplet~~ TestUsernsCheckpoint and TestCheckpoint fail on master on fresh ubuntu droplet Feb 27, 2018

tiborvass mentioned this issue Feb 27, 2018

Makefile:71: recipe for target 'localunittest' failed make: *** [localunittest] Error 1 #1713

Closed

avagin added a commit to avagin/runc that referenced this issue Feb 28, 2018

tests: allows to load modules from a test container

1adb067

CRIU needs to load a few modules to checkpoint/resume containers. opencontainers#1745 Signed-off-by: Andrei Vagin <avagin@virtuozzo.com>

avagin added a commit to avagin/runc that referenced this issue Feb 28, 2018

tests: allows to load modules from a test container

d104529

CRIU needs to load a few modules to checkpoint/resume containers. opencontainers#1745 Signed-off-by: Andrei Vagin <avagin@virtuozzo.com>

avagin added a commit to avagin/runc that referenced this issue Feb 28, 2018

tests: allows to load modules from a test container

84c206a

CRIU needs to load a few modules to checkpoint/resume containers. opencontainers#1745 Signed-off-by: Andrei Vagin <avagin@virtuozzo.com>

avagin added a commit to avagin/runc that referenced this issue Feb 28, 2018

tests: allow to load kernel modules from a test container

432745a

CRIU needs to load a few modules to checkpoint/resume containers. opencontainers#1745 Signed-off-by: Andrei Vagin <avagin@virtuozzo.com>

avagin mentioned this issue Feb 28, 2018

tests: allow to load kernel modules from a test container #1750

Merged

avagin added a commit to avagin/runc that referenced this issue Mar 12, 2018

tests: allow to load kernel modules from a test container

74e961e

CRIU needs to load a few modules to checkpoint/resume containers. opencontainers#1745 Signed-off-by: Andrei Vagin <avagin@virtuozzo.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

`TestUsernsCheckpoint` and `TestCheckpoint` fail on master on fresh ubuntu droplet #1745

`TestUsernsCheckpoint` and `TestCheckpoint` fail on master on fresh ubuntu droplet #1745

tiborvass commented Feb 27, 2018 •

edited

Loading

tiborvass commented Feb 27, 2018 •

edited

Loading

tiborvass commented Feb 27, 2018

avagin commented Feb 28, 2018

avagin commented Feb 28, 2018

tiborvass commented Feb 28, 2018

avagin commented Feb 28, 2018

tiborvass commented Feb 28, 2018 •

edited

Loading

avagin commented Feb 28, 2018

avagin commented Feb 28, 2018

mattbonnell commented Aug 26, 2020 •

edited

Loading

TestUsernsCheckpoint and TestCheckpoint fail on master on fresh ubuntu droplet #1745

TestUsernsCheckpoint and TestCheckpoint fail on master on fresh ubuntu droplet #1745

Comments

tiborvass commented Feb 27, 2018 • edited Loading

tiborvass commented Feb 27, 2018 • edited Loading

tiborvass commented Feb 27, 2018

avagin commented Feb 28, 2018

avagin commented Feb 28, 2018

tiborvass commented Feb 28, 2018

avagin commented Feb 28, 2018

tiborvass commented Feb 28, 2018 • edited Loading

avagin commented Feb 28, 2018

avagin commented Feb 28, 2018

mattbonnell commented Aug 26, 2020 • edited Loading

`TestUsernsCheckpoint` and `TestCheckpoint` fail on master on fresh ubuntu droplet #1745

`TestUsernsCheckpoint` and `TestCheckpoint` fail on master on fresh ubuntu droplet #1745

tiborvass commented Feb 27, 2018 •

edited

Loading

tiborvass commented Feb 27, 2018 •

edited

Loading

tiborvass commented Feb 28, 2018 •

edited

Loading

mattbonnell commented Aug 26, 2020 •

edited

Loading