Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

podman hangs when creating a container in a pod #4829

Open
jelly opened this issue May 31, 2023 · 2 comments
Open

podman hangs when creating a container in a pod #4829

jelly opened this issue May 31, 2023 · 2 comments
Labels
knownissue

Comments

@jelly
Copy link
Member

jelly commented May 31, 2023 •
edited
Loading

Downstream report: https://bugzilla.redhat.com/show_bug.cgi?id=2211395
@jelly jelly changed the title podman hangs creating a container in a pod podman hangs when creating a container in a pod May 31, 2023
@cockpituous
Copy link
Contributor

cockpituous commented May 31, 2023 •
edited
Loading

rhel4edge
Ooops, it happened again

# ----------------------------------------------------------------------
# testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:9312/devtools/browser/d399756b-7d4a-40b1-9c84-3e936055f6bb
[0717/154138.312547:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
time="2023-07-17T11:41:43-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> log: 
> log: 
> log: 
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%2216775fb9cff295b9b1339049d51c9aa99fa659ac30ac3182d36cf88c7d0f161c%22%5D%7D: received truncated HTTP response
> warning: http:///run/podman/podman.sock/v1.12/libpod/containers/45ade4c0df270adfbb9f69d93e708b64db66eccc3b5bb59f3171235599f504ef/json?size=false: received truncated HTTP response
> warning: Failed to do Update Pod: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2190, in testPruneUnusedContainersSystem
    self._testPruneUnusedContainersSystem(True)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2203, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/test/check-application", line 212, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 212, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem) failed
# 1 TEST FAILED [269s on 3-cockpit-10]
not ok 27 /work/bots/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersSystem [ND@5]

First occurrence: 2023-07-17T15:45:57.502039 | revision 64b0bac28eac4a0d466ad2333d786dc96aab0722
Times recorded: 1
Latest occurrences:

  • 2023-07-17T15:45:57.502039 | revision 64b0bac28eac4a0d466ad2333d786dc96aab0722
# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:10099/devtools/browser/19492a17-6eeb-47c0-8653-45c8b83d1e4d
[0717/232745.553747:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
> warning: Parse error /var/lib/insights/host-details.json Not permitted to perform this action.
> warning: Parse error /var/lib/insights/insights-details.json Not permitted to perform this action.
time="2023-07-17T19:27:49-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
----- user containers -----
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%2238c38006a6917f444e291f695a8f10c0a726ad2327945209bdab633a11c1e6fc%22%5D%7D: received truncated HTTP response
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/containers/672c4e343f176340544be7acdc4c947c24a9f54e133603c9b7b5a3bf756fc088/json?size=false: received truncated HTTP response
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: Failed to do Update Pod: {"problem":"protocol-error","message":"protocol-error"}
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> log: 
rm: cannot remove '/home/admin/.local/share/containers/storage/overlay': Directory not empty
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
umount: /run/user/1000: no mount point specified.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2193, in testPruneUnusedContainersUser
    self._testPruneUnusedContainersSystem(False)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2203, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman pod rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2401', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'IdentitiesOnly=yes', '-o', 'BatchMode=yes', '-o', 'PKCS11Provider=none', '-o', 'LogLevel=ERROR', '-l', 'root', '127.0.0.2', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%h-%p-%r-6924', 'set -e;', 'rm -rf /home/admin/.local/share/containers; mv /var/lib/cockpittest/_home_admin_.local_share_containers /home/admin/.local/share/containers']' returned non-zero exit status 1.

# Result testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser) failed
# 1 TEST FAILED [497s on rhos-01-12]
not ok 28 /work/bots/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@2]

First occurrence: 2023-07-17T23:35:57.516964 | revision c7f7692
Times recorded: 1
Latest occurrences:

  • 2023-07-17T23:35:57.516964 | revision c7f7692
# ----------------------------------------------------------------------
# testCreatePodUser (__main__.TestApplication.testCreatePodUser)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:10149/devtools/browser/26867979-f208-452b-bd17-a10536f824fd
[0718/041703.054412:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
> warning: Parse error /var/lib/insights/host-details.json Not permitted to perform this action.
> warning: Parse error /var/lib/insights/insights-details.json Not permitted to perform this action.
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
----- user containers -----
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/containers/b994eb5326472ed3a1c5f228236700c5fc75d7af4776c7a928637100917b93cb/json?size=false: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> log: 
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> log: 
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2579, in testCreatePodUser
    self._createPod(False)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2635, in _createPod
    self.waitPodContainer(pod_name,
  File "/work/bots/make-checkout-workdir/test/check-application", line 253, in waitPodContainer
    self.waitContainer(container["id"], system, name=container["name"], image=container["image"],
  File "/work/bots/make-checkout-workdir/test/check-application", line 2069, in waitContainer
    b.wait_text(sel + " .container-name", name)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 659, in wait_text
    self.wait_visible(selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 616, in wait_visible
    self._wait_present(selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 607, in _wait_present
    self.wait_js_func('ph_is_present', selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 601, in wait_js_func
    self.wait_js_cond("%s(%s)" % (func, ','.join(map(jsquote, args))))
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 587, in wait_js_cond
    self.raise_cdp_exception("timeout\nwait_js_cond", cond, result["exceptionDetails"], trailer)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 293, in raise_cdp_exception
    raise Error("%s(%s): %s" % (func, arg, msg))
testlib.Error: timeout
wait_js_cond(ph_is_present("#containers-containers #table-testpod1 tbody tr[data-row-id=b994eb5326472ed3a1c5f228236700c5fc75d7af4776c7a928637100917b93cbfalse] .container-name")): Uncaught (in promise) Error: condition did not become true
cdp: {'source': 'network', 'level': 'error', 'text': 'Failed to load resource: the server responded with a status of 401 (Authentication failed)', 'timestamp': 1689653823964.228, 'url': 'http://127.0.0.2:9291/cockpit/login', 'networkRequestId': '4569.12'}
warning: Parse error /var/lib/insights/host-details.json Not permitted to perform this action.
warning: Parse error /var/lib/insights/insights-details.json Not permitted to perform this action.
warning: Unhandled event type  container history
warning: Unhandled event type  container history

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman pod rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman rm --force --time 0 --all || true'

# Result testCreatePodUser (__main__.TestApplication.testCreatePodUser) failed
# 1 TEST FAILED [398s on 4-cockpit-9]
not ok 12 /work/bots/make-checkout-workdir/test/check-application TestApplication.testCreatePodUser [ND@2]

First occurrence: 2023-07-18T04:23:33.435892 | revision e2fa6f2f3df29db632c8c04ca87855580c446b2a
Times recorded: 1
Latest occurrences:

  • 2023-07-18T04:23:33.435892 | revision e2fa6f2f3df29db632c8c04ca87855580c446b2a
# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:9612/devtools/browser/22b1abc3-6fde-4863-bdfd-5e577c56cc0f
[0718/052531.210416:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
> warning: Parse error /var/lib/insights/host-details.json Not permitted to perform this action.
> warning: Parse error /var/lib/insights/insights-details.json Not permitted to perform this action.
time="2023-07-18T01:25:34-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
time="2023-07-18T01:25:35-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
----- user containers -----
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/containers/98c31a56a08900f05427bb35354438f82bf495835c8604dbe5f2443824557bd3/json?size=false: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> log: 
> log: 
rm: cannot remove '/home/admin/.local/share/containers/storage/overlay': Directory not empty
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2193, in testPruneUnusedContainersUser
    self._testPruneUnusedContainersSystem(False)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2205, in _testPruneUnusedContainersSystem
    runninginpodId = self.execute(auth, f"""
                     ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpodrunning --pod pod -tid localhost/test-busybox sh -c 'sleep infinity''

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman pod rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2701', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'IdentitiesOnly=yes', '-o', 'BatchMode=yes', '-o', 'PKCS11Provider=none', '-o', 'LogLevel=ERROR', '-l', 'root', '127.0.0.2', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%h-%p-%r-8937', 'set -e;', 'rm -rf /home/admin/.local/share/containers; mv /var/lib/cockpittest/_home_admin_.local_share_containers /home/admin/.local/share/containers']' returned non-zero exit status 1.

# Result testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser) failed
# 1 TEST FAILED [496s on rhos-01-7]
not ok 28 /work/bots/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@4]

First occurrence: 2023-07-18T05:33:43.543583 | revision 6af1ca09c21db58f78cb610d6aa91329d5d46da7
Times recorded: 1
Latest occurrences:

  • 2023-07-18T05:33:43.543583 | revision 6af1ca09c21db58f78cb610d6aa91329d5d46da7
# ----------------------------------------------------------------------
# testCreatePodSystem (__main__.TestApplication.testCreatePodSystem)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:9794/devtools/browser/89189636-34ca-48a1-a9f3-5741b8a77930
[0718/054424.894151:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> log: 
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> log: 
> log: 
> log: 
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> warning: http:///run/podman/podman.sock/v1.12/libpod/containers/93ef8cfe831ca38025e7e0596c18a26630dc0582abd471d8c85938be97a142be/json?size=false: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> log: 
> log: 
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2576, in testCreatePodSystem
    self._createPod(True)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2635, in _createPod
    self.waitPodContainer(pod_name,
  File "/work/bots/make-checkout-workdir/test/check-application", line 253, in waitPodContainer
    self.waitContainer(container["id"], system, name=container["name"], image=container["image"],
  File "/work/bots/make-checkout-workdir/test/check-application", line 2069, in waitContainer
    b.wait_text(sel + " .container-name", name)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 659, in wait_text
    self.wait_visible(selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 616, in wait_visible
    self._wait_present(selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 607, in _wait_present
    self.wait_js_func('ph_is_present', selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 601, in wait_js_func
    self.wait_js_cond("%s(%s)" % (func, ','.join(map(jsquote, args))))
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 587, in wait_js_cond
    self.raise_cdp_exception("timeout\nwait_js_cond", cond, result["exceptionDetails"], trailer)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 293, in raise_cdp_exception
    raise Error("%s(%s): %s" % (func, arg, msg))
testlib.Error: timeout
wait_js_cond(ph_is_present("#containers-containers #table-testpod1 tbody tr[data-row-id=93ef8cfe831ca38025e7e0596c18a26630dc0582abd471d8c85938be97a142betrue] .container-name")): Uncaught (in promise) Error: condition did not become true
cdp: {'source': 'network', 'level': 'error', 'text': 'Failed to load resource: the server responded with a status of 401 (Authentication failed)', 'timestamp': 1689659065760.192, 'url': 'http://127.0.0.2:9191/cockpit/login', 'networkRequestId': '7316.12'}
warning: Unhandled event type  container history
warning: Unhandled event type  container history
log: 
warning: Unhandled event type  container history
warning: Unhandled event type  container history
log: 
log: 
log: 

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 212, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testCreatePodSystem (__main__.TestApplication.testCreatePodSystem) failed
# 1 TEST FAILED [166s on 2-ci-srv-01]
not ok 11 /work/bots/make-checkout-workdir/test/check-application TestApplication.testCreatePodSystem [ND@1]

First occurrence: 2023-07-18T05:47:02.634732 | revision f43e385a6ec41a6fc24390214d0a1b54f45ea1f5
Times recorded: 1
Latest occurrences:

  • 2023-07-18T05:47:02.634732 | revision f43e385a6ec41a6fc24390214d0a1b54f45ea1f5
# ----------------------------------------------------------------------
# testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:9618/devtools/browser/f7ca5948-a3d2-4b50-a0dd-94ae2322cb39
[0718/054628.908310:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
time="2023-07-18T01:46:34-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> log: 
> log: 
> log: 
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%223ffb79d5f199b9b4b65ec40d9b61cc3348b1639fba6979b10f73a2169b7ece04%22%5D%7D: received truncated HTTP response
> warning: Failed to do Update Pod: {"problem":"protocol-error","message":"protocol-error"}
> warning: http:///run/podman/podman.sock/v1.12/libpod/containers/fe2ba1f94bc200673cd123ab27e2cfd58e636219c7d204165b62cdbda126509e/json?size=false: received truncated HTTP response
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> log: 
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2190, in testPruneUnusedContainersSystem
    self._testPruneUnusedContainersSystem(True)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2203, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/test/check-application", line 212, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 212, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem) failed
# 1 TEST FAILED [272s on 2-ci-srv-01]
not ok 27 /work/bots/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersSystem [ND@6]

First occurrence: 2023-07-18T05:50:49.735321 | revision f43e385a6ec41a6fc24390214d0a1b54f45ea1f5
Times recorded: 1
Latest occurrences:

  • 2023-07-18T05:50:49.735321 | revision f43e385a6ec41a6fc24390214d0a1b54f45ea1f5
# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:9865/devtools/browser/a7f8e32c-8a4a-46b2-afec-ef9deb447fa2
[0718/135536.518313:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
> warning: Parse error /var/lib/insights/host-details.json Not permitted to perform this action.
> warning: Parse error /var/lib/insights/insights-details.json Not permitted to perform this action.
time="2023-07-18T09:55:40-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
time="2023-07-18T09:55:40-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
----- user containers -----
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/containers/229f67a73c32f2dea18ad2f9f392efdd5fd9bf4fc55dcee4ad8fed1a779cd6a3/json?size=false: received truncated HTTP response
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/containers/d39bfa1d2c5022ee004aa72da6c255c3d7567a5492d5956ce2bce9ddd125cdc8/json?size=false: received truncated HTTP response
> log: 
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> log: 
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> log: 
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2193, in testPruneUnusedContainersUser
    self._testPruneUnusedContainersSystem(False)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2205, in _testPruneUnusedContainersSystem
    runninginpodId = self.execute(auth, f"""
                     ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpodrunning --pod pod -tid localhost/test-busybox sh -c 'sleep infinity''

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman pod rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman rm --force --time 0 --all || true'

# Result testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser) failed
# 1 TEST FAILED [497s on rhos-01-27]
not ok 28 /work/bots/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@3]

First occurrence: 2023-07-18T14:03:48.503599 | revision 2cf5425961f7564695241fd78d3f4a83a65e7978
Times recorded: 1
Latest occurrences:

  • 2023-07-18T14:03:48.503599 | revision 2cf5425961f7564695241fd78d3f4a83a65e7978
# ----------------------------------------------------------------------
# testCreatePodSystem (__main__.TestApplication.testCreatePodSystem)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:9938/devtools/browser/710d1588-5808-4c97-8825-4a3e78965e09
[0718/142515.556243:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> log: 
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
> log: 
> log: 
> log: 
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> warning: http:///run/podman/podman.sock/v1.12/libpod/containers/c857301bcdb9c88e2cf268d28a4d6e034a6783e3bd346ffa4fdeb29c25248364/json?size=false: received truncated HTTP response
> warning: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> log: 
> log: 
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2576, in testCreatePodSystem
    self._createPod(True)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2635, in _createPod
    self.waitPodContainer(pod_name,
  File "/work/bots/make-checkout-workdir/test/check-application", line 253, in waitPodContainer
    self.waitContainer(container["id"], system, name=container["name"], image=container["image"],
  File "/work/bots/make-checkout-workdir/test/check-application", line 2069, in waitContainer
    b.wait_text(sel + " .container-name", name)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 659, in wait_text
    self.wait_visible(selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 616, in wait_visible
    self._wait_present(selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 607, in _wait_present
    self.wait_js_func('ph_is_present', selector)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 601, in wait_js_func
    self.wait_js_cond("%s(%s)" % (func, ','.join(map(jsquote, args))))
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 587, in wait_js_cond
    self.raise_cdp_exception("timeout\nwait_js_cond", cond, result["exceptionDetails"], trailer)
  File "/work/bots/make-checkout-workdir/test/common/testlib.py", line 293, in raise_cdp_exception
    raise Error("%s(%s): %s" % (func, arg, msg))
testlib.Error: timeout
wait_js_cond(ph_is_present("#containers-containers #table-testpod1 tbody tr[data-row-id=c857301bcdb9c88e2cf268d28a4d6e034a6783e3bd346ffa4fdeb29c25248364true] .container-name")): Uncaught (in promise) Error: condition did not become true
cdp: {'source': 'network', 'level': 'error', 'text': 'Failed to load resource: the server responded with a status of 401 (Authentication failed)', 'timestamp': 1689690316455.03, 'url': 'http://127.0.0.2:9291/cockpit/login', 'networkRequestId': '40572.12'}
warning: Unhandled event type  container history
warning: Unhandled event type  container history
log: 
warning: Unhandled event type  container history
warning: Unhandled event type  container history
log: 
log: 
log: 

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 212, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testCreatePodSystem (__main__.TestApplication.testCreatePodSystem) failed
# 1 TEST FAILED [167s on 4-ci-srv-02]
not ok 11 /work/bots/make-checkout-workdir/test/check-application TestApplication.testCreatePodSystem [ND@2]

First occurrence: 2023-07-18T14:27:53.366360 | revision afd9d6b7cc9572a4334afbfddff63e7bc5b0c796
Times recorded: 1
Latest occurrences:

  • 2023-07-18T14:27:53.366360 | revision afd9d6b7cc9572a4334afbfddff63e7bc5b0c796
# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Warning: Stopping podman.service, but it can still be activated by:
  podman.socket

DevTools listening on ws://127.0.0.1:9797/devtools/browser/e0b50fcd-0c20-413f-a534-9752e28237fe
[0718/142647.259131:WARNING:sandbox_linux.cc(393)] InitializeSandbox() called with multiple threads in process gpu-process.
> warning: Parse error /var/lib/insights/host-details.json Not permitted to perform this action.
> warning: Parse error /var/lib/insights/insights-details.json Not permitted to perform this action.
time="2023-07-18T10:26:50-04:00" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warning: Unhandled event type  container history
> warning: Unhandled event type  container history
----- user containers -----
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%220828519e83b96aeb7cfdfc73e9071c78a8fd5e0f5a3f5ec675b075519c8fbdb8%22%5D%7D: received truncated HTTP response
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/containers/a35ed9a2b7a6d50c888694d05ae38d2fc36b6849b6a90f1e6601f9b286ef9b98/json?size=false: received truncated HTTP response
> warning: Failed to do Update Pod: {"problem":"protocol-error","message":"protocol-error"}
> log: 
> warning: http:///run/user/1000/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warning: Failed to do Update Pods: {"problem":"protocol-error","message":"protocol-error"}
> log: 
rm: cannot remove '/home/admin/.local/share/containers/storage/overlay': Directory not empty
> warning: transport closed: disconnected
Connection to 127.0.0.2 closed by remote host.
Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 2193, in testPruneUnusedContainersUser
    self._testPruneUnusedContainersSystem(False)
  File "/work/bots/make-checkout-workdir/test/check-application", line 2203, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/test/check-application", line 174, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/bots/make-checkout-workdir/test/check-application", line 214, in execute
    return self.admin_s.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman pod rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 1207, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 2075, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 41, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman rm --force --time 0 --all || true'

Traceback (most recent call last):
  File "/work/bots/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 306, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.11/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2201', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'IdentitiesOnly=yes', '-o', 'BatchMode=yes', '-o', 'PKCS11Provider=none', '-o', 'LogLevel=ERROR', '-l', 'root', '127.0.0.2', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%h-%p-%r-43894', 'set -e;', 'rm -rf /home/admin/.local/share/containers; mv /var/lib/cockpittest/_home_admin_.local_share_containers /home/admin/.local/share/containers']' returned non-zero exit status 1.

# Result testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser) failed
# 1 TEST FAILED [508s on 4-ci-srv-02]
not ok 28 /work/bots/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@0]

First occurrence: 2023-07-18T14:35:01.317701 | revision afd9d6b7cc9572a4334afbfddff63e7bc5b0c796
Times recorded: 1
Latest occurrences:

  • 2023-07-18T14:35:01.317701 | revision afd9d6b7cc9572a4334afbfddff63e7bc5b0c796

@martinpitt martinpitt mentioned this issue Jun 16, 2023
Merged
@cockpituous
Copy link
Contributor

cockpituous commented Jun 16, 2023 •
edited
Loading

ubuntu-2204
Ooops, it happened again

# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 58683
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 58683.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
time="2024-11-07T16:28:07Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Unhandled event type  container history
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
time="2024-11-07T16:28:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
time="2024-11-07T16:28:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Unhandled event type  container history
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
time="2024-11-07T16:28:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
----- user containers -----
timeout: sending signal TERM to command ‘/work/make-checkout-workdir/test/check-application’
not ok 29 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@3]

First occurrence: 2024-11-07T16:37:58.694476+00:00 | revision 715e37f741a729debb7563f2be50e13918c8e128
Times recorded: 1
Latest occurrences:

  • 2024-11-07T16:37:58.694476+00:00 | revision 715e37f741a729debb7563f2be50e13918c8e128
# ----------------------------------------------------------------------
# testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 59093
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 59093.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
> warn: Unhandled event type  container history
time="2024-11-07T17:56:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warn: Unhandled event type  system
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%2272f6a41f4ed877f0538826f870c8c81254b232c90c33e1bf2d969156d0e6739e%22%5D%7D: received truncated HTTP response
> warn: http:///run/podman/podman.sock/v1.12/libpod/containers/535e926908332180091a26714e4ff73b2196afde62781ced5b8ac3df4717d73d/json?size=false: received truncated HTTP response
> warn: Failed to do Update Pod: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%2272f6a41f4ed877f0538826f870c8c81254b232c90c33e1bf2d969156d0e6739e%22%5D%7D: received truncated HTTP response"}
> info: Object(3)
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warn: Failed to do Update Pods: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response"}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> info: Object(3)
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 2454, in testPruneUnusedContainersSystem
    self._testPruneUnusedContainersSystem(True)
  File "/work/make-checkout-workdir/test/check-application", line 2467, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-application", line 210, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 172, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/make-checkout-workdir/test/check-application", line 210, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem) failed
# 1 TEST FAILED [263s on 7851d004a55f]
not ok 28 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersSystem [ND@7]

First occurrence: 2024-11-07T18:01:12.004991+00:00 | revision 7f9862c85913e911574de69080755e384fc9707c
Times recorded: 1
Latest occurrences:

  • 2024-11-07T18:01:12.004991+00:00 | revision 7f9862c85913e911574de69080755e384fc9707c
# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 49033
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 49033.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
time="2024-11-07T17:57:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Unhandled event type  container history
time="2024-11-07T17:57:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
----- user containers -----
timeout: sending signal TERM to command ‘/work/make-checkout-workdir/test/check-application’
not ok 29 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@5]

First occurrence: 2024-11-07T18:06:52.077691+00:00 | revision 7f9862c85913e911574de69080755e384fc9707c
Times recorded: 1
Latest occurrences:

  • 2024-11-07T18:06:52.077691+00:00 | revision 7f9862c85913e911574de69080755e384fc9707c
# ----------------------------------------------------------------------
# testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 37669
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 37669.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
time="2024-11-11T14:33:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Unhandled event type  container history
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warn: Unhandled event type  system
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%224b5dbc25baf82d73fe81b976529d9fa1af9d13d26df077247878f7816e3c3b5c%22%5D%7D: received truncated HTTP response
> warn: http:///run/podman/podman.sock/v1.12/libpod/containers/ef5ca49a9f941afa14805e430a1e032bb63ff12691b5e2acbf1b8188d1d5c6ef/json?size=false: received truncated HTTP response
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warn: Failed to do Update Pod: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%224b5dbc25baf82d73fe81b976529d9fa1af9d13d26df077247878f7816e3c3b5c%22%5D%7D: received truncated HTTP response"}
> warn: Failed to do Update Pods: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response"}
> info: Object(3)
> warn: http:///run/podman/podman.sock/v1.12/libpod/containers/50178fec419defa453b8c2fc5d60290fe8cc4467774ac40c438db36bddd5c660/json?size=false: received truncated HTTP response
> info: Object(3)
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> info: Object(3)
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 2456, in testPruneUnusedContainersSystem
    self._testPruneUnusedContainersSystem(True)
  File "/work/make-checkout-workdir/test/check-application", line 2469, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-application", line 211, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 173, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/make-checkout-workdir/test/check-application", line 211, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem) failed
# 1 TEST FAILED [265s on 919e28b40657]
not ok 28 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersSystem [ND@3]

First occurrence: 2024-11-11T14:37:13.907705+00:00 | revision 2348edbfd9199b76184d74c06009ebcff30fc48e
Times recorded: 1
Latest occurrences:

  • 2024-11-11T14:37:13.907705+00:00 | revision 2348edbfd9199b76184d74c06009ebcff30fc48e
# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 35061
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 35061.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
> warn: Unhandled event type  container history
time="2024-11-11T14:32:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
time="2024-11-11T14:32:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
----- user containers -----
timeout: sending signal TERM to command ‘/work/make-checkout-workdir/test/check-application’
not ok 29 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@4]

First occurrence: 2024-11-11T14:42:32.321327+00:00 | revision 2348edbfd9199b76184d74c06009ebcff30fc48e
Times recorded: 1
Latest occurrences:

  • 2024-11-11T14:42:32.321327+00:00 | revision 2348edbfd9199b76184d74c06009ebcff30fc48e
# ----------------------------------------------------------------------
# testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 59547
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 59547.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
time="2024-11-11T15:00:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Unhandled event type  container history
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warn: Unhandled event type  system
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%222ad1c0e0a773e4eb1c851cd7939f2bc0a3cd78ca59c54f7a82d856dcdf21d517%22%5D%7D: received truncated HTTP response
> warn: http:///run/podman/podman.sock/v1.12/libpod/containers/c9321e5484e044099789ac3e2c514c0bd6afb4666525dcbdcf3b9fc020981c50/json?size=false: received truncated HTTP response
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warn: Failed to do Update Pod: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%222ad1c0e0a773e4eb1c851cd7939f2bc0a3cd78ca59c54f7a82d856dcdf21d517%22%5D%7D: received truncated HTTP response"}
> warn: Failed to do Update Pods: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response"}
> info: Object(3)
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> info: Object(3)
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 2456, in testPruneUnusedContainersSystem
    self._testPruneUnusedContainersSystem(True)
  File "/work/make-checkout-workdir/test/check-application", line 2469, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-application", line 211, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 173, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/make-checkout-workdir/test/check-application", line 211, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem) failed
# 1 TEST FAILED [262s on 089ca0ec06ea]
not ok 28 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersSystem [ND@1]

First occurrence: 2024-11-11T15:04:40.712131+00:00 | revision ee68115630c573971e5a23ccd92d255d17115fb8
Times recorded: 1
Latest occurrences:

  • 2024-11-11T15:04:40.712131+00:00 | revision ee68115630c573971e5a23ccd92d255d17115fb8
# ----------------------------------------------------------------------
# testPruneUnusedContainersUser (__main__.TestApplication.testPruneUnusedContainersUser)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 60249
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 60249.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
> warn: Unhandled event type  container history
time="2024-11-11T14:59:42Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
time="2024-11-11T14:59:42Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Th: Table headers must have an accessible name. If the Th is intended to be visually empty, pass in screenReaderText. If the Th contains only non-text, interactive content such as a checkbox or expand toggle, pass in an aria-label.
----- user containers -----
timeout: sending signal TERM to command ‘/work/make-checkout-workdir/test/check-application’
not ok 29 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersUser [ND@3]

First occurrence: 2024-11-11T15:09:32.086920+00:00 | revision ee68115630c573971e5a23ccd92d255d17115fb8
Times recorded: 1
Latest occurrences:

  • 2024-11-11T15:09:32.086920+00:00 | revision ee68115630c573971e5a23ccd92d255d17115fb8
# ----------------------------------------------------------------------
# testCreatePodUser (__main__.TestApplication.testCreatePodUser)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 52567
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 52567.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
> warn: Unhandled event type  container history
> warn: Unhandled event type  container history
----- user containers -----
timeout: sending signal TERM to command ‘/work/make-checkout-workdir/test/check-application’
not ok 12 /work/make-checkout-workdir/test/check-application TestApplication.testCreatePodUser [ND@3]

First occurrence: 2024-11-14T09:17:44.272206+00:00 | revision cf1ebbc325bbc4d4967340d4705da6584b5ec49f
Times recorded: 1
Latest occurrences:

  • 2024-11-14T09:17:44.272206+00:00 | revision cf1ebbc325bbc4d4967340d4705da6584b5ec49f
# ----------------------------------------------------------------------
# testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 38113
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 38113.
Getting image source signatures
Copying blob sha256:dee215ffc666313e1381d3e6e4299a4455503735b8df31c3fa161d2df50860a8
Copying config sha256:ed210e3e4a5bae1237f1bb44d72a05a2f1e5c6bfe7a7e73da179e2534269c459
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:efcd79a6555c3bb616e8210a62959e3962c64505efc540d46011db5b4837b43b
Copying blob sha256:4f1f16223f9d50190a92cf2b08d04f6bcaaaa78474ed0e72615e05b5d12b1650
Copying config sha256:eb7e77f38262e36399de0c9f77c92b690952c8bdb3fa2fa8abb8138af78a0331
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:1e604deea57dbda554a168861cff1238f93b8c6c69c863c43aed37d9d99c5fed
Copying blob sha256:6b83872188a9e8912bee1d43add5e9bc518601b02a14a364c0da43b0d59acf33
Copying config sha256:56a9b5a744a674481a5c034fec45ebf470a58ab844cd0da4d26b89bd27df5e36
Writing manifest to image destination
Storing signatures
Getting image source signatures
Copying blob sha256:4bc1ddfc34abe57103cf30d7d295e8ea920689ea9992000fb33c29b3fa11b50c
Copying blob sha256:a1c01e366b99afb656cec4b16561b6ab299fa471011b4414826407af3a5884f8
Copying blob sha256:414fa8d4b08681291f1df5d79769b70f8e0836fd0f3a86fa7e11f7ab9ddc4ce0
Copying blob sha256:e5dfe2b43270bc5eb6ac9021609a90c2beacae1eebc90db5b96c2b3997448511
Copying blob sha256:44bce369696406a99f5d433a09943b787a28b3912bb5b693c77345a18401e3ea
Copying config sha256:d3241e050fc981849fc396c054aa87da6b1e2d748ee46cd3e71bf89050881631
Writing manifest to image destination
Storing signatures
time="2024-11-21T17:46:31Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly"
> warn: Unhandled event type  container history
> warn: Unhandled event type  container history
----- user containers -----
CONTAINER ID  IMAGE       COMMAND     CREATED     STATUS      PORTS       NAMES
----- system containers -----
> warn: Unhandled event type  system
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%22952caa79c29905c608c546bbcb18ad5947fc217a0be90320341ad4db1d9c56f1%22%5D%7D: received truncated HTTP response
> warn: http:///run/podman/podman.sock/v1.12/libpod/containers/d40574f2af987abf79153d819df197bfc3c66b6b4fde3dca9b8fcf73f91cab7e/json?size=false: received truncated HTTP response
> warn: http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response
> warn: Failed to do Update Pod: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?filters=%7B%22id%22%3A%5B%22952caa79c29905c608c546bbcb18ad5947fc217a0be90320341ad4db1d9c56f1%22%5D%7D: received truncated HTTP response"}
> warn: Failed to do Update Pods: {"problem":"protocol-error","message":"http:///run/podman/podman.sock/v1.12/libpod/pods/json?: received truncated HTTP response"}
> info: Object(3)
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> warn: Failed to do Update Images: {"problem":"disconnected","message":"Server has closed the connection."}
> info: Object(3)
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 2456, in testPruneUnusedContainersSystem
    self._testPruneUnusedContainersSystem(True)
  File "/work/make-checkout-workdir/test/check-application", line 2469, in _testPruneUnusedContainersSystem
    notrunninginpodId = self.execute(auth, f"""
                        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-application", line 211, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on '
            podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 173, in tearDown
    self.execute(auth, "podman ps -a >&2")
  File "/work/make-checkout-workdir/test/check-application", line 211, in execute
    return self.machine.execute(cmd)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 550, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 1209, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 2115, in _communicate
    ready = selector.select(timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/selectors.py", line 415, in select
    fd_event_list = self._selector.poll(timeout)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem) failed
# 1 TEST FAILED [263s on 1c78734b4bf6]
not ok 28 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersSystem [ND@7]

First occurrence: 2024-11-21T17:50:44.737633+00:00 | revision 378924bedfef315b36eb369424e2a58066796f67
Times recorded: 1
Latest occurrences:

  • 2024-11-21T17:50:44.737633+00:00 | revision 378924bedfef315b36eb369424e2a58066796f67
podman run --name inpod --pod pod -tid localhost/test-busybox sh -c 'exit 1''

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-application", line 173, in tearDown
    self.execute(auth, "podman ps -a >&2")
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-application", line 211, in execute
    return self.machine.execute(cmd)
           ~~~~~~~~~~~~~~~~~~~~^^^^^
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
                         input=input.encode("UTF-8") if input else b'',
                         stdout=stdout, check=check)
  File "/usr/lib64/python3.13/subprocess.py", line 556, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
                     ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.13/subprocess.py", line 1219, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
                     ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.13/subprocess.py", line 2122, in _communicate
    ready = selector.select(timeout)
  File "/usr/lib64/python3.13/selectors.py", line 398, in select
    fd_event_list = self._selector.poll(timeout)
  File "/work/make-checkout-workdir/bots/machine/machine_core/timeout.py", line 45, in handle_timeout
    raise RuntimeError(self.error_message)
RuntimeError: Timed out on 'podman ps -a >&2'

# Result testPruneUnusedContainersSystem (__main__.TestApplication.testPruneUnusedContainersSystem) failed
# 1 TEST FAILED [261s on 20a39cf5a83f]
not ok 28 /work/make-checkout-workdir/test/check-application TestApplication.testPruneUnusedContainersSystem [ND@4]

First occurrence: 2024-12-26T23:01:48.231507+00:00 | revision 99a5b13
Times recorded: 1
Latest occurrences:

  • 2024-12-26T23:01:48.231507+00:00 | revision 99a5b13

jelly pushed a commit that referenced this issue Jun 16, 2023
@martinpitt @jelly
naughty: podman container hang #4829 affects ubuntu-2204 as well
8be95f0
@martinpitt martinpitt mentioned this issue Jun 23, 2023
Merged
2 tasks
martinpitt added a commit to martinpitt/bots that referenced this issue Jun 23, 2023
@martinpitt
naughty: Unify the two patterns for cockpit-project#4829
1d1ff2a 
They only differ in the test name suffix, use a glob to catch them both.

Also add the test file. Not important, but keeps the pattern consistent
with others.
martinpitt added a commit to martinpitt/bots that referenced this issue Jun 23, 2023
@martinpitt
naughty: Fix cockpit-project#4829 pattern
ade8125 
cockpit-project/cockpit-podman@85b116af6b65f0d
changed the formatting of the `podman run` command. Adjust the pattern
accordingly.
jelly pushed a commit that referenced this issue Jun 23, 2023
@martinpitt @jelly
naughty: Unify the two patterns for #4829
0c27670 
They only differ in the test name suffix, use a glob to catch them both.

Also add the test file. Not important, but keeps the pattern consistent
with others.
@jelly jelly closed this as completed in 39f3859 Jun 23, 2023
@martinpitt martinpitt reopened this Jul 3, 2023
martinpitt added a commit to martinpitt/bots that referenced this issue Jul 3, 2023
@martinpitt
naughty: Add variation for cockpit-project#4829 podman hang
20802e7 
This can also happen for the "inpodrunning" part of the test, where the
pod name and the executed command are different.
@martinpitt martinpitt mentioned this issue Jul 3, 2023
Merged
allisonkarlitskaya pushed a commit that referenced this issue Jul 3, 2023
@martinpitt @allisonkarlitskaya
naughty: Add variation for #4829 podman hang
dab89cf 
This can also happen for the "inpodrunning" part of the test, where the
pod name and the executed command are different.
@martinpitt martinpitt mentioned this issue Jul 5, 2023
Closed
martinpitt added a commit to martinpitt/bots that referenced this issue Jul 5, 2023
@martinpitt
naughty: Add another variation of cockpit-project#4829
81f1d64 
This also happens in testCreatePod{User,System}
martinpitt added a commit that referenced this issue Jul 5, 2023
@martinpitt
naughty: Add another variation of #4829
e3d3035 
This also happens in testCreatePod{User,System}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
knownissue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jelly @martinpitt @cockpituous