Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

nfs-utils 2.8.1-1.rc2 regression: rpc.statd crashes with SIGABRT in nsm_atomic_write() #7137

Closed
martinpitt opened this issue Nov 25, 2024 · 4 comments · Fixed by #7282
Closed

nfs-utils 2.8.1-1.rc2 regression: rpc.statd crashes with SIGABRT in nsm_atomic_write() #7137

martinpitt opened this issue Nov 25, 2024 · 4 comments · Fixed by #7282
Labels
knownissue

Comments

@martinpitt
Copy link
Member

Downstream report: https://bugzilla.redhat.com/show_bug.cgi?id=2328627
martinpitt added a commit to martinpitt/bots that referenced this issue Nov 25, 2024
@martinpitt
naughty: Add pattern for NFS rpc.statd regression
c5228b9 
Known issue cockpit-project#7137
Downstream report: https://bugzilla.redhat.com/show_bug.cgi?id=2328627
martinpitt added a commit to martinpitt/bots that referenced this issue Nov 25, 2024
@martinpitt
naughty: Add pattern for NFS rpc.statd regression
9929253 
Known issue cockpit-project#7137
Downstream report: https://bugzilla.redhat.com/show_bug.cgi?id=2328627

Fixes cockpit-project/cockpit#21312
@martinpitt martinpitt mentioned this issue Nov 25, 2024
Merged
@cockpituous
Copy link
Contributor

fedora-40
Ooops, it happened again

# ----------------------------------------------------------------------
# testStorageVolumesCreate (__main__.TestMachinesStoragePools.testStorageVolumesCreate)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 41097
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 41097.
error: Failed to start pool nfs-pool
error: internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 127.0.0.1:/var/lib/cockpittest/mnt_exports /var/lib/cockpittest/nfs_pool) unexpected exit status 32: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/var/lib/cockpittest/mnt_exports failed, reason given by server: No such file or directory

Stopping 'virtstoraged.service', but its triggering units are still active:
virtstoraged-ro.socket, virtstoraged-admin.socket, virtstoraged.socket
Stopping 'virtnetworkd.service', but its triggering units are still active:
virtnetworkd.socket, virtnetworkd-ro.socket, virtnetworkd-admin.socket
Stopping 'virtqemud.service', but its triggering units are still active:
virtqemud-admin.socket, virtqemud-ro.socket, virtqemud.socket
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 522, in testStorageVolumesCreate
    m.execute(f"""
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2401', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-811', '127.0.0.2', 'set -e;', '\n        systemctl restart nfs-server\n        virsh pool-define-as nfs-pool --type netfs --target /var/lib/cockpittest/nfs_pool --source-host 127.0.0.1 --source-path /var/lib/cockpittest/mnt_exports\n        virsh pool-start nfs-pool\n        ')' returned non-zero exit status 1.

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/machineslib.py", line 543, in tearDown
    if b.valid and b.is_present("#button.alert-link.more-button"):
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 804, in is_present
    return self.call_js_func('ph_is_present', selector)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 445, in call_js_func
    return self.eval_js("%s(%s)" % (func, ','.join(map(jsquote, args))))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 436, in eval_js
    return self.bidi("script.evaluate", expression=code, quiet=no_trace,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 324, in bidi
    raise Error(str(e)) from None
testlib.Error: ReferenceError: ph_is_present is not defined

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/machineslib.py", line 480, in <lambda>
    self.addCleanup(lambda: not self.browser.valid or self.browser.logout())
                                                      ^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1015, in logout
    self.wait_visible("#toggle-menu")
  File "/work/make-checkout-workdir/test/common/testlib.py", line 816, in wait_visible
    self._wait_present(selector)
  File "/work/make-checkout-workdir/test/common/testlib.py", line 807, in _wait_present
    self.wait_js_func('ph_is_present', selector)
  File "/work/make-checkout-workdir/test/common/testlib.py", line 801, in wait_js_func
    self.wait_js_cond("%s(%s)" % (func, ','.join(map(jsquote, args))))
  File "/work/make-checkout-workdir/test/common/testlib.py", line 798, in wait_js_cond
    raise Error(f"timeout\nwait_js_cond({cond}): {last_error.msg}") from None
testlib.Error: timeout
wait_js_cond(ph_is_present("#toggle-menu")): ReferenceError: ph_wait_cond is not defined

# Result testStorageVolumesCreate (__main__.TestMachinesStoragePools.testStorageVolumesCreate) failed
# 1 TEST FAILED [38s on 7043e6d851f4]
not ok 89 /work/make-checkout-workdir/test/check-machines-storage-pools TestMachinesStoragePools.testStorageVolumesCreate [ND@2]

First occurrence: 2024-11-25T08:54:07.733100+00:00 | revision 9929253
Times recorded: 1
Latest occurrences:

  • 2024-11-25T08:54:07.733100+00:00 | revision 9929253

@cockpituous
Copy link
Contributor

fedora-40
Ooops, it happened again

# ----------------------------------------------------------------------
# testStoragePoolsCreate (__main__.TestMachinesStoragePools.testStoragePoolsCreate)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 53895
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 53895.
> error: Scrollbar test exception: TypeError: Cannot read properties of null (reading 'appendChild')
> info: failed to fetch lastlog2: Object(5)
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
Information: You may need to update /etc/fstab.

> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
Information: You may need to update /etc/fstab.

Warning: The resulting partition is not properly aligned for best performance: 40s % 2048s != 0s
mke2fs 1.47.0 (5-Feb-2023)

Filesystem too small for a journal
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
Process 2450 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 2450:
#0  0x00007f54db73ecd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f54db6e5c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f54db6cd902 abort (libc.so.6 + 0x28902)
#3  0x00007f54db6ce767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f54db7cd0a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f54db7cca44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f54db7ce235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000557b34cde7b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000557b34cdc230 main (rpc.statd + 0x6230)
#9  0x00007f54db6cf088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f54db6cf14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000557b34cdcaf5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Wrote JS log to TestMachinesStoragePools-testStoragePoolsCreate-fedora-40-127.0.0.2-2701-FAIL.js.log
Journal extracted to TestMachinesStoragePools-testStoragePoolsCreate-fedora-40-127.0.0.2-2701-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestMachinesStoragePools-testStoragePoolsCreate-fedora-40-127.0.0.2-2701-FAIL.core
Stopping 'virtstoraged.service', but its triggering units are still active:
virtstoraged.socket, virtstoraged-ro.socket, virtstoraged-admin.socket
Stopping 'virtnetworkd.service', but its triggering units are still active:
virtnetworkd.socket, virtnetworkd-admin.socket, virtnetworkd-ro.socket
Stopping 'virtqemud.service', but its triggering units are still active:
virtqemud-admin.socket, virtqemud-ro.socket, virtqemud.socket
umount: /dev/sda: not mounted.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/machineslib.py", line 554, in tearDown
    super().tearDown()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1913, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2176, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 2450 (rpc.statd) of user 0 dumped core.

# Result testStoragePoolsCreate (__main__.TestMachinesStoragePools.testStoragePoolsCreate) failed
# 1 TEST FAILED [81s on 7043e6d851f4]
not ok 87 /work/make-checkout-workdir/test/check-machines-storage-pools TestMachinesStoragePools.testStoragePoolsCreate [ND@4]

First occurrence: 2024-11-25T08:54:50.531967+00:00 | revision 9929253
Times recorded: 1
Latest occurrences:

  • 2024-11-25T08:54:50.531967+00:00 | revision 9929253

@cockpituous
Copy link
Contributor

cockpituous commented Nov 25, 2024 •
edited
Loading

fedora-40
Ooops, it happened again

# ----------------------------------------------------------------------
# testNfsClient (__main__.TestStorageNfs.testNfsClient)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 37101
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 37101.
> info: failed to fetch lastlog2: Object(5)
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates-testing': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates-testing': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> warn: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/usr/share failed, reason given by server: No such file or directory
WARNING: Waiting for ph_is_present("#dialog .pf-v5-c-alert.pf-m-danger") took 11.5 seconds, which is 76% of the timeout.
Process 13138 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 13138:
#0  0x00007fc944a0dcd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007fc9449b4c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007fc94499c902 abort (libc.so.6 + 0x28902)
#3  0x00007fc94499d767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007fc944a9c0a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007fc944a9ba44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007fc944a9d235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000556dd33fe7b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000556dd33fc230 main (rpc.statd + 0x6230)
#9  0x00007fc94499e088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007fc94499e14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000556dd33fcaf5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 13404 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 13404:
#0  0x00007f2e53b9bcd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f2e53b42c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f2e53b2a902 abort (libc.so.6 + 0x28902)
#3  0x00007f2e53b2b767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f2e53c2a0a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f2e53c29a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f2e53c2b235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000561f6a2d87b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000561f6a2d6230 main (rpc.statd + 0x6230)
#9  0x00007f2e53b2c088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f2e53b2c14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000561f6a2d6af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 13414 (rpc.statd) of user 0 terminated abnormally without generating a coredump.
Wrote JS log to TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2201-FAIL.js.log
Journal extracted to TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2201-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2201-FAIL.core
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1934, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2197, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 13138 (rpc.statd) of user 0 dumped core.

# Result testNfsClient (__main__.TestStorageNfs.testNfsClient) failed
# 1 TEST FAILED [32s on 7872b9e42617]
not ok 261 test/verify/check-storage-nfs TestStorageNfs.testNfsClient [ND@0]

First occurrence: 2024-11-28T01:43:07.880346+00:00 | revision 7090fab7372ef7e87e508d207e6468ba76983f9f
Times recorded: 1
Latest occurrences:

  • 2024-11-28T01:43:07.880346+00:00 | revision 7090fab7372ef7e87e508d207e6468ba76983f9f
# ----------------------------------------------------------------------
# testStoragePoolsDeletion (__main__.TestMachinesStoragePools.testStoragePoolsDeletion)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 47855
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 47855.
Information: You may need to update /etc/fstab.

> error: Scrollbar test exception: TypeError: Cannot read properties of null (reading 'appendChild')
> info: failed to fetch lastlog2: Object(5)
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> error: Scrollbar test exception: TypeError: Cannot read properties of null (reading 'appendChild')
> info: failed to fetch lastlog2: Object(5)
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> error: Scrollbar test exception: TypeError: Cannot read properties of null (reading 'appendChild')
> info: failed to fetch lastlog2: Object(5)
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
error: Failed to start pool nfs-pool-1
error: internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 127.0.0.1:/var/lib/cockpittest/mnt_exports /var/lib/cockpittest/nfs_pool) unexpected exit status 32: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/var/lib/cockpittest/mnt_exports failed, reason given by server: No such file or directory

Wrote subVmTest1 XML to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-subVmTest1.xml
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 1000, in testStoragePoolsDeletion
    activate=True).execute()
                   ^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 871, in execute
    self.create()
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 891, in create
    m.execute(f"virsh pool-start {self.name}")
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2501', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-831', '127.0.0.2', 'set -e;', 'virsh pool-start nfs-pool-1')' returned non-zero exit status 1.

Wrote screenshot to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.png
Wrote HTML dump to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.html
Wrote JS log to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.js.log
Journal extracted to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.core
Process 2726 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 2726:
#0  0x00007f60c9f19cd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f60c9ec0c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f60c9ea8902 abort (libc.so.6 + 0x28902)
#3  0x00007f60c9ea9767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f60c9fa80a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f60c9fa7a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f60c9fa9235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x00005630e863a7b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x00005630e8638230 main (rpc.statd + 0x6230)
#9  0x00007f60c9eaa088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f60c9eaa14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x00005630e8638af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 4375 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 4375:
#0  0x00007fa66dbaecd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007fa66db55c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007fa66db3d902 abort (libc.so.6 + 0x28902)
#3  0x00007fa66db3e767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007fa66dc3d0a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007fa66dc3ca44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007fa66dc3e235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000560c379247b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000560c37922230 main (rpc.statd + 0x6230)
#9  0x00007fa66db3f088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007fa66db3f14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000560c37922af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 4383 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 4383:
#0  0x00007fc7417a4cd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007fc74174bc5e raise (libc.so.6 + 0x40c5e)
#2  0x00007fc741733902 abort (libc.so.6 + 0x28902)
#3  0x00007fc741734767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007fc7418330a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007fc741832a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007fc741834235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000560b8aab67b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000560b8aab4230 main (rpc.statd + 0x6230)
#9  0x00007fc741735088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007fc74173514b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000560b8aab4af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Wrote JS log to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.js.log
Journal extracted to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.core
> warn: transport closed: disconnected
iscsiadm: No records found
Stopping 'virtstoraged.service', but its triggering units are still active:
virtstoraged.socket, virtstoraged-ro.socket, virtstoraged-admin.socket
Stopping 'virtnetworkd.service', but its triggering units are still active:
virtnetworkd-ro.socket, virtnetworkd-admin.socket, virtnetworkd.socket
Stopping 'virtqemud.service', but its triggering units are still active:
virtqemud.socket, virtqemud-ro.socket, virtqemud-admin.socket
umount: /dev/sda: not mounted.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 1000, in testStoragePoolsDeletion
    activate=True).execute()
                   ^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 871, in execute
    self.create()
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 891, in create
    m.execute(f"virsh pool-start {self.name}")
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2501', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-831', '127.0.0.2', 'set -e;', 'virsh pool-start nfs-pool-1')' returned non-zero exit status 1.

Traceback (most recent call last):
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2501', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-831', '127.0.0.2', 'set -e;', 'targetcli /iscsi delete iqn.2019-09.cockpit.lan; iscsiadm -m node -o delete')' returned non-zero exit status 21.

# Result testStoragePoolsDeletion (__main__.TestMachinesStoragePools.testStoragePoolsDeletion) failed
# 1 TEST FAILED [83s on 703ad7264c31]
not ok 88 /work/make-checkout-workdir/test/check-machines-storage-pools TestMachinesStoragePools.testStoragePoolsDeletion [ND@3]

First occurrence: 2024-11-28T02:28:46.355550+00:00 | revision de58158754007f6fa92f9275ea547c5a943306bc
Times recorded: 1
Latest occurrences:

  • 2024-11-28T02:28:46.355550+00:00 | revision de58158754007f6fa92f9275ea547c5a943306bc
# ----------------------------------------------------------------------
# testAddDiskNFS (__main__.TestMachinesDisks.testAddDiskNFS)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 46185
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 46185.
Created symlink /run/systemd/system/setroubleshootd.service → /dev/null.
error: Failed to start pool nfs-pool
error: internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 127.0.0.1:/var/lib/cockpittest/mnt_exports /var/lib/cockpittest/nfs_pool) unexpected exit status 32: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/var/lib/cockpittest/mnt_exports failed, reason given by server: No such file or directory

Stopping 'virtstoraged.service', but its triggering units are still active:
virtstoraged-admin.socket, virtstoraged-ro.socket, virtstoraged.socket
Stopping 'virtnetworkd.service', but its triggering units are still active:
virtnetworkd-ro.socket, virtnetworkd-admin.socket, virtnetworkd.socket
Stopping 'virtqemud.service', but its triggering units are still active:
virtqemud-admin.socket, virtqemud-ro.socket, virtqemud.socket
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-machines-disks", line 887, in testAddDiskNFS
    m.execute(f"""
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '3001', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-17505', '127.0.0.2', 'set -e;', '\n        systemctl restart nfs-server\n        virsh pool-define-as nfs-pool --type netfs --target /var/lib/cockpittest/nfs_pool                 --source-host 127.0.0.1 --source-path /var/lib/cockpittest/mnt_exports\n        virsh pool-start nfs-pool\n        ')' returned non-zero exit status 1.

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/machineslib.py", line 560, in tearDown
    if b.valid and b.is_present("#button.alert-link.more-button"):
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 809, in is_present
    return self.call_js_func('ph_is_present', selector)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 446, in call_js_func
    return self.eval_js("%s(%s)" % (func, ','.join(map(jsquote, args))))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 437, in eval_js
    return self.bidi("script.evaluate", expression=code, quiet=no_trace,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 325, in bidi
    raise Error(str(e)) from None
testlib.Error: ReferenceError: ph_is_present is not defined

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/machineslib.py", line 497, in <lambda>
    self.addCleanup(lambda: not self.browser.valid or self.browser.logout())
                                                      ^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1020, in logout
    self.wait_visible("#toggle-menu")
  File "/work/make-checkout-workdir/test/common/testlib.py", line 821, in wait_visible
    self._wait_present(selector)
  File "/work/make-checkout-workdir/test/common/testlib.py", line 812, in _wait_present
    self.wait_js_func('ph_is_present', selector)
  File "/work/make-checkout-workdir/test/common/testlib.py", line 806, in wait_js_func
    self.wait_js_cond("%s(%s)" % (func, ','.join(map(jsquote, args))))
  File "/work/make-checkout-workdir/test/common/testlib.py", line 803, in wait_js_cond
    raise Error(f"timeout\nwait_js_cond({cond}): {last_error.msg}") from None
testlib.Error: timeout
wait_js_cond(ph_is_present("#toggle-menu")): ReferenceError: ph_wait_cond is not defined

# Result testAddDiskNFS (__main__.TestMachinesDisks.testAddDiskNFS) failed
# 1 TEST FAILED [27s on 703ad7264c31]
not ok 26 /work/make-checkout-workdir/test/check-machines-disks TestMachinesDisks.testAddDiskNFS [ND@7]

First occurrence: 2024-11-28T02:33:24.404591+00:00 | revision de58158754007f6fa92f9275ea547c5a943306bc
Times recorded: 1
Latest occurrences:

  • 2024-11-28T02:33:24.404591+00:00 | revision de58158754007f6fa92f9275ea547c5a943306bc
# ----------------------------------------------------------------------
# testNfsClient (__main__.TestStorageNfs.testNfsClient)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 55041
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 55041.
> info: failed to fetch lastlog2: Object(5)
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates-testing': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates-testing': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> warn: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/usr/share failed, reason given by server: No such file or directory
WARNING: Waiting for ph_is_present("#dialog .pf-v5-c-alert.pf-m-danger") took 10.8 seconds, which is 71% of the timeout.
Process 20036 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 20036:
#0  0x00007fc18a75dcd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007fc18a704c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007fc18a6ec902 abort (libc.so.6 + 0x28902)
#3  0x00007fc18a6ed767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007fc18a7ec0a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007fc18a7eba44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007fc18a7ed235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x00005637804a07b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x000056378049e230 main (rpc.statd + 0x6230)
#9  0x00007fc18a6ee088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007fc18a6ee14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x000056378049eaf5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 20286 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 20286:
#0  0x00007f123bbe9cd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f123bb90c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f123bb78902 abort (libc.so.6 + 0x28902)
#3  0x00007f123bb79767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f123bc780a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f123bc77a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f123bc79235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000557a0b5277b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000557a0b525230 main (rpc.statd + 0x6230)
#9  0x00007f123bb7a088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f123bb7a14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000557a0b525af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 20295 (rpc.statd) of user 0 terminated abnormally without generating a coredump.
Wrote JS log to TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2401-FAIL.js.log
Journal extracted to TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2401-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2401-FAIL.core
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1934, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2197, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 20036 (rpc.statd) of user 0 dumped core.

# Result testNfsClient (__main__.TestStorageNfs.testNfsClient) failed
# 1 TEST FAILED [32s on 3358df98331c]
not ok 261 test/verify/check-storage-nfs TestStorageNfs.testNfsClient [ND@2]

First occurrence: 2024-11-29T01:43:48.264693+00:00 | revision ab76818721182151b95a6dd721414cea625a67cf
Times recorded: 1
Latest occurrences:

  • 2024-11-29T01:43:48.264693+00:00 | revision ab76818721182151b95a6dd721414cea625a67cf
# ----------------------------------------------------------------------
# testStoragePoolsDeletion (__main__.TestMachinesStoragePools.testStoragePoolsDeletion)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 44683
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 44683.
Information: You may need to update /etc/fstab.

> error: Scrollbar test exception: TypeError: Cannot read properties of null (reading 'appendChild')
> info: failed to fetch lastlog2: Object(5)
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> error: Scrollbar test exception: TypeError: Cannot read properties of null (reading 'appendChild')
> info: failed to fetch lastlog2: Object(5)
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: GET_STORAGE_POOL action failed for path /org/libvirt/QEMU/storagepool/_5a512141_3bb8_4f25_9edb_29bd4f7c7935 Storage pool not found: no storage pool with matching uuid '5a512141-3bb8-4f25-9edb-29bd4f7c7935'
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> error: Scrollbar test exception: TypeError: Cannot read properties of null (reading 'appendChild')
> info: failed to fetch lastlog2: Object(5)
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
> warn: One of aria-label or aria-labelledby properties should be passed when using the progress component without a title.
error: Failed to start pool nfs-pool-1
error: internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 127.0.0.1:/var/lib/cockpittest/mnt_exports /var/lib/cockpittest/nfs_pool) unexpected exit status 32: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/var/lib/cockpittest/mnt_exports failed, reason given by server: No such file or directory

Wrote subVmTest1 XML to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-subVmTest1.xml
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 1000, in testStoragePoolsDeletion
    activate=True).execute()
                   ^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 871, in execute
    self.create()
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 891, in create
    m.execute(f"virsh pool-start {self.name}")
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2501', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-831', '127.0.0.2', 'set -e;', 'virsh pool-start nfs-pool-1')' returned non-zero exit status 1.

Wrote screenshot to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.png
Wrote HTML dump to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.html
Wrote JS log to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.js.log
Journal extracted to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.core
Process 2729 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 2729:
#0  0x00007f6e0e81acd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f6e0e7c1c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f6e0e7a9902 abort (libc.so.6 + 0x28902)
#3  0x00007f6e0e7aa767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f6e0e8a90a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f6e0e8a8a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f6e0e8aa235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x000055db5e3c37b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x000055db5e3c1230 main (rpc.statd + 0x6230)
#9  0x00007f6e0e7ab088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f6e0e7ab14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x000055db5e3c1af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 4378 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 4378:
#0  0x00007fe72a32acd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007fe72a2d1c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007fe72a2b9902 abort (libc.so.6 + 0x28902)
#3  0x00007fe72a2ba767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007fe72a3b90a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007fe72a3b8a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007fe72a3ba235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000558aba2ed7b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000558aba2eb230 main (rpc.statd + 0x6230)
#9  0x00007fe72a2bb088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007fe72a2bb14b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000558aba2ebaf5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 4386 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 4386:
#0  0x00007f4c14ff2cd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f4c14f99c5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f4c14f81902 abort (libc.so.6 + 0x28902)
#3  0x00007f4c14f82767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f4c150810a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f4c15080a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f4c15082235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x00005623e41547b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x00005623e4152230 main (rpc.statd + 0x6230)
#9  0x00007f4c14f83088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f4c14f8314b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x00005623e4152af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Wrote JS log to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.js.log
Journal extracted to TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestMachinesStoragePools-testStoragePoolsDeletion-fedora-40-127.0.0.2-2501-FAIL.core
> warn: transport closed: disconnected
iscsiadm: No records found
Stopping 'virtstoraged.service', but its triggering units are still active:
virtstoraged.socket, virtstoraged-admin.socket, virtstoraged-ro.socket
Stopping 'virtnetworkd.service', but its triggering units are still active:
virtnetworkd-admin.socket, virtnetworkd.socket, virtnetworkd-ro.socket
Stopping 'virtqemud.service', but its triggering units are still active:
virtqemud-admin.socket, virtqemud.socket, virtqemud-ro.socket
umount: /dev/sda: not mounted.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 1000, in testStoragePoolsDeletion
    activate=True).execute()
                   ^^^^^^^^^
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 871, in execute
    self.create()
  File "/work/make-checkout-workdir/test/check-machines-storage-pools", line 891, in create
    m.execute(f"virsh pool-start {self.name}")
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2501', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-831', '127.0.0.2', 'set -e;', 'virsh pool-start nfs-pool-1')' returned non-zero exit status 1.

Traceback (most recent call last):
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2501', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-831', '127.0.0.2', 'set -e;', 'targetcli /iscsi delete iqn.2019-09.cockpit.lan; iscsiadm -m node -o delete')' returned non-zero exit status 21.

# Result testStoragePoolsDeletion (__main__.TestMachinesStoragePools.testStoragePoolsDeletion) failed
# 1 TEST FAILED [85s on ade55545cbd3]
not ok 88 /work/make-checkout-workdir/test/check-machines-storage-pools TestMachinesStoragePools.testStoragePoolsDeletion [ND@3]

First occurrence: 2024-11-29T02:28:40.537340+00:00 | revision 7629de1e4af5906aa3f8a626343a73597b4c5cd5
Times recorded: 1
Latest occurrences:

  • 2024-11-29T02:28:40.537340+00:00 | revision 7629de1e4af5906aa3f8a626343a73597b4c5cd5
# ----------------------------------------------------------------------
# testAddDiskNFS (__main__.TestMachinesDisks.testAddDiskNFS)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 38017
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 38017.
Created symlink /run/systemd/system/setroubleshootd.service → /dev/null.
error: Failed to start pool nfs-pool
error: internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 127.0.0.1:/var/lib/cockpittest/mnt_exports /var/lib/cockpittest/nfs_pool) unexpected exit status 32: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/var/lib/cockpittest/mnt_exports failed, reason given by server: No such file or directory

Stopping 'virtstoraged.service', but its triggering units are still active:
virtstoraged-ro.socket, virtstoraged.socket, virtstoraged-admin.socket
Stopping 'virtnetworkd.service', but its triggering units are still active:
virtnetworkd-admin.socket, virtnetworkd.socket, virtnetworkd-ro.socket
Stopping 'virtqemud.service', but its triggering units are still active:
virtqemud.socket, virtqemud-admin.socket, virtqemud-ro.socket
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/check-machines-disks", line 887, in testAddDiskNFS
    m.execute(f"""
  File "/work/make-checkout-workdir/bots/machine/machine_core/ssh_connection.py", line 327, in execute
    res = subprocess.run(command_line,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('env', '-u', 'LANGUAGE', 'LC_ALL=C', 'ssh', '-p', '2501', '-o', 'BatchMode=yes', '-o', 'IdentitiesOnly=yes', '-o', 'PKCS11Provider=none', '-o', 'StrictHostKeyChecking=no', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'LogLevel=ERROR', '-l', 'root', '-o', 'ControlPath=/tmp/.cockpit-test-resources/ssh-%C-17574', '127.0.0.2', 'set -e;', '\n        systemctl restart nfs-server\n        virsh pool-define-as nfs-pool --type netfs --target /var/lib/cockpittest/nfs_pool                 --source-host 127.0.0.1 --source-path /var/lib/cockpittest/mnt_exports\n        virsh pool-start nfs-pool\n        ')' returned non-zero exit status 1.

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/machineslib.py", line 560, in tearDown
    if b.valid and b.is_present("#button.alert-link.more-button"):
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 809, in is_present
    return self.call_js_func('ph_is_present', selector)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 446, in call_js_func
    return self.eval_js("%s(%s)" % (func, ','.join(map(jsquote, args))))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 437, in eval_js
    return self.bidi("script.evaluate", expression=code, quiet=no_trace,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 325, in bidi
    raise Error(str(e)) from None
testlib.Error: ReferenceError: ph_is_present is not defined

Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/machineslib.py", line 497, in <lambda>
    self.addCleanup(lambda: not self.browser.valid or self.browser.logout())
                                                      ^^^^^^^^^^^^^^^^^^^^^
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1020, in logout
    self.wait_visible("#toggle-menu")
  File "/work/make-checkout-workdir/test/common/testlib.py", line 821, in wait_visible
    self._wait_present(selector)
  File "/work/make-checkout-workdir/test/common/testlib.py", line 812, in _wait_present
    self.wait_js_func('ph_is_present', selector)
  File "/work/make-checkout-workdir/test/common/testlib.py", line 806, in wait_js_func
    self.wait_js_cond("%s(%s)" % (func, ','.join(map(jsquote, args))))
  File "/work/make-checkout-workdir/test/common/testlib.py", line 803, in wait_js_cond
    raise Error(f"timeout\nwait_js_cond({cond}): {last_error.msg}") from None
testlib.Error: timeout
wait_js_cond(ph_is_present("#toggle-menu")): ReferenceError: ph_wait_cond is not defined

# Result testAddDiskNFS (__main__.TestMachinesDisks.testAddDiskNFS) failed
# 1 TEST FAILED [26s on ade55545cbd3]
not ok 26 /work/make-checkout-workdir/test/check-machines-disks TestMachinesDisks.testAddDiskNFS [ND@3]

First occurrence: 2024-11-29T02:33:49.143408+00:00 | revision 7629de1e4af5906aa3f8a626343a73597b4c5cd5
Times recorded: 1
Latest occurrences:

  • 2024-11-29T02:33:49.143408+00:00 | revision 7629de1e4af5906aa3f8a626343a73597b4c5cd5
# ----------------------------------------------------------------------
# testNfsClient (__main__.TestStorageNfs.testNfsClient)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 53543
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 53543.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates-testing': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> info: failed to fetch lastlog2: Object(5)
> warn: loading available updates failed: {"detail":"cannot update repo 'updates-testing': Cannot prepare internal mirrorlist: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=updates-testing-f40&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> warn: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/usr/share failed, reason given by server: No such file or directory
WARNING: Waiting for ph_is_present("#dialog .pf-v5-c-alert.pf-m-danger") took 11.5 seconds, which is 76% of the timeout.
Process 25333 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 25333:
#0  0x00007f6fa27d7cd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f6fa277ec5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f6fa2766902 abort (libc.so.6 + 0x28902)
#3  0x00007f6fa2767767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f6fa28660a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f6fa2865a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f6fa2867235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x0000560debf757b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x0000560debf73230 main (rpc.statd + 0x6230)
#9  0x00007f6fa2768088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f6fa276814b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x0000560debf73af5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 25795 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc40.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-2.fc40.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc40.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-3.fc40.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-3.fc40.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-2.fc40.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.0-5.fc40.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-2.fc40.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-2.fc40.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc40.x86_64
Module libcap.so.2 from rpm libcap-2.69-8.fc40.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc40.x86_64
Stack trace of thread 25795:
#0  0x00007f53cc2f6cd4 __pthread_kill_implementation (libc.so.6 + 0x99cd4)
#1  0x00007f53cc29dc5e raise (libc.so.6 + 0x40c5e)
#2  0x00007f53cc285902 abort (libc.so.6 + 0x28902)
#3  0x00007f53cc286767 __libc_message_impl.cold (libc.so.6 + 0x29767)
#4  0x00007f53cc3850a9 __fortify_fail (libc.so.6 + 0x1280a9)
#5  0x00007f53cc384a44 __chk_fail (libc.so.6 + 0x127a44)
#6  0x00007f53cc386235 __snprintf_chk (libc.so.6 + 0x129235)
#7  0x00005567090907b6 nsm_atomic_write (rpc.statd + 0x87b6)
#8  0x000055670908e230 main (rpc.statd + 0x6230)
#9  0x00007f53cc287088 __libc_start_call_main (libc.so.6 + 0x2a088)
#10 0x00007f53cc28714b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2a14b)
#11 0x000055670908eaf5 _start (rpc.statd + 0x6af5)
ELF object binary architecture: AMD x86-64
Process 25811 (rpc.statd) of user 0 terminated abnormally without generating a coredump.
Wrote JS log to TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2501-FAIL.js.log
Journal extracted to TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2501-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestStorageNfs-testNfsClient-fedora-40-127.0.0.2-2501-FAIL.core
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1934, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2197, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 25333 (rpc.statd) of user 0 dumped core.

# Result testNfsClient (__main__.TestStorageNfs.testNfsClient) failed
# 1 TEST FAILED [33s on aee8b9e5180f]
not ok 261 test/verify/check-storage-nfs TestStorageNfs.testNfsClient [ND@3]

First occurrence: 2024-11-29T09:26:39.041103+00:00 | revision ab76818721182151b95a6dd721414cea625a67cf
Times recorded: 1
Latest occurrences:

  • 2024-11-29T09:26:39.041103+00:00 | revision ab76818721182151b95a6dd721414cea625a67cf

martinpitt added a commit that referenced this issue Nov 25, 2024
@martinpitt
naughty: Add pattern for NFS rpc.statd regression
b23672f 
Known issue #7137
Downstream report: https://bugzilla.redhat.com/show_bug.cgi?id=2328627

Fixes cockpit-project/cockpit#21312
@martinpitt martinpitt mentioned this issue Nov 26, 2024
Merged
@cockpituous
Copy link
Contributor

cockpituous commented Nov 26, 2024 •
edited
Loading

fedora-41
Ooops, it happened again

# ----------------------------------------------------------------------
# testNfsClient (__main__.TestStorageNfs.testNfsClient)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 34585
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 34585.
> info: failed to fetch lastlog2: Object(5)
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> warn: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/usr/share failed, reason given by server: No such file or directory
WARNING: Waiting for ph_is_present("#dialog .pf-v5-c-alert.pf-m-danger") took 10.7 seconds, which is 71% of the timeout.
Process 7820 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 7820 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc41.1.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-3.fc41.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc41.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-9.fc41.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-4.fc41.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-3.fc41.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.1-6.fc41.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-3.fc41.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc41.x86_64
Module libcap.so.2 from rpm libcap-2.70-4.fc41.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc41.x86_64
Stack trace of thread 7820:
#0  0x00007f153a06cc94 __pthread_kill_implementation (libc.so.6 + 0x72c94)
#1  0x00007f153a013d1e raise (libc.so.6 + 0x19d1e)
#2  0x00007f1539ffb942 abort (libc.so.6 + 0x1942)
#3  0x00007f1539ffc7a7 __libc_message_impl.cold (libc.so.6 + 0x27a7)
#4  0x00007f153a0faf79 __fortify_fail (libc.so.6 + 0x100f79)
#5  0x00007f153a0fa914 __chk_fail (libc.so.6 + 0x100914)
#6  0x00007f153a0fc105 __snprintf_chk (libc.so.6 + 0x102105)
#7  0x0000560b223217b6 nsm_atomic_write (rpc.statd + 0x67b6)
#8  0x0000560b2231f230 main (rpc.statd + 0x4230)
#9  0x00007f1539ffd248 __libc_start_call_main (libc.so.6 + 0x3248)
#10 0x00007f1539ffd30b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x330b)
#11 0x0000560b2231faf5 _start (rpc.statd + 0x4af5)
ELF object binary architecture: AMD x86-64
Process 8102 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 8102 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc41.1.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-3.fc41.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc41.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-9.fc41.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-4.fc41.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-3.fc41.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.1-6.fc41.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-3.fc41.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc41.x86_64
Module libcap.so.2 from rpm libcap-2.70-4.fc41.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc41.x86_64
Stack trace of thread 8102:
#0  0x00007f36af2fac94 __pthread_kill_implementation (libc.so.6 + 0x72c94)
#1  0x00007f36af2a1d1e raise (libc.so.6 + 0x19d1e)
#2  0x00007f36af289942 abort (libc.so.6 + 0x1942)
#3  0x00007f36af28a7a7 __libc_message_impl.cold (libc.so.6 + 0x27a7)
#4  0x00007f36af388f79 __fortify_fail (libc.so.6 + 0x100f79)
#5  0x00007f36af388914 __chk_fail (libc.so.6 + 0x100914)
#6  0x00007f36af38a105 __snprintf_chk (libc.so.6 + 0x102105)
#7  0x000055d0f03897b6 nsm_atomic_write (rpc.statd + 0x67b6)
#8  0x000055d0f0387230 main (rpc.statd + 0x4230)
#9  0x00007f36af28b248 __libc_start_call_main (libc.so.6 + 0x3248)
#10 0x00007f36af28b30b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x330b)
#11 0x000055d0f0387af5 _start (rpc.statd + 0x4af5)
ELF object binary architecture: AMD x86-64
Process 8112 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 8112 (rpc.statd) of user 0 terminated abnormally without generating a coredump.
Wrote JS log to TestStorageNfs-testNfsClient-fedora-41-127.0.0.2-2301-FAIL.js.log
Journal extracted to TestStorageNfs-testNfsClient-fedora-41-127.0.0.2-2301-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestStorageNfs-testNfsClient-fedora-41-127.0.0.2-2301-FAIL.core
> warn: transport closed: disconnected
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 7820 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testNfsClient (__main__.TestStorageNfs.testNfsClient) failed
# 1 TEST FAILED [30s on fc5d7dc7aee5]
not ok 66 test/verify/check-storage-nfs TestStorageNfs.testNfsClient [ND@1]

First occurrence: 2024-12-02T08:29:13.466958+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T08:29:13.466958+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
# ----------------------------------------------------------------------
# testNfsClient (__main__.TestStorageNfs.testNfsClient)
*** You are running in headless mode.
[GFX1-]: glxtest: libGL.so.1 missing
WebDriver BiDi listening on ws://127.0.0.1:41085
[GFX1-]: RenderCompositorSWGL failed mapping default framebuffer, no dt
> error: Error: Permission denied to access property "length"
> error: Error: Permission denied to access property "length"
> error: The resource from “http://127.0.0.2:9691/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9691/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9691/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9691/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> info: failed to fetch lastlog2: [object Object]
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> warn: Job for rpc-statd.service failed because the control process exited with error code.
See "systemctl status rpc-statd.service" and "journalctl -xeu rpc-statd.service" for details.
mount.nfs: rpc.statd is not running but is required for remote locking.
mount.nfs: Either use '-o nolock' to keep locks local, or start statd.
mount.nfs: mounting 127.0.0.1:/usr/share failed, reason given by server: No such file or directory
WARNING: Waiting for ph_is_present("#dialog .pf-v5-c-alert.pf-m-danger") took 13.6 seconds, which is 90% of the timeout.
Process 9471 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 9471 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc41.1.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-3.fc41.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc41.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-9.fc41.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-4.fc41.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-3.fc41.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.1-6.fc41.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-3.fc41.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc41.x86_64
Module libcap.so.2 from rpm libcap-2.70-4.fc41.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc41.x86_64
Stack trace of thread 9471:
#0  0x00007f531b3c2c94 __pthread_kill_implementation (libc.so.6 + 0x72c94)
#1  0x00007f531b369d1e raise (libc.so.6 + 0x19d1e)
#2  0x00007f531b351942 abort (libc.so.6 + 0x1942)
#3  0x00007f531b3527a7 __libc_message_impl.cold (libc.so.6 + 0x27a7)
#4  0x00007f531b450f79 __fortify_fail (libc.so.6 + 0x100f79)
#5  0x00007f531b450914 __chk_fail (libc.so.6 + 0x100914)
#6  0x00007f531b452105 __snprintf_chk (libc.so.6 + 0x102105)
#7  0x0000562f1aad87b6 nsm_atomic_write (rpc.statd + 0x67b6)
#8  0x0000562f1aad6230 main (rpc.statd + 0x4230)
#9  0x00007f531b353248 __libc_start_call_main (libc.so.6 + 0x3248)
#10 0x00007f531b35330b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x330b)
#11 0x0000562f1aad6af5 _start (rpc.statd + 0x4af5)
ELF object binary architecture: AMD x86-64
Process 9947 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 9947 (rpc.statd) of user 0 dumped core.
Module libpcre2-8.so.0 from rpm pcre2-10.44-1.fc41.1.x86_64
Module libz.so.1 from rpm zlib-ng-2.1.7-3.fc41.x86_64
Module libselinux.so.1 from rpm libselinux-3.7-5.fc41.x86_64
Module libcrypto.so.3 from rpm openssl-3.2.2-9.fc41.x86_64
Module libkeyutils.so.1 from rpm keyutils-1.6.3-4.fc41.x86_64
Module libkrb5support.so.0 from rpm krb5-1.21.3-3.fc41.x86_64
Module libcom_err.so.2 from rpm e2fsprogs-1.47.1-6.fc41.x86_64
Module libk5crypto.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libkrb5.so.3 from rpm krb5-1.21.3-3.fc41.x86_64
Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-3.fc41.x86_64
Module libtirpc.so.3 from rpm libtirpc-1.3.6-1.fc41.x86_64
Module libcap.so.2 from rpm libcap-2.70-4.fc41.x86_64
Module rpc.statd from rpm nfs-utils-2.8.1-1.rc2.fc41.x86_64
Stack trace of thread 9947:
#0  0x00007f5be2598c94 __pthread_kill_implementation (libc.so.6 + 0x72c94)
#1  0x00007f5be253fd1e raise (libc.so.6 + 0x19d1e)
#2  0x00007f5be2527942 abort (libc.so.6 + 0x1942)
#3  0x00007f5be25287a7 __libc_message_impl.cold (libc.so.6 + 0x27a7)
#4  0x00007f5be2626f79 __fortify_fail (libc.so.6 + 0x100f79)
#5  0x00007f5be2626914 __chk_fail (libc.so.6 + 0x100914)
#6  0x00007f5be2628105 __snprintf_chk (libc.so.6 + 0x102105)
#7  0x000055586c18a7b6 nsm_atomic_write (rpc.statd + 0x67b6)
#8  0x000055586c188230 main (rpc.statd + 0x4230)
#9  0x00007f5be2529248 __libc_start_call_main (libc.so.6 + 0x3248)
#10 0x00007f5be252930b __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x330b)
#11 0x000055586c188af5 _start (rpc.statd + 0x4af5)
ELF object binary architecture: AMD x86-64
Process 9957 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 9957 (rpc.statd) of user 0 terminated abnormally without generating a coredump.
Wrote JS log to TestStorageNfs-testNfsClient-fedora-41-127.0.0.2-2801-FAIL.js.log
Journal extracted to TestStorageNfs-testNfsClient-fedora-41-127.0.0.2-2801-FAIL.log.gz
Core dumps downloaded to /work/make-checkout-workdir/TestStorageNfs-testNfsClient-fedora-41-127.0.0.2-2801-FAIL.core
> warn: transport closed: disconnected
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 9471 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testNfsClient (__main__.TestStorageNfs.testNfsClient) failed
# 1 TEST FAILED [49s on 85b70384870c]
not ok 66 test/verify/check-storage-nfs TestStorageNfs.testNfsClient [ND@5]

First occurrence: 2024-12-02T08:32:39.540425+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T08:32:39.540425+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
# ----------------------------------------------------------------------
# testRootReboot (__main__.TestStorageNBDE.testRootReboot)
Error: unknown connection 'ens15'.
Error: cannot delete unknown connection(s): 'ens15'.
Error: unknown connection 'ens15'.
Error: cannot delete unknown connection(s): 'ens15'.
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 54309
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 54309.
Failed to kill unit packagekit.service: Unit packagekit.service not loaded.
Failed to reset failed state of unit packagekit.service: Unit packagekit.service not loaded.
+ parted -s /dev/sda mktable msdos
+ parted -s /dev/sda mkpart primary ext4 1M 500M
+ parted -s /dev/sda mkpart primary ext4 500M 100%
+ echo einszweidrei
+ cryptsetup luksFormat --pbkdf-memory=300 /dev/sda2
++ blkid -p /dev/sda2 -s UUID -o value
+ luks_uuid=602e73c9-02a3-44a8-b509-cb714651e3f6
+ echo einszweidrei
+ cryptsetup luksOpen --pbkdf-memory=300 /dev/sda2 luks-602e73c9-02a3-44a8-b509-cb714651e3f6
+ vgcreate root /dev/mapper/luks-602e73c9-02a3-44a8-b509-cb714651e3f6
+ lvcreate root -n root -l100%VG
+ mkfs.ext4 /dev/root/root
mke2fs 1.47.1 (20-May-2024)
+ mkdir /new-root
+ mount /dev/root/root /new-root
+ mkfs.ext4 /dev/sda1
mke2fs 1.47.1 (20-May-2024)
+ mountpoint /boot/efi
+ umount /boot/efi
+ mkdir /new-root/boot
+ mount /dev/sda1 /new-root/boot
+ tar --selinux --one-file-system -cf - --exclude /boot '--exclude=/var/tmp/*' '--exclude=/var/cache/*' '--exclude=/var/lib/mock/*' '--exclude=/var/lib/containers/*' '--exclude=/new-root/*' /
+ tar --selinux -C /new-root -xf -
tar: Removing leading `/' from member names
tar: Removing leading `/' from hard link targets
+ mountpoint /var
+ tar -C /var --selinux --one-file-system -cf - '--exclude=tmp/*' '--exclude=cache/*' '--exclude=lib/mock/*' '--exclude=lib/containers/*' .
+ tar --selinux -C /new-root/var -xf -
+ tar --one-file-system -C /boot -cf - .
+ tar -C /new-root/boot -xf -
+ umount /new-root/boot
+ mount /dev/sda1 /boot
+ echo '(hd0) /dev/sda'
+ sed -i -e s,/boot/,/, /boot/loader/entries/67070f5f5154497487bffe1249f3b091-6.11.8-300.fc41.x86_64.conf /boot/loader/entries/d54382b15c5f431c98a6aa42f3a26e5a-6.11.4-301.fc41.x86_64.conf
++ blkid -p /dev/root/root -s UUID -o value
+ uuid=3eeaa044-61fc-49b9-b520-5a8252f2c0f3
++ blkid -p /dev/sda1 -s UUID -o value
+ buuid=86e80a8b-1eb2-49fc-a869-d0843195379e
+ echo 'UUID=3eeaa044-61fc-49b9-b520-5a8252f2c0f3 / auto defaults 0 0'
+ echo 'UUID=86e80a8b-1eb2-49fc-a869-d0843195379e /boot auto defaults 0 0'
+ dracut --regenerate-all --force
+ grub2-install /dev/sda
Installing for i386-pc platform.
Installation finished. No error reported.
+ mv /boot/loader/entries /boot/loader/entries.stowed
+ test -f /etc/kernel/cmdline
+ mv /etc/kernel/cmdline /etc/kernel/cmdline.stowed
+ grub2-mkconfig -o /boot/grub2/grub.cfg
Generating grub configuration file ...
Warning: Requested serial terminal but GRUB_SERIAL_COMMAND is unspecified. Default parameters will be used.
Found Fedora Linux 41 (Cloud Edition) on /dev/mapper/root-root
Adding boot menu entry for UEFI Firmware Settings ...
done
+ mv /boot/loader/entries.stowed /boot/loader/entries
+ test -f /etc/kernel/cmdline.stowed
+ mv /etc/kernel/cmdline.stowed /etc/kernel/cmdline
+ grubby --update-kernel=ALL '--args=root=UUID=3eeaa044-61fc-49b9-b520-5a8252f2c0f3 rootflags=defaults rd.luks.uuid=602e73c9-02a3-44a8-b509-cb714651e3f6 rd.lvm.lv=root/root'
+ test -f /etc/kernel/cmdline
+ cp /etc/kernel/cmdline /new-root/etc/kernel/cmdline
> info: failed to fetch lastlog2: Object(5)
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> info: Object(4)
> info: Object(4)
> warn: transport closed: disconnected
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
> info: failed to fetch lastlog2: Object(5)
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2301-FAIL.js.log
Journal extracted to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2301-FAIL.log.gz
Journal extracted to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2302-FAIL.log.gz
rm: cannot remove '/etc/systemd/system/dnf5-automatic*.d': No such file or directory
> info: Object(4)
Failed to reset failed state of unit packagekit.service: Unit packagekit.service not loaded.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testRootReboot (__main__.TestStorageNBDE.testRootReboot) failed
# 1 TEST FAILED [278s on fc5d7dc7aee5]
not ok 37 test/verify/check-storage-luks TestStorageNBDE.testRootReboot $2

First occurrence: 2024-12-02T08:38:00.619094+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T08:38:00.619094+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
# ----------------------------------------------------------------------
# testRootReboot (__main__.TestStorageNBDE.testRootReboot)
Error: unknown connection 'ens15'.
Error: cannot delete unknown connection(s): 'ens15'.
Error: unknown connection 'ens15'.
Error: cannot delete unknown connection(s): 'ens15'.
*** You are running in headless mode.
[GFX1-]: glxtest: libGL.so.1 missing
WebDriver BiDi listening on ws://127.0.0.1:46377
[GFX1-]: RenderCompositorSWGL failed mapping default framebuffer, no dt
Failed to kill unit packagekit.service: Unit packagekit.service not loaded.
Failed to reset failed state of unit packagekit.service: Unit packagekit.service not loaded.
+ parted -s /dev/sda mktable msdos
+ parted -s /dev/sda mkpart primary ext4 1M 500M
+ parted -s /dev/sda mkpart primary ext4 500M 100%
+ echo einszweidrei
+ cryptsetup luksFormat --pbkdf-memory=300 /dev/sda2
++ blkid -p /dev/sda2 -s UUID -o value
+ luks_uuid=19dbfb23-5351-402d-85b2-f9a659d2891f
+ cryptsetup luksOpen --pbkdf-memory=300 /dev/sda2 luks-19dbfb23-5351-402d-85b2-f9a659d2891f
+ echo einszweidrei
+ vgcreate root /dev/mapper/luks-19dbfb23-5351-402d-85b2-f9a659d2891f
+ lvcreate root -n root -l100%VG
+ mkfs.ext4 /dev/root/root
mke2fs 1.47.1 (20-May-2024)
+ mkdir /new-root
+ mount /dev/root/root /new-root
+ mkfs.ext4 /dev/sda1
mke2fs 1.47.1 (20-May-2024)
+ mountpoint /boot/efi
+ umount /boot/efi
+ mkdir /new-root/boot
+ mount /dev/sda1 /new-root/boot
+ tar --selinux --one-file-system -cf - --exclude /boot '--exclude=/var/tmp/*' '--exclude=/var/cache/*' '--exclude=/var/lib/mock/*' '--exclude=/var/lib/containers/*' '--exclude=/new-root/*' /
+ tar --selinux -C /new-root -xf -
tar: Removing leading `/' from member names
tar: Removing leading `/' from hard link targets
+ mountpoint /var
+ tar -C /var --selinux --one-file-system -cf - '--exclude=tmp/*' '--exclude=cache/*' '--exclude=lib/mock/*' '--exclude=lib/containers/*' .
+ tar --selinux -C /new-root/var -xf -
+ tar --one-file-system -C /boot -cf - .
+ tar -C /new-root/boot -xf -
+ umount /new-root/boot
+ mount /dev/sda1 /boot
+ echo '(hd0) /dev/sda'
+ sed -i -e s,/boot/,/, /boot/loader/entries/67070f5f5154497487bffe1249f3b091-6.11.8-300.fc41.x86_64.conf /boot/loader/entries/d54382b15c5f431c98a6aa42f3a26e5a-6.11.4-301.fc41.x86_64.conf
++ blkid -p /dev/root/root -s UUID -o value
+ uuid=80ae5acc-51f1-43bb-8f38-66a265124463
++ blkid -p /dev/sda1 -s UUID -o value
+ buuid=29ba166b-8c15-4444-9448-261660de87cd
+ echo 'UUID=80ae5acc-51f1-43bb-8f38-66a265124463 / auto defaults 0 0'
+ echo 'UUID=29ba166b-8c15-4444-9448-261660de87cd /boot auto defaults 0 0'
+ dracut --regenerate-all --force
+ grub2-install /dev/sda
Installing for i386-pc platform.
Installation finished. No error reported.
+ mv /boot/loader/entries /boot/loader/entries.stowed
+ test -f /etc/kernel/cmdline
+ mv /etc/kernel/cmdline /etc/kernel/cmdline.stowed
+ grub2-mkconfig -o /boot/grub2/grub.cfg
Generating grub configuration file ...
Warning: Requested serial terminal but GRUB_SERIAL_COMMAND is unspecified. Default parameters will be used.
Found Fedora Linux 41 (Cloud Edition) on /dev/mapper/root-root
Adding boot menu entry for UEFI Firmware Settings ...
done
+ mv /boot/loader/entries.stowed /boot/loader/entries
+ test -f /etc/kernel/cmdline.stowed
+ mv /etc/kernel/cmdline.stowed /etc/kernel/cmdline
+ grubby --update-kernel=ALL '--args=root=UUID=80ae5acc-51f1-43bb-8f38-66a265124463 rootflags=defaults rd.luks.uuid=19dbfb23-5351-402d-85b2-f9a659d2891f rd.lvm.lv=root/root'
+ test -f /etc/kernel/cmdline
+ cp /etc/kernel/cmdline /new-root/etc/kernel/cmdline
> error: Error: Permission denied to access property "length"
> error: Error: Permission denied to access property "length"
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> info: failed to fetch lastlog2: [object Object]
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> info: [object Object]
> info: [object Object]
> warn: transport closed: disconnected
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> info: failed to fetch lastlog2: [object Object]
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2301-FAIL.js.log
Journal extracted to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2301-FAIL.log.gz
Journal extracted to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2302-FAIL.log.gz
rm: cannot remove '/etc/systemd/system/dnf5-automatic*.d': No such file or directory
> info: [object Object]
Failed to reset failed state of unit packagekit.service: Unit packagekit.service not loaded.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testRootReboot (__main__.TestStorageNBDE.testRootReboot) failed
# 1 TEST FAILED [296s on 85b70384870c]
not ok 37 test/verify/check-storage-luks TestStorageNBDE.testRootReboot $2

First occurrence: 2024-12-02T08:42:51.443887+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T08:42:51.443887+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
# ----------------------------------------------------------------------
# testCryptoPolicies (__main__.TestSystemInfo.testCryptoPolicies)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 38259
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 38259.
> info: failed to fetch lastlog2: Object(5)
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: transport closed: disconnected
> info: failed to fetch lastlog2: Object(5)
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: transport closed: disconnected
> info: failed to fetch lastlog2: Object(5)
Process 452 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 615 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2701-FAIL.js.log
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Journal extracted to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2701-FAIL.log.gz
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 452 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testCryptoPolicies (__main__.TestSystemInfo.testCryptoPolicies) failed
# 1 TEST FAILED [285s on eabcc93bdc42]
not ok 141 test/verify/check-system-info TestSystemInfo.testCryptoPolicies

First occurrence: 2024-12-02T08:48:44.222088+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T08:48:44.222088+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
# ----------------------------------------------------------------------
# testInconsistentCryptoPolicy (__main__.TestSystemInfo.testInconsistentCryptoPolicy)
*** You are running in headless mode.
[GFX1-]: glxtest: libGL.so.1 missing
WebDriver BiDi listening on ws://127.0.0.1:55337
[GFX1-]: RenderCompositorSWGL failed mapping default framebuffer, no dt
Warning: Using 'update-crypto-policies --set FIPS' is not sufficient for
         FIPS compliance.
         Use 'fips-mode-setup --enable' command instead.
> error: Error: Permission denied to access property "length"
> error: Error: Permission denied to access property "length"
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> info: failed to fetch lastlog2: [object Object]
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: transport closed: disconnected
> error: Error: Permission denied to access property "length"
> error: Error: Permission denied to access property "length"
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> info: failed to fetch lastlog2: [object Object]
Warning: Using 'update-crypto-policies --set' in FIPS mode will make the system
         non-compliant with FIPS.
         It can also break the ssh access to the system.
         Use 'fips-mode-setup --disable' to disable the system FIPS mode.
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
Warning: Using 'update-crypto-policies --set FIPS' is not sufficient for
         FIPS compliance.
         Use 'fips-mode-setup --enable' command instead.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Warning: Using 'update-crypto-policies --set' in FIPS mode will make the system
         non-compliant with FIPS.
         It can also break the ssh access to the system.
         Use 'fips-mode-setup --disable' to disable the system FIPS mode.
> warn: transport closed: disconnected
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
> error: Error: Permission denied to access property "length"
> error: Error: Permission denied to access property "length"
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9591/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> info: failed to fetch lastlog2: [object Object]
Process 615 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 452 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestSystemInfo-testInconsistentCryptoPolicy-fedora-41-127.0.0.2-2701-FAIL.js.log
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Journal extracted to TestSystemInfo-testInconsistentCryptoPolicy-fedora-41-127.0.0.2-2701-FAIL.log.gz
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
[GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown
Exiting due to channel error.
[GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown
Exiting due to channel error.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 615 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testInconsistentCryptoPolicy (__main__.TestSystemInfo.testInconsistentCryptoPolicy) failed
# 1 TEST FAILED [245s on b7a279007679]
not ok 143 test/verify/check-system-info TestSystemInfo.testInconsistentCryptoPolicy

First occurrence: 2024-12-02T08:50:50.065613+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T08:50:50.065613+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
# ----------------------------------------------------------------------
# testRootReboot (__main__.TestStorageNBDE.testRootReboot)
Error: unknown connection 'ens15'.
Error: cannot delete unknown connection(s): 'ens15'.
Error: unknown connection 'ens15'.
Error: cannot delete unknown connection(s): 'ens15'.
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 46647
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 46647.
Failed to kill unit packagekit.service: Unit packagekit.service not loaded.
Failed to reset failed state of unit packagekit.service: Unit packagekit.service not loaded.
+ parted -s /dev/sda mktable msdos
+ parted -s /dev/sda mkpart primary ext4 1M 500M
+ parted -s /dev/sda mkpart primary ext4 500M 100%
+ cryptsetup luksFormat --pbkdf-memory=300 /dev/sda2
+ echo einszweidrei
++ blkid -p /dev/sda2 -s UUID -o value
+ luks_uuid=681d5dc0-49da-4b8f-a4d4-ce60c77c3c55
+ echo einszweidrei
+ cryptsetup luksOpen --pbkdf-memory=300 /dev/sda2 luks-681d5dc0-49da-4b8f-a4d4-ce60c77c3c55
+ vgcreate root /dev/mapper/luks-681d5dc0-49da-4b8f-a4d4-ce60c77c3c55
+ lvcreate root -n root -l100%VG
+ mkfs.ext4 /dev/root/root
mke2fs 1.47.1 (20-May-2024)
+ mkdir /new-root
+ mount /dev/root/root /new-root
+ mkfs.ext4 /dev/sda1
mke2fs 1.47.1 (20-May-2024)
+ mountpoint /boot/efi
+ umount /boot/efi
+ mkdir /new-root/boot
+ mount /dev/sda1 /new-root/boot
+ tar --selinux --one-file-system -cf - --exclude /boot '--exclude=/var/tmp/*' '--exclude=/var/cache/*' '--exclude=/var/lib/mock/*' '--exclude=/var/lib/containers/*' '--exclude=/new-root/*' /
+ tar --selinux -C /new-root -xf -
tar: Removing leading `/' from member names
tar: Removing leading `/' from hard link targets
+ mountpoint /var
+ tar -C /var --selinux --one-file-system -cf - '--exclude=tmp/*' '--exclude=cache/*' '--exclude=lib/mock/*' '--exclude=lib/containers/*' .
+ tar --selinux -C /new-root/var -xf -
+ tar --one-file-system -C /boot -cf - .
+ tar -C /new-root/boot -xf -
+ umount /new-root/boot
+ mount /dev/sda1 /boot
+ echo '(hd0) /dev/sda'
+ sed -i -e s,/boot/,/, /boot/loader/entries/67070f5f5154497487bffe1249f3b091-6.11.8-300.fc41.x86_64.conf /boot/loader/entries/d54382b15c5f431c98a6aa42f3a26e5a-6.11.4-301.fc41.x86_64.conf
++ blkid -p /dev/root/root -s UUID -o value
+ uuid=63e9040b-64e5-4c0f-8d2b-a3a1c6dd8029
++ blkid -p /dev/sda1 -s UUID -o value
+ buuid=631bcb8d-97ba-4926-a48e-70e1794a26de
+ echo 'UUID=63e9040b-64e5-4c0f-8d2b-a3a1c6dd8029 / auto defaults 0 0'
+ echo 'UUID=631bcb8d-97ba-4926-a48e-70e1794a26de /boot auto defaults 0 0'
+ dracut --regenerate-all --force
+ grub2-install /dev/sda
Installing for i386-pc platform.
Installation finished. No error reported.
+ mv /boot/loader/entries /boot/loader/entries.stowed
+ test -f /etc/kernel/cmdline
+ mv /etc/kernel/cmdline /etc/kernel/cmdline.stowed
+ grub2-mkconfig -o /boot/grub2/grub.cfg
Generating grub configuration file ...
Warning: Requested serial terminal but GRUB_SERIAL_COMMAND is unspecified. Default parameters will be used.
Found Fedora Linux 41 (Cloud Edition) on /dev/mapper/root-root
Adding boot menu entry for UEFI Firmware Settings ...
done
+ mv /boot/loader/entries.stowed /boot/loader/entries
+ test -f /etc/kernel/cmdline.stowed
+ mv /etc/kernel/cmdline.stowed /etc/kernel/cmdline
+ grubby --update-kernel=ALL '--args=root=UUID=63e9040b-64e5-4c0f-8d2b-a3a1c6dd8029 rootflags=defaults rd.luks.uuid=681d5dc0-49da-4b8f-a4d4-ce60c77c3c55 rd.lvm.lv=root/root'
+ test -f /etc/kernel/cmdline
+ cp /etc/kernel/cmdline /new-root/etc/kernel/cmdline
> info: "font-weight:bold"Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
> warn: cockpit.format_{bytes,bits}[_per_sec](..., 1024, true) is deprecated.
> error: Warning: You are calling ReactDOMClient.createRoot() on a container that has already been passed to createRoot() before. Instead, call root.render() on the existing root instead if you want to update it.
> error: Warning: You are calling ReactDOMClient.createRoot() on a container that has already been passed to createRoot() before. Instead, call root.render() on the existing root instead if you want to update it.
> warn: transport closed: disconnected
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
kex_exchange_identification: read: Connection reset by peer
> info: "font-weight:bold"Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
Wrote coverage data to /work/make-checkout-workdir/lcov/TestStorageNBDE-testRootReboot.info.gz
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2501-FAIL.js.log
Journal extracted to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2501-FAIL.log.gz
Journal extracted to TestStorageNBDE-testRootReboot-fedora-41-127.0.0.2-2502-FAIL.log.gz
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GB, [object Object]) is deprecated.
rm: cannot remove '/etc/systemd/system/dnf5-automatic*.d': No such file or directory
> info: PackageKit went away from D-Bus
Failed to reset failed state of unit packagekit.service: Unit packagekit.service not loaded.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 467 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testRootReboot (__main__.TestStorageNBDE.testRootReboot) failed
# 1 TEST FAILED [273s on 2366f229ec56]
not ok 232 test/verify/check-storage-luks TestStorageNBDE.testRootReboot $2

First occurrence: 2024-12-02T08:54:22.407437+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T08:54:22.407437+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
# ----------------------------------------------------------------------
# testCryptoPolicies (__main__.TestSystemInfo.testCryptoPolicies)
Starting ChromeDriver 129.0.6668.89 (951c0b97221f8d4ba37cf97d324505c832251cf9-refs/branch-heads/6668@{#1503}) on port 60955
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 60955.
> info: "font-weight:bold"Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
> info: failed to fetch lastlog2: Object(5)
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
kex_exchange_identification: read: Connection reset by peer
> warn: transport closed: disconnected
kex_exchange_identification: read: Connection reset by peer
> info: "font-weight:bold"Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
> info: failed to fetch lastlog2: Object(5)
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: transport closed: disconnected
> info: "font-weight:bold"Download the React DevTools for a better development experience: https://reactjs.org/link/react-devtools
> info: failed to fetch lastlog2: Object(5)
Wrote coverage data to /work/make-checkout-workdir/lcov/TestSystemInfo-testCryptoPolicies.info.gz
Process 452 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 614 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2401-FAIL.js.log
Journal extracted to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2401-FAIL.log.gz
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 452 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testCryptoPolicies (__main__.TestSystemInfo.testCryptoPolicies) failed
# 1 TEST FAILED [261s on 2366f229ec56]
not ok 379 test/verify/check-system-info TestSystemInfo.testCryptoPolicies

First occurrence: 2024-12-02T09:05:38.230862+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
Times recorded: 1
Latest occurrences:

  • 2024-12-02T09:05:38.230862+00:00 | revision 12ebe11436d440ba0323bff7b8a2c4814c86d171
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64&countme=1 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Connection to 127.0.0.2 closed by remote host.
> warn: transport closed: disconnected
kex_exchange_identification: read: Connection reset by peer
> info: failed to fetch lastlog2: Object(5)
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: transport closed: disconnected
> info: failed to fetch lastlog2: Object(5)
Process 453 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 614 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2701-FAIL.js.log
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Journal extracted to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2701-FAIL.log.gz
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 453 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testCryptoPolicies (__main__.TestSystemInfo.testCryptoPolicies) failed
# 1 TEST FAILED [306s on e97185fae7ec]
not ok 86 test/verify/check-system-info TestSystemInfo.testCryptoPolicies

First occurrence: 2024-12-08T04:48:43.269708+00:00 | revision de082c39420c15d7d3d9c87d69065c12701a895f
Times recorded: 1
Latest occurrences:

  • 2024-12-08T04:48:43.269708+00:00 | revision de082c39420c15d7d3d9c87d69065c12701a895f
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.manifest.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> error: The resource from “http://127.0.0.2:9191/cockpit/@localhost/*/po.js” was blocked due to MIME type (“text/html”) mismatch (X-Content-Type-Options: nosniff).
> info: failed to fetch lastlog2: [object Object]
Process 452 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Process 615 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...
Wrote JS log to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2301-FAIL.js.log
> warn: Resolving coreutils failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
> warn: cockpit.format_{bytes,bits}[_per_sec](..., GiB, [object Object]) is deprecated.
> warn: loading available updates failed: {"detail":"cannot update repo 'updates': Cannot prepare internal mirrorlist: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]; Last error: Curl error (6): Could not resolve hostname for https://mirrors.fedoraproject.org/metalink?repo=updates-released-f41&arch=x86_64 [Could not resolve host: mirrors.fedoraproject.org]","code":64}
Journal extracted to TestSystemInfo-testCryptoPolicies-fedora-41-127.0.0.2-2301-FAIL.log.gz
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
Exiting due to channel error.
[GFX1-]: CompositorBridgeChild receives IPC close with reason=AbnormalShutdown
Exiting due to channel error.
Exiting due to channel error.
Traceback (most recent call last):
  File "/work/make-checkout-workdir/test/common/testlib.py", line 1951, in tearDown
    self.check_journal_messages()
  File "/work/make-checkout-workdir/test/common/testlib.py", line 2214, in check_journal_messages
    raise Error(UNEXPECTED_MESSAGE + "journal messages:\n" + first)
testlib.Error: FAIL: Test completed, but found unexpected journal messages:
Process 452 (rpc.statd) of user 0 terminated abnormally with signal 6/ABRT, processing...

# Result testCryptoPolicies (__main__.TestSystemInfo.testCryptoPolicies) failed
# 1 TEST FAILED [278s on 974202097a7f]
not ok 86 test/verify/check-system-info TestSystemInfo.testCryptoPolicies

First occurrence: 2024-12-09T08:41:34.284042+00:00 | revision e6af5d452e8a7536b50fa2e63315f728758be93c
Times recorded: 1
Latest occurrences:

  • 2024-12-09T08:41:34.284042+00:00 | revision e6af5d452e8a7536b50fa2e63315f728758be93c

@martinpitt martinpitt mentioned this issue Nov 26, 2024
Merged
5 tasks
martinpitt added a commit to martinpitt/bots that referenced this issue Nov 26, 2024
@martinpitt
naughty: cockpit-project#7137 affects Rawhide as well
ac0a673
martinpitt added a commit that referenced this issue Nov 26, 2024
@martinpitt
naughty: #7137 affects Rawhide as well
8990bf8
martinpitt added a commit that referenced this issue Nov 26, 2024
@martinpitt
naughty: Adjust #7137 pattern for Fedora 41
5ab0c77 
systemd in Fedora 41 changed the message. Also, some tests like
`TestSystemInfo.testCryptoPolicies` only show the failure without the
stack trace, so drop the glob. The "Test completed, but found unexpected
journal messages" match protects us from hiding more severe failures.
martinpitt added a commit that referenced this issue Nov 26, 2024
@martinpitt
naughty: Adjust #7137 pattern for Fedora 41
d470b2c 
systemd in Fedora 41 changed the message. Also, some tests like
`TestSystemInfo.testCryptoPolicies` only show the failure without the
stack trace, so drop the glob. The "Test completed, but found unexpected
journal messages" match protects us from hiding more severe failures.
martinpitt added a commit to martinpitt/cockpit-machines that referenced this issue Nov 28, 2024
@martinpitt
test: Only run alert and logout cleanups if Cockpit is actually opened
ebaa19d 
Some tests like `testAddDiskNFS` fail during setup [1], so the test
teardown runs while the browser still shows a blank page.

Use the new `Browser.have_test_api()` from
cockpit-project/cockpit#21349 instead of merely
checking if the browser is running to clean that up.

[1] cockpit-project/bots#7137
@martinpitt martinpitt mentioned this issue Nov 28, 2024
Merged
2 tasks
martinpitt added a commit to martinpitt/cockpit-machines that referenced this issue Nov 29, 2024
@martinpitt
test: Only run alert and logout cleanups if Cockpit is actually opened
b276f3f 
Some tests like `testAddDiskNFS` fail during setup [1], so the test
teardown runs while the browser still shows a blank page.

Use the new `Browser.have_test_api()` from
cockpit-project/cockpit#21349 instead of merely
checking if the browser is running to clean that up.

[1] cockpit-project/bots#7137
jelly pushed a commit to cockpit-project/cockpit-machines that referenced this issue Nov 29, 2024
@martinpitt @jelly
test: Only run alert and logout cleanups if Cockpit is actually opened
978131f 
Some tests like `testAddDiskNFS` fail during setup [1], so the test
teardown runs while the browser still shows a blank page.

Use the new `Browser.have_test_api()` from
cockpit-project/cockpit#21349 instead of merely
checking if the browser is running to clean that up.

[1] cockpit-project/bots#7137
allisonkarlitskaya pushed a commit that referenced this issue Jan 5, 2025
naughty: Close 7137: nfs-utils 2.8.1-1.rc2 regression: rpc.statd cras…
0c639d1 
…hes with SIGABRT in nsm_atomic_write()

Known issue which has not occurred in 26 days

nfs-utils 2.8.1-1.rc2 regression: rpc.statd crashes with SIGABRT in nsm_atomic_write()

Fixes #7137
@github-actions github-actions bot mentioned this issue Jan 5, 2025
Merged
allisonkarlitskaya pushed a commit that referenced this issue Jan 5, 2025
naughty: Close 7137: nfs-utils 2.8.1-1.rc2 regression: rpc.statd cras…
ca3b779 
…hes with SIGABRT in nsm_atomic_write()

Known issue which has not occurred in 26 days

nfs-utils 2.8.1-1.rc2 regression: rpc.statd crashes with SIGABRT in nsm_atomic_write()

Fixes #7137

Closes #7282
martinpitt pushed a commit that referenced this issue Jan 5, 2025
@martinpitt
naughty: Close 7137: nfs-utils 2.8.1-1.rc2 regression: rpc.statd cras…
f09e869 
…hes with SIGABRT in nsm_atomic_write()

Known issue which has not occurred in 26 days

nfs-utils 2.8.1-1.rc2 regression: rpc.statd crashes with SIGABRT in nsm_atomic_write()

Fixes #7137

Closes #7282
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
knownissue
Projects
None yet
Milestone
No milestone
2 participants
@martinpitt @cockpituous