Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some Automatus tests fail for unknown reasons on RHEL #13126

Open
comps opened this issue Mar 1, 2025 · 0 comments
Open

Some Automatus tests fail for unknown reasons on RHEL #13126

comps opened this issue Mar 1, 2025 · 0 comments
Labels
productization-issue Issue found in upstream stabilization process. RHEL Red Hat Enterprise Linux product related.

Comments

@comps
Copy link
Collaborator

comps commented Mar 1, 2025

Description of problem:

We currently track these as "fail for unknown reasons" when executed via Contest's /per-rule (on a vanilla RHEL virtual machine, not install_vm.py):

All RHELs:

accounts_password_set_max_life_root/correct.pass
accounts_password_set_max_life_root/wrong.fail
postfix_client_configure_mail_alias/correct.pass

RHEL-8 only:

grub2_audit_backlog_limit_argument/correct_grubenv.pass
grub2_password/invalid_username.fail
harden_sshd_ciphers_openssh_conf_crypto_policy/stig_correct.pass
harden_sshd_ciphers_openssh_conf_crypto_policy/stig_correct_followed_by_incorrect_commented.pass
sudo_add_umask/0027_var_multiple_values.pass

Further, additional rules/tests fail for semi-known reasons - my limited investigation suggests these try to install packages non-existent on RHEL, or start services that don't exist.

All RHELs:

package_quagga_removed/package-installed.fail
package_rsh-server_removed/package-installed.fail
package_rsh_removed/package-installed.fail
package_mcafeetp_installed/package-installed.pass

RHEL-9 only:

package_xinetd_removed/package-installed.fail
package_ypbind_removed/package-installed.fail
package_ypserv_removed/package-installed.fail
service_telnet_disabled/service_disabled.pass

Please investigate why these fail - typically it's not straightforward (no output from the shell scripts), unfortunately.

SCAP Security Guide Version:

master @ 6d67ad5

Operating System Version:

RHEL

Steps to Reproduce:

  1. Execute as ie. --rhel 9.6 --arch x86_64 --test /per-rule/from-env -e 'RULE="rule1 rule2 rule3"'
@comps comps added productization-issue Issue found in upstream stabilization process. RHEL Red Hat Enterprise Linux product related. labels Mar 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
productization-issue Issue found in upstream stabilization process. RHEL Red Hat Enterprise Linux product related.
Projects
None yet
Development

No branches or pull requests

1 participant