Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CASMAUTO 32 : adding IUF BATS #629

Open
wants to merge 32 commits into
base: release/1.6
Choose a base branch
from
Open

Conversation

Pankhuri-Rajesh
Copy link

@Pankhuri-Rajesh Pankhuri-Rajesh commented Nov 13, 2024

Summary and Scope

Adding the files for IUF test cases which have been automated and are to be made a part of CSM 1.6
Changes-
1. All the goss files for IUF placed under ncn folder. (file name starts with "goss-iuf-")
2. All python scripts are placed under src/csm-testing/tests and lib.
3. iuf_run_setup is the folder containing the dummy-product tar file which will be used for running the tests (mainly IUF stages till prepare-images) and the manifest files which is placed in goss-testing/scripts.
4. New variables-iuf.yaml file added under vars folder.

Issues and Related PRs

Testing

Scripts have been tested by directly installing the modules on the system. Testing with virtual environment is in progress.

Tested on:

  • starlord

Pull Request Checklist

  • Version number(s) incremented, if applicable
  • Copyrights updated
  • License file intact
  • Target branch correct
  • CHANGELOG.md updated
  • Testing is appropriate and complete, if applicable
  • HPC Product Announcement prepared, if applicable

requirements.txt Outdated Show resolved Hide resolved
requirements.txt Outdated Show resolved Hide resolved
requirements.txt Outdated Show resolved Hide resolved
requirements.txt Outdated Show resolved Hide resolved
constraints.txt Outdated Show resolved Hide resolved
goss-testing/scripts/check_iuf_abort.sh Show resolved Hide resolved
goss-testing/scripts/python/check_workflow_template.py Outdated Show resolved Hide resolved
goss-testing/tests/iuf/goss-iuf-activity-abort.yaml Outdated Show resolved Hide resolved
Copy link
Contributor

@jacobsalmela jacobsalmela left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will any tests need to be skipped on Vshasta? If so, a key should be added for that.

@Srinivas-Anand-HPE Srinivas-Anand-HPE force-pushed the CASMAUTO-32 branch 6 times, most recently from 18b9106 to dd75b9f Compare November 15, 2024 06:51
@Pankhuri-Rajesh
Copy link
Author

Will any tests need to be skipped on Vshasta? If so, a key should be added for that.

all the tests can run on Vshashta

Copy link
Contributor

@mharding-hpe mharding-hpe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you installed the RPMs on a system and tested to make sure your additions work? I don't see the "testing is complete" checklist item marked in the PR template.

Please do this before requesting a re-review.

constraints.txt Outdated Show resolved Hide resolved
goss-testing/scripts/check_iuf_abort.sh Outdated Show resolved Hide resolved
goss-testing/scripts/workflows/iuf_base_workflow.yaml Outdated Show resolved Hide resolved
goss-testing/scripts/workflows/update_cpc_workflow.yaml Outdated Show resolved Hide resolved
goss-testing/tests/ncn/goss-validate-iuf-manifest.yaml Outdated Show resolved Hide resolved
goss-testing/tests/ncn/goss-validate-iuf-manifest.yaml Outdated Show resolved Hide resolved
requirements.txt Show resolved Hide resolved
requirements.txt Show resolved Hide resolved
Signed-off-by: Mitch Harding <mitchell.harding@hpe.com>
@haasken-hpe
Copy link

Hi @Pankhuri-Rajesh, can we please set up a time to discuss the intention of these tests and the possible overlap with the automated tests that the SAT team (me, @ethanholen-hpe, and @annapoorna-s-alt) is developing?

One thing I saw here really concerns me, which is that the entire JSON Schema files (for bootprep input files and IUF product manifest files) are being copied into this repository. I would like to understand why that is being done and come up with a better solution.

Thank you!

…as we need to consider all non-zero exit code as error
Signed-off-by: Mitch Harding <mitchell.harding@hpe.com>
Comment on lines +68 to +71
# Exit with code 1 if test case failed with exit code 1
if [ $run_exit_code_1 -eq 1 ] || [ $run_exit_code_2 -eq 1 ]; then
exit 1
fi
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this also not fail if the subtests returned other non-0 return codes?

Suggested change
# Exit with code 1 if test case failed with exit code 1
if [ $run_exit_code_1 -eq 1 ] || [ $run_exit_code_2 -eq 1 ]; then
exit 1
fi
# Fail if either subtest failed
[[ $run_exit_code_1 -ne 0 ]] && exit $run_exit_code_1
exit $run_exit_code_2

src/csm_testing/tests/iuf_post_checks/__main__.py Outdated Show resolved Hide resolved
src/csm_testing/tests/iuf_cleanup/__main__.py Outdated Show resolved Hide resolved
src/csm_testing/tests/iuf_cleanup/__main__.py Outdated Show resolved Hide resolved
Signed-off-by: Mitch Harding <mitchell.harding@hpe.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants