Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature #2460 allow missing input #2493

Merged
merged 106 commits into from
Feb 8, 2024

Conversation

georgemccabe
Copy link
Collaborator

@georgemccabe georgemccabe commented Feb 8, 2024

Pull Request Testing

  • Describe testing already performed for these changes:

Added unit tests for new capability to allow missing input files and still run without error
Ensured all existing tests and use cases pass

  • Recommend testing for the reviewer(s) to perform, including the location of input datasets, and any additional instructions:

@JohnHalleyGotway and I met to discuss the details of this PR because there are a lot of changes. All tests should pass with no differences.

Review beta3 release notes: https://metplus--2493.org.readthedocs.build/en/2493/Users_Guide/release-notes.html#metplus-version-6-0-0-beta-3-release-notes-2024-02-07

  • Do these changes include sufficient documentation updates, ensuring that no errors or warnings exist in the build of the documentation? [No]

Additional changes should be made after the beta3 release, including adding documentation for the new config variables. I created issue #2492 to complete remaining tasks.

  • Do these changes include sufficient testing updates? [Yes]

Added and enhanced unit tests

  • Will this PR result in changes to the test suite? [No]

  • Please complete this pull request review by 2/7/2024.

Pull Request Checklist

See the METplus Workflow for details.

  • Add any new Python packages to the METplus Components Python Requirements table.
  • Review the source issue metadata (required labels, projects, and milestone).
  • Complete the PR definition above.
  • Ensure the PR title matches the feature or bugfix branch name.
  • Define the PR metadata, as permissions allow.
    Select: Reviewer(s)
    Select: Organization level software support Project or Repository level development cycle Project
    Select: Milestone as the version that will include these changes
  • After submitting the PR, select the ⚙️ icon in the Development section of the right hand sidebar. Search for the issue that this PR will close and select it, if it is not already selected.
  • After the PR is approved, merge your changes. If permissions do not allow this, request that the reviewer do the merge.
  • Close the linked issue and delete your feature or bugfix branch from GitHub.

…files, updated unit tests to match new behavior, added exception handling to series analysis to prevent crash if file does not exist
… template tag to override a config variable on the command line
…list text file even if there is only 1 file found. Use this argument in UserScript wrapper so that the environment variables that contain paths to file list files are consistent in format for use in user scripts
…nd added optional argument to skip clearing input file list
…ean up those functions to return boolean instead of sometimes returning None or a list of files to be consistent
…ermine if a python script is used with always setting file_type
…ecaus there is no truth data - to confirm that the error log merge step behaves properly in this case
…or logs if any of the 'Save error logs' steps ran successfully
@georgemccabe georgemccabe added this to the METplus-6.0.0 milestone Feb 8, 2024
@georgemccabe georgemccabe linked an issue Feb 8, 2024 that may be closed by this pull request
22 tasks
Copy link
Collaborator

@JohnHalleyGotway JohnHalleyGotway left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I approve of this PR, as soon as we're able to get a clean GHA run of the testing workflow that does not flag any diffs.

Note that I proposed 2 minor edits in the release notes, updating the release date and fixing a typo. I did check all the issue links and confirmed that they do work.

As for the actual code changes, @georgemccabe walked me through them, and they make sense. But with the possibility of unintended consequences, we should get a clean run before merging.

@@ -30,6 +30,49 @@ When applicable, release notes are followed by the
`GitHub issue <https://github.com/dtcenter/METplus/issues>`__ number which
describes the bugfix, enhancement, or new feature.

METplus Version 6.0.0 Beta 3 Release Notes (2024-02-07)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
METplus Version 6.0.0 Beta 3 Release Notes (2024-02-07)
METplus Version 6.0.0 Beta 3 Release Notes (2024-02-08)


.. dropdown:: Enhancements

* Add suport for MET land-mask settings in Point-Stat
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Add suport for MET land-mask settings in Point-Stat
* Add support for MET land-mask settings in Point-Stat

@georgemccabe georgemccabe merged commit 0f5beca into develop Feb 8, 2024
76 checks passed
@georgemccabe georgemccabe deleted the feature_2460_allow_missing_input branch February 8, 2024 23:23
@georgemccabe
Copy link
Collaborator Author

@JohnHalleyGotway, I will fix the typos in the release notes in the PR for creating the release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Status: 🏁 Done
Development

Successfully merging this pull request may close these issues.

Enhancement: Prevent error if some input files are missing
2 participants