Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix inconsistent output when running HiRA #2045

Closed
22 tasks
TaraJensen opened this issue Feb 10, 2022 · 1 comment · Fixed by #2049
Closed
22 tasks

Fix inconsistent output when running HiRA #2045

TaraJensen opened this issue Feb 10, 2022 · 1 comment · Fixed by #2049
Assignees
Labels
reporting: DTC NCAR Base NCAR Base DTC Project reporting: DTC NOAA BASE NOAA Office of Atmospheric Research DTC Project requestor: METplus Team METplus Development Team requestor: UK Met Office United Kingdom Met Office required: FOR OFFICIAL RELEASE Required to be completed in the official release for the assigned milestone type: bug Fix something that is not working
Milestone

Comments

@TaraJensen
Copy link
Contributor

TaraJensen commented Feb 10, 2022

Describe the Problem

Rob and others at the Met Office were testing running HiRA using MET only and METplus. They noticed that the output in the RPS line type was different between the two run configurations. It boiled down to with MET only the TOTAL column was populated with realistic values. The METplus run output TOTAL were all 0. All other values in _rps.txt files were the same

Their debugging activity identified that:
MET only - ECNT and RPS output was turned on (they had it set to BOTH)
METplus - RPS was turned on, ECNT was not.

Expected Behavior

The TOTAL column in RPS line type should be reported regardless of if ECNT output is requested.

Environment

Describe your runtime environment:
1. Machine: (e.g. HPC name, Linux Workstation, Mac Laptop)
2. OS: (e.g. RedHat Linux, MacOS)
3. Software version number(s)

To Reproduce

Describe the steps to reproduce the behavior: - working on defining this
*1. I replicated the problem on seneca in /d1/personal/jensen/tutorial/METplus-4.0.0_Tutorial/output/met_output/point_stat
*2. PointStatConfig_tutorial_run2 has ECNT and RPS turned on
*3. PointStatConfig_tutorial_run3 only had RPS turned on
*4. point_stat_run2_360000L_20070331_120000V_rps.txt - has valid data in the TOTAL column;
point_stat_run3_360000L_20070331_120000V_rps.txt - has 0s

Relevant Deadlines

List relevant project deadlines here or state NONE.

Funding Source

2702691

Define the Metadata

Assignee

  • Select engineer(s) or no engineer required
  • Select scientist(s) or no scientist required

Labels

  • Select component(s)
  • Select priority
  • Select requestor(s)

Projects and Milestone

  • Select Organization level Project for support of the current coordinated release
  • Select Repository level Project for development toward the next official release or add alert: NEED PROJECT ASSIGNMENT label
  • Select Milestone as the next bugfix version

Define Related Issue(s)

Consider the impact to the other METplus components.

Bugfix Checklist

See the METplus Workflow for details.

  • Complete the issue definition above, including the Time Estimate and Funding Source.
  • Fork this repository or create a branch of main_<Version>.
    Branch name: bugfix_<Issue Number>_main_<Version>_<Description>
  • Fix the bug and test your changes.
  • Add/update log messages for easier debugging.
  • Add/update unit tests.
  • Add/update documentation.
  • Push local changes to GitHub.
  • Submit a pull request to merge into main_<Version>.
    Pull request: bugfix <Issue Number> main_<Version> <Description>
  • Define the pull request metadata, as permissions allow.
    Select: Reviewer(s) and Linked issues
    Select: Organization level software support Project for the current coordinated release
    Select: Milestone as the next bugfix version
  • Iterate until the reviewer(s) accept and merge your changes.
  • Delete your fork or branch.
  • Complete the steps above to fix the bug on the develop branch.
    Branch name: bugfix_<Issue Number>_develop_<Description>
    Pull request: bugfix <Issue Number> develop <Description>
    Select: Reviewer(s) and Linked issues
    Select: Repository level development cycle Project for the next official release
    Select: Milestone as the next official version
  • Close this issue.
@TaraJensen TaraJensen added type: bug Fix something that is not working alert: NEED MORE DEFINITION Not yet actionable, additional definition required labels Feb 10, 2022
@TaraJensen TaraJensen added this to the MET 10.1.0 milestone Feb 10, 2022
@JohnHalleyGotway JohnHalleyGotway self-assigned this Feb 10, 2022
@TaraJensen TaraJensen added required: FOR OFFICIAL RELEASE Required to be completed in the official release for the assigned milestone reporting: DTC NCAR Base NCAR Base DTC Project reporting: DTC NOAA BASE NOAA Office of Atmospheric Research DTC Project requestor: METplus Team METplus Development Team requestor: UK Met Office United Kingdom Met Office and removed alert: NEED MORE DEFINITION Not yet actionable, additional definition required labels Feb 10, 2022
@JohnHalleyGotway
Copy link
Collaborator

@TaraJensen thanks for setting up the nice test to illustrate the difference.

In seneca:/d1/personal/jensen/tutorial/METplus-4.0.0_Tutorial/output/met_output/point_stat and comparing those two files:

vimdiff point_stat_run[2,3]_360000L_20070331_120000V_rps.txt

I see that the differences are limited to the TOTAL column. Run 2 has the correct values and run 3 has all 0's. That tells me right where I should go look.

Screen Shot 2022-02-11 at 2 18 30 PM

JohnHalleyGotway added a commit that referenced this issue Feb 11, 2022
…her up in the logic, rather than calling it separately for ECNT and ORANK. One of the things it does is compute the number of pairs... and that's used to set the number of pairs in the RPSInfo class. Calling that function before writing the RPS output fixes this bug. Running a full regression test to make sure this doesn't have unexpected impacts. ci-run-unit
@JohnHalleyGotway JohnHalleyGotway linked a pull request Feb 11, 2022 that will close this issue
14 tasks
@JohnHalleyGotway JohnHalleyGotway changed the title Inconsistent Output when running HiRA Fix inconsistent output when running HiRA Mar 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
reporting: DTC NCAR Base NCAR Base DTC Project reporting: DTC NOAA BASE NOAA Office of Atmospheric Research DTC Project requestor: METplus Team METplus Development Team requestor: UK Met Office United Kingdom Met Office required: FOR OFFICIAL RELEASE Required to be completed in the official release for the assigned milestone type: bug Fix something that is not working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants