Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Development of GFS atmospheric component of EVS #1

Closed
3 tasks
PerryShafran-NOAA opened this issue Apr 8, 2022 · 0 comments
Closed
3 tasks

Development of GFS atmospheric component of EVS #1

PerryShafran-NOAA opened this issue Apr 8, 2022 · 0 comments
Assignees
@malloryprow @PerryShafran-NOAA
Labels
enhancement New feature or request
Milestone
EVS v1.0.0

Comments

@PerryShafran-NOAA
Copy link
Contributor

PerryShafran-NOAA commented Apr 8, 2022 •
edited
Loading

Description

Develop the GFS atmospheric component of EVS, including all code to create stats, plotting, and any prep steps that may be necessary.

Steps

  • Develop and test code on local machine.
  • Push code to local fork
  • Submit pull request
@PerryShafran-NOAA PerryShafran-NOAA added the enhancement New feature or request label Apr 8, 2022
@PerryShafran-NOAA PerryShafran-NOAA added this to the EVS v1.0.0 milestone Apr 8, 2022
@PerryShafran-NOAA PerryShafran-NOAA changed the title Development of GFS grid2obs component of EVS Development of GFS atmospheric component of EVS Apr 11, 2022
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 24, 2022
@malloryprow
Remove initial placeholder files
5c69a13 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 24, 2022
@malloryprow
Add initial work for global_det atmos prep
82b7959 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 26, 2022
@malloryprow
Merge branch 'develop' into feature/global_det_atmos
69bb702 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 27, 2022
@malloryprow
Rework of global_det atmos prep
b6dc9b6 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 29, 2022
@malloryprow
Update prep scripts with new output directory structure
93e2416 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 29, 2022
@malloryprow
Use INITDATE instead of VDATE for prep scripts
ae0ed4c 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 29, 2022
@malloryprow
Create global_det_atmos prep scripts
f5b43ca 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Apr 29, 2022
@malloryprow
Fix reference to removed variable name
e02c853 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 5, 2022
@malloryprow
Keep precipitation files in their native accumulation
99a9dac 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 6, 2022
@malloryprow
Add SENDCOM step instead of writing directly to COMOUT
6f43891 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 6, 2022
@malloryprow
Add initial work for grid2grid_stats for reformatting obs. data
de1337f 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 9, 2022
@malloryprow
Change 24hr accumulated CCPA output file name
82bd9c5 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 9, 2022
@malloryprow
Add reformating jobs for model precip files
57cb024 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 10, 2022
@malloryprow
Change ECMWF files used and add SNOD variable to file
9c64f94 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 10, 2022
@malloryprow
Clean up ecm_gfs_look_alike_new.f90
ad2b48c 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 10, 2022
@malloryprow
Add WGRIB prep command for ECMWF
486830e 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 10, 2022
@malloryprow
Change file being run for ECMWF command
94e76b0 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 10, 2022
@malloryprow
Update copying prep file to COMOUT to do files individually
369c8f4 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 10, 2022
@malloryprow
Captialize model environment variable
5ba0270 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 18, 2022
@malloryprow
Change references to "Mallory.Row" to "$USER"
3ec844e 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 23, 2022
@malloryprow
Add MODEL_list variable for global_det atmos prep
1876111 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 23, 2022
@malloryprow
Add reformat step for models
508f336 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 23, 2022
@malloryprow
Merge branch 'develop' into feature/global_det_atmos
e88c3a0 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 24, 2022
@malloryprow
Create function for putting together METplus call
39429c5 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue May 26, 2022
@malloryprow
Change to using GFS 0p50 data
ba29c78 
Refs: NOAA-EMC#1
ShelleyMelchior-NOAA pushed a commit that referenced this issue Feb 7, 2024
@malloryprow
Move defining of output paths (#437)
0c1e87f 
Refs: #1
malloryprow added a commit to malloryprow/EVS that referenced this issue Feb 8, 2024
@malloryprow
Use file checking util for source files
d35f5c7 
Refs: NOAA-EMC#1
PerryShafran-NOAA pushed a commit that referenced this issue Feb 8, 2024
@malloryprow
Use file checking util for source files (#442)
82eb383 
Refs: #1
malloryprow added a commit to malloryprow/EVS that referenced this issue Feb 8, 2024
@malloryprow
Clean up plots logging messages
3178acd 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Feb 9, 2024
@malloryprow
Mask out negative values under square root
3b4a2ec 
Refs: NOAA-EMC#1
malloryprow added a commit to malloryprow/EVS that referenced this issue Feb 13, 2024
@malloryprow
Adjust memory
f10c44c 
Refs: NOAA-EMC#1
ShelleyMelchior-NOAA pushed a commit that referenced this issue Feb 13, 2024
@malloryprow
Adjust memory (#450)
8195b2f 
Refs: #1
malloryprow added a commit to malloryprow/EVS that referenced this issue Mar 22, 2024
@malloryprow
Subtract f0 from f24 for snowfall
3850448 
Refs: NOAA-EMC#1
ShelleyMelchior-NOAA pushed a commit that referenced this issue Mar 29, 2024
@malloryprow
Subtract f0 from f24 for snowfall (#460)
2fada6b 
Refs: #1
@PerryShafran-NOAA PerryShafran-NOAA mentioned this issue Apr 18, 2024
Merged
18 tasks
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 17, 2024
@Ho-ChunHuang-NOAA
incremental change for plots 06/17/2023 NOAA-EMC#1
5292fa2
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 18, 2024
@Ho-ChunHuang-NOAA
incremental change for plots 06/18/2023 NOAA-EMC#1
fa0d301
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 20, 2024
@Ho-ChunHuang-NOAA
incremental change for plots 06/20/2023 NOAA-EMC#1
324c7fa
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 21, 2024
@Ho-ChunHuang-NOAA
incremental change for plots 06/21/2023 NOAA-EMC#1
c578076
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 24, 2024
@Ho-ChunHuang-NOAA
incremental change for plots 06/24/2023 NOAA-EMC#1
40592ca
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 25, 2024
@Ho-ChunHuang-NOAA
incremental change for plots 06/25/2023 NOAA-EMC#1
824a35f
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 25, 2024
@Ho-ChunHuang-NOAA
incremental change for stats 06/25/2023 NOAA-EMC#1
b5fd0b8
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Jun 26, 2024
@Ho-ChunHuang-NOAA
vpppg overall v2.0 request changes NOAA-EMC#1
3d19138
PerryShafran-NOAA pushed a commit that referenced this issue Jul 10, 2024
@malloryprow
feature/global_det_v1.0plus (#495)
ec43e0d 
* Add "last" in plots driver script names

* Add "last" in plots ecf script names

* Remove echo of config file

* Change pastXXdays to lastXXdays in wave image names

* Remove LOOP_ORDER from METplus configs

* Remove subprocess import when not used

* Use subprocess.run

* Switch gfs/ecmwf order for headline plot

* Make grid2grid stats job formatting similar to plots

* Make grid2obs stats job formatting similar to plots

* Clean up plots logging messages

Refs: #1

* Mask out negative values under square root

Refs: #1

* Rename stats dev drivers

* Fix cmc_regional atmos order

* Add set -x to missing file mail script

* Define NET prior to HOMEevs

* Remove PBS -V from driver scripts

Refs: #464

* Add 0.25 inch for precip ETS headline plots

* Update default MET version

* Add osisaf COMOUT directory creation

* Add scale specifications for ETS

* Use PB2NC_SKIP_VALID_TIMES

* Remove cat'ing of METplus log files

* Update long-term time series mean to reflect values on plot

* Remove weird space that was causing weird message in log

* Bugfix

* Remove ltrop, utrop, and trop for ozone vertical profile plots

* Format environment variables correctly

* Change warning messages to note/debugs

* Update drivers to use environment VDATE_END
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Aug 13, 2024
@Ho-ChunHuang-NOAA
PR changes NOAA-EMC#1
9792ef8
malloryprow pushed a commit that referenced this issue Aug 15, 2024
@Ho-ChunHuang-NOAA
Fixes and Additions in EVS v2.0 #1 feature/EVSv2revision1 (#513)
91806be 
* vpppg overall v2.0 request changes #1

* vpppg overall v2.0 request changes #2

* add check corrupt grib2 files

* update subprocess.run statements

* update subprocess.run statements2

* remove checking on model output

* replace VDATE with INITDATE in prep

* replace DCOMIN with DCOMINairnow

* remove description

* change stdout to be consistent with suprocess.run

* PR changes #1

* PR changes #2

* PR changes #3 PrgEnvintel_ver

* PR changes #4 cleanup code

* PR changes #5 reverse cleanup
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Aug 21, 2024
@Ho-ChunHuang-NOAA
incremental change 08/21/2024 NOAA-EMC#1
63cc1dd
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Aug 28, 2024
@Ho-ChunHuang-NOAA
PR change NOAA-EMC#1
e280075
malloryprow pushed a commit that referenced this issue Aug 30, 2024
@Ho-ChunHuang-NOAA
Merge global_ens j-jobs Feature/gef schemv2 (#530)
1a141da 
* initial merge

* in bash shell and incremental changes

* incremental changes 08 15 2024

* incremental changes 08 15 2024 #2

* incremental changes 08 15 2024 #3

* merg j-job and performance lengend

* airnow perfdiag lengend

* update legend label and x tick label

* adjust perfdiag legend ncol

* adjust title format

* add criterion to run gefs chem stats

* PR change #1

* PR change #2

* PR change #3

* PR change #4

* PR change #5

* PR change #5 corrected
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Oct 22, 2024
@Ho-ChunHuang-NOAA
PR changes NOAA-EMC#1
10129f1
malloryprow pushed a commit that referenced this issue Oct 23, 2024
@Ho-ChunHuang-NOAA
Screen GEFS grid2obs Aeronet file before ASCII2NC call Feature/aerone…
e50a2f5 
…tasciifix (#593)

* add python check file code

* add checking aeronet record columns

* incremental changes 10/17/2024 1

* updated script to use post-screen aeronet file for metplus ascii2nc

* fix fcst missing sen email

* incremental changes 10/22/2024

* PR changes #1

* fix number comparison
@BinbinZhou-NOAA BinbinZhou-NOAA mentioned this issue Nov 18, 2024
Merged
Ho-ChunHuang-NOAA added a commit to Ho-ChunHuang-NOAA/EVS that referenced this issue Feb 10, 2025
@Ho-ChunHuang-NOAA
for PR664 comments NOAA-EMC#1
df76ba1
malloryprow pushed a commit that referenced this issue Feb 12, 2025
@Ho-ChunHuang-NOAA
GEFS -CHEM PLOTS MPMD BUGFIX - Feature/gef splotmpmd (#664)
f31754b 
* incremental chaneg with mpmd code changes and fix Mezquital name bug

* minor fix for email message file definition

* use rc1

* update GMC

* work on mpmd fix

* work on mpmd fix 02/04/2025

* work on mpmd fix 02/04/2025 2

* incremental changes 02/04/2025 1

* incremental changes 02/04/2025 2

* incremental changes 02/05/2025 1

* incremental changes 02/05/2025 2

* incremental changes 02/05/2025 2

* reset settings.py to the one in develop

* reset settings.py to simplify the mpmd PR

* for PR664 comments #1

* for PR664 comments #2

* backout changes in exevs_global_ens_chem_grid2obs_stats.sh

* update walltime to 00:25:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@malloryprow malloryprow

@PerryShafran-NOAA PerryShafran-NOAA

Labels
enhancement New feature or request
Projects
None yet
Milestone
EVS v1.0.0
Development

No branches or pull requests
2 participants
@malloryprow @PerryShafran-NOAA