Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bugfix/cam fixes 3 #597

Merged
merged 26 commits into from
Nov 12, 2024
Merged

Bugfix/cam fixes 3 #597

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
1005721
Fix Look-in dir for gather3
Oct 18, 2024
d58ef60
Bugzilla 1547: Run child processes in separate working directories
Oct 24, 2024
9f84f4e
Bugzilla 1547: Run child processes in separate working directories
Oct 24, 2024
018e348
Fix ASNOW verification + adjust snowfall graphics
Oct 25, 2024
37f3416
Adjust precip graphics
Oct 25, 2024
6477246
Fix HRRR TCDC field configuration
Oct 25, 2024
f3788c9
Add CONUS E/W/C/S graphics
Oct 25, 2024
8c721da
update walltime
Oct 25, 2024
15fea2f
Adjust severe prep resource allocation + match ecf with dev
Oct 25, 2024
a7ea44c
Fix input template for merged ptype file
Oct 25, 2024
a86d9ff
Fix metric config
Oct 25, 2024
4664562
Merge branch 'develop' into bugfix/cam_fixes_3
Oct 25, 2024
01928c7
Use verbose option for cp commands
Oct 28, 2024
8ddb098
Bugzilla 1547: Run child processes in separate working directories
Oct 28, 2024
1b49174
use cfp + reduce resources
Oct 29, 2024
c2ab45d
Look in main output dir for firewx mask input
Oct 30, 2024
601f0ca
Adjust walltimes + match ecf with dev walltimes
Oct 31, 2024
a07e669
Match ecf with dev driver walltime
Oct 31, 2024
14fc4c6
set and adjust mem allocation
Nov 1, 2024
0038604
Match ecf with dev resource requests
Nov 1, 2024
0c95388
Reduce mem allocation
Nov 1, 2024
d1859e0
Reduce mem allocation (ecf)
Nov 1, 2024
dd80739
Match ecf with dev driver allocations (plots)
Nov 1, 2024
c426889
Add memory allocation
Nov 1, 2024
cf37baf
Increase mem allocation
Nov 1, 2024
dfc000f
Use single cpu + match ecf with dev resources
Nov 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions dev/drivers/scripts/plots/cam/jevs_cam_grid2obs_plots_last31days.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@
#PBS -S /bin/bash
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=2:30:00
#PBS -l place=vscatter:exclhost,select=12:ncpus=128:mem=220GB
#PBS -l walltime=8:00:00
#PBS -l place=vscatter:exclhost,select=12:ncpus=128:mem=300GB
#PBS -l debug=true

set -x
Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/plots/cam/jevs_cam_grid2obs_plots_last90days.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -S /bin/bash
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=4:30:00
#PBS -l walltime=8:00:00
#PBS -l place=vscatter:exclhost,select=12:ncpus=128:mem=330GB
#PBS -l debug=true

Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/plots/cam/jevs_cam_headline_plots.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=50GB
#PBS -l debug=true

set -x
Expand Down
6 changes: 3 additions & 3 deletions dev/drivers/scripts/prep/cam/jevs_cam_hireswarw_precip_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:15:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=128GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:ompthreads=1:mem=128GB
#PBS -l debug=true

set -x
Expand All @@ -21,8 +21,8 @@ export SENDDBN_NTC=
export job=${PBS_JOBNAME:-jevs_cam_hireswarw_precip_prep}
export jobid=$job.${PBS_JOBID:-$$}
export SITE=$(cat /etc/cluster_name)
export USE_CFP=NO
export nproc=128
export USE_CFP=YES
export nproc=3

# General Verification Settings
export NET="evs"
Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/prep/cam/jevs_cam_hireswarw_severe_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=shared,select=1:ncpus=1:mem=10GB
#PBS -l place=shared,select=1:ncpus=1:mem=15GB
#PBS -l debug=true


Expand Down
6 changes: 3 additions & 3 deletions dev/drivers/scripts/prep/cam/jevs_cam_hireswarwmem2_precip_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:15:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=128GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:ompthreads=1:mem=128GB
#PBS -l debug=true

set -x
Expand All @@ -21,8 +21,8 @@ export SENDDBN_NTC=
export job=${PBS_JOBNAME:-jevs_cam_hireswarwmem2_precip_prep}
export jobid=$job.${PBS_JOBID:-$$}
export SITE=$(cat /etc/cluster_name)
export USE_CFP=NO
export nproc=128
export USE_CFP=YES
export nproc=3

# General Verification Settings
export NET="evs"
Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/prep/cam/jevs_cam_hireswarwmem2_severe_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=shared,select=1:ncpus=1:mem=10GB
#PBS -l place=shared,select=1:ncpus=1:mem=15GB
#PBS -l debug=true


Expand Down
6 changes: 3 additions & 3 deletions dev/drivers/scripts/prep/cam/jevs_cam_hireswfv3_precip_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:15:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=128GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:ompthreads=1:mem=128GB
#PBS -l debug=true

set -x
Expand All @@ -21,8 +21,8 @@ export SENDDBN_NTC=
export job=${PBS_JOBNAME:-jevs_cam_hireswfv3_precip_prep}
export jobid=$job.${PBS_JOBID:-$$}
export SITE=$(cat /etc/cluster_name)
export USE_CFP=NO
export nproc=128
export USE_CFP=YES
export nproc=3

# General Verification Settings
export NET="evs"
Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/prep/cam/jevs_cam_hireswfv3_severe_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=shared,select=1:ncpus=1:mem=10GB
#PBS -l place=shared,select=1:ncpus=1:mem=15GB
#PBS -l debug=true


Expand Down
6 changes: 3 additions & 3 deletions dev/drivers/scripts/prep/cam/jevs_cam_hrrr_precip_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:15:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=128GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:ompthreads=1:mem=128GB
#PBS -l debug=true

set -x
Expand All @@ -21,8 +21,8 @@ export SENDDBN_NTC=
export job=${PBS_JOBNAME:-jevs_cam_hrrr_precip_prep}
export jobid=$job.${PBS_JOBID:-$$}
export SITE=$(cat /etc/cluster_name)
export USE_CFP=NO
export nproc=128
export USE_CFP=YES
export nproc=3

# General Verification Settings
export NET="evs"
Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/prep/cam/jevs_cam_hrrr_severe_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=shared,select=1:ncpus=1:mem=10GB
#PBS -l place=shared,select=1:ncpus=1:mem=15GB
#PBS -l debug=true


Expand Down
6 changes: 3 additions & 3 deletions dev/drivers/scripts/prep/cam/jevs_cam_namnest_precip_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:15:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=128GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:ompthreads=1:mem=128GB
#PBS -l debug=true

set -x
Expand All @@ -21,8 +21,8 @@ export SENDDBN_NTC=
export job=${PBS_JOBNAME:-jevs_cam_namnest_precip_prep}
export jobid=$job.${PBS_JOBID:-$$}
export SITE=$(cat /etc/cluster_name)
export USE_CFP=NO
export nproc=128
export USE_CFP=YES
export nproc=3

# General Verification Settings
export NET="evs"
Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/prep/cam/jevs_cam_namnest_severe_prep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=shared,select=1:ncpus=1:mem=10GB
#PBS -l place=shared,select=1:ncpus=1:mem=75GB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hireswarw_radar_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=500GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=50GB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hireswarw_severe_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=exclhost,select=1:ncpus=5:mem=500MB
#PBS -l place=exclhost,select=1:ncpus=1:mem=500MB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hireswarwmem2_radar_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=500GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=50GB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hireswarwmem2_severe_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=exclhost,select=1:ncpus=5:mem=500MB
#PBS -l place=exclhost,select=1:ncpus=1:mem=500MB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hireswfv3_grid2obs_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -S /bin/bash
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:45:00
#PBS -l walltime=01:00:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=150GB
#PBS -l debug=true

Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hireswfv3_radar_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=500GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=50GB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hireswfv3_severe_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=exclhost,select=1:ncpus=5:mem=500MB
#PBS -l place=exclhost,select=1:ncpus=1:mem=500MB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_href_severe_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=exclhost,select=1:ncpus=5:mem=500MB
#PBS -l place=exclhost,select=1:ncpus=1:mem=500MB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hrrr_radar_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=500GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=50GB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_hrrr_severe_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=0:30:00
#PBS -l place=exclhost,select=1:ncpus=5:mem=500MB
#PBS -l place=exclhost,select=1:ncpus=1:mem=500MB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_namnest_grid2obs_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -S /bin/bash
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=02:15:00
#PBS -l walltime=02:50:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=256GB
#PBS -l debug=true

Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_namnest_precip_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=01:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=125GB
#PBS -l debug=true

set -x
Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_namnest_radar_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=500GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:mem=50GB
#PBS -l debug=true


Expand Down
2 changes: 1 addition & 1 deletion dev/drivers/scripts/stats/cam/jevs_cam_namnest_severe_stats.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q dev
#PBS -A VERF-DEV
#PBS -l walltime=00:30:00
#PBS -l place=exclhost,select=1:ncpus=5:mem=500MB
#PBS -l place=exclhost,select=1:ncpus=1:mem=500MB
#PBS -l debug=true


Expand Down
4 changes: 2 additions & 2 deletions ecf/scripts/plots/cam/jevs_cam_grid2obs_plots_last31days.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -S /bin/bash
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=2:30:00
#PBS -l place=vscatter:exclhost,select=12:ncpus=128:mem=220GB
#PBS -l walltime=8:00:00
#PBS -l place=vscatter:exclhost,select=12:ncpus=128:mem=300GB
#PBS -l debug=true

export model=evs
Expand Down
2 changes: 1 addition & 1 deletion ecf/scripts/plots/cam/jevs_cam_grid2obs_plots_last90days.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
#PBS -S /bin/bash
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=4:30:00
#PBS -l walltime=8:00:00
#PBS -l place=vscatter:exclhost,select=12:ncpus=128:mem=330GB
#PBS -l debug=true

Expand Down
4 changes: 2 additions & 2 deletions ecf/scripts/plots/cam/jevs_cam_headline_plots.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
#PBS -S /bin/bash
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=00:40:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=150GB
#PBS -l walltime=00:30:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=50GB
#PBS -l debug=true

export model=evs
Expand Down
2 changes: 1 addition & 1 deletion ecf/scripts/plots/cam/jevs_cam_precip_plots_last90days.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
#PBS -S /bin/bash
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=04:35:00
#PBS -l walltime=04:30:00
#PBS -l place=vscatter:exclhost,select=4:ncpus=128:mem=200GB
#PBS -l debug=true

Expand Down
2 changes: 1 addition & 1 deletion ecf/scripts/plots/cam/jevs_cam_snowfall_plots.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
#PBS -S /bin/bash
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=04:30:00
#PBS -l walltime=05:30:00
#PBS -l place=vscatter:exclhost,select=4:ncpus=128:mem=150GB
#PBS -l debug=true

Expand Down
6 changes: 3 additions & 3 deletions ecf/scripts/prep/cam/jevs_cam_hireswarw_precip_prep_vhr_master.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=00:10:00
#PBS -l place=vscatter:exclhost,select=1:ncpus=128:ompthreads=1:mem=128GB
#PBS -l place=vscatter:exclhost,select=1:ncpus=3:ompthreads=1:mem=128GB
#PBS -l debug=true

export model=evs
Expand Down Expand Up @@ -42,13 +42,13 @@ module list
############################################################
# Specify environment variables
############################################################
export nproc=128
export nproc=3
if [ -n "%VHR:%" ]; then
export vhr=${vhr:-%VHR:%}
else
export vhr=00
fi
export USE_CFP=NO
export USE_CFP=YES
export NET="evs"
export RUN="atmos"
export VERIF_CASE="precip"
Expand Down
2 changes: 1 addition & 1 deletion ecf/scripts/prep/cam/jevs_cam_hireswarw_severe_prep_vhr_master.ecf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
#PBS -q %QUEUE%
#PBS -A %PROJ%-%PROJENVIR%
#PBS -l walltime=00:10:00
#PBS -l place=shared,select=1:ncpus=1:mem=40GB
#PBS -l place=shared,select=1:ncpus=1:mem=15GB
#PBS -l debug=true

export model=evs
Expand Down
Loading