Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can't run short-term archiver if there are no restart files #2480

Closed
billsacks opened this issue Apr 17, 2018 · 4 comments
Closed

Can't run short-term archiver if there are no restart files #2480

billsacks opened this issue Apr 17, 2018 · 4 comments
Assignees
@jedwards4b
Labels
Assigned tp: CIMElib ty: Bug

Comments

@billsacks
Copy link
Member

I'll start by admitting that this problem arose due to user error on my part: I accidentally set up a case where I set ./xmlchange REST_OPTION=nmonths,REST_N=18,RESUBMIT=1, but I forgot to increase HIST_OPTION and HIST_N. So it ran for 5 days, and didn't create any restart files in that time. But I think the same problem would occur if you intentionally ran a case without restart files, e.g., by setting REST_OPTION=never.

When the short-term archiver ran in this case, it generated the message,

Setting resource.RLIMIT_STACK to -1 from (-1, -1)
st_archive starting
moving /glade/scratch/sacks/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/run/rof.log.7635249.chadmin1.180417-123429.gz to /glade/scratch/sacks/archive/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/logs/rof.log.7635249.chadmin1.180417-123429.gz
moving /glade/scratch/sacks/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/run/cesm.log.7635249.chadmin1.180417-123429.gz to /glade/scratch/sacks/archive/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/logs/cesm.log.7635249.chadmin1.180417-123429.gz
moving /glade/scratch/sacks/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/run/cpl.log.7635249.chadmin1.180417-123429.gz to /glade/scratch/sacks/archive/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/logs/cpl.log.7635249.chadmin1.180417-123429.gz
moving /glade/scratch/sacks/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/run/lnd.log.7635249.chadmin1.180417-123429.gz to /glade/scratch/sacks/archive/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/logs/lnd.log.7635249.chadmin1.180417-123429.gz
moving /glade/scratch/sacks/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/run/atm.log.7635249.chadmin1.180417-123429.gz to /glade/scratch/sacks/archive/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/logs/atm.log.7635249.chadmin1.180417-123429.gz
ERROR: Cannot find a i.e20.I1850Clm50Sp.f10_f10_musgs.001r.cpl*.r.*.nc file in directory /glade/scratch/sacks/i.e20.I1850Clm50Sp.f10_f10_musgs.001r/run

It looks like this is generated from the _get_datenames function.

Shouldn't it be possible to run the short-term archiver even if there are no restart files present?
@jedwards4b
Copy link
Contributor

I've added a fix for this in my st_archive_test branch.

@billsacks
Copy link
Member Author

Thanks for the quick fix!

@jedwards4b jedwards4b mentioned this issue Apr 19, 2018
Merged
@billsacks
Copy link
Member Author

Oh, @jedwards4b I just saw that you say this is fixed - so should this be closed?

@jedwards4b
Copy link
Contributor

Yes, I have confirmed that this is fixed.

jgfouca added a commit that referenced this issue Aug 8, 2018
@jgfouca
Merge branch 'jgfouca/cime/upgrade_wait_for_tests_cdash' into master …
ce58118 
…(PR #2480)

Big update to wait_for_tests/jenkins

Changes:

* Upgrade cdash XML spoofing for prettier cdash pages for e3sm
* Add ability for jenkins jobs to use alternate baseline area, nice for test cleanup
* New test test suite that includes DIFFs
* Add ability to turn off all test teardowns from scripts_regr command line
* New Jenkins test to upload a realistic dashboard result
* Make TESTBUILDFAIL produce a bldlog file (So that uploading of log files for failed builds can be tested)
* Add logging to TestStatus processing (waiting)

[BFB]

* jgfouca/cime/upgrade_wait_for_tests_cdash:
  Make pylint happy
  Remove useless commented-out code
  Make TESTBUILDFAIL produce a bldlog file
  Big update to wait_for_test/jenkins
  wait_for_test logging working
  Remove debug stuff
  Progress
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jedwards4b jedwards4b

Labels
Assigned tp: CIMElib ty: Bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@rljacob @jedwards4b @billsacks