Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

create_test does not take suite name(s) as position argument #2094

Closed
gold2718 opened this issue Nov 24, 2017 · 7 comments
Closed

create_test does not take suite name(s) as position argument #2094

gold2718 opened this issue Nov 24, 2017 · 7 comments
Assignees
Labels
Responsibility: CESM Responsibility to manage and accomplish this issue is through CESM ty: Bug

Comments

@gold2718
Copy link

./create_test --help says (among other things):

positional arguments:
  testargs              Tests or test suites to run. Testname form is
                        TEST.GRID.COMPSET[.MACHINE_COMPILER] (default: None)

However, attempts to use one or more test suite names (e.g., prealpha) results in the error:

ERROR: Could not fill-out test name, partial string 'prealpha' had no grid information and you did not provide any

Either the documentation is incorrect or the code is not correct. It would be really convenient to be able to specify multiple test suites in one create_test call so all output is collected in one place.

@gold2718 gold2718 added Responsibility: CESM Responsibility to manage and accomplish this issue is through CESM ty: Bug labels Nov 24, 2017
@jedwards4b
Copy link
Contributor

That is an interesting interpretation of the help text. Test suite names can only be used with the
--xml-category option. I think that it only accepts one at a time however if you use some --xml-* options but not others it will do all - that is
./create_test --xml-machine yellowstone --xml-compiler gnu will run all categories defined for machine yellowstone and compiler gnu.

@gold2718
Copy link
Author

Where does it say "Test suite names can only be used with the --xml-category option."?

Are you saying the phrase "or test suites" under positional arguments is incorrect?

Is there a way to (for instance) run two suites for a single machine_compiler combination with a single create_test call?

@jedwards4b
Copy link
Contributor

I don't think so.

@billsacks
Copy link
Member

I have also been confused by this help text. So it sounds like the answer to this

Are you saying the phrase "or test suites" under positional arguments is incorrect?

is "yes"?

@jgfouca
Copy link
Contributor

jgfouca commented Nov 27, 2017

@gold2718 , positional testargs are for ACME.

@gold2718
Copy link
Author

@jgfouca,
I am aware that ACME has a different interface to create_test which is why I marked this as CESM-only. The issue here is that either the CESM-specific documentation is wrong or the CESM implementation is wrong and I think we should get those aligned.

Of course, in this case, we could just adopt the ACME interface to create_test and solve a lot of problems (IMHO).

@jgfouca
Copy link
Contributor

jgfouca commented Dec 13, 2017

Fix the description help-dump for create_test.

@jgfouca jgfouca self-assigned this Dec 13, 2017
jgfouca pushed a commit that referenced this issue Feb 23, 2018
Adds coupled 1950-control-run compsets at low and high resolution

This PR brings in three new compsets:
* A_WCYCL1950S_HR;
* A_WCYCL1950S_LR; and
* A_WCYCL1950S_LRtunedHR.
In conjunction with this PR, new inputdata files have already been added
to the svn server. We have tested that these new compsets run using
short (day-long) simulations on cori-knl.

It should be BFB for all other compsets

[BFB]
jgfouca pushed a commit that referenced this issue Mar 13, 2018
Adds coupled 1950-control-run compsets at low and high resolution

This PR brings in three new compsets:
* A_WCYCL1950S_HR;
* A_WCYCL1950S_LR; and
* A_WCYCL1950S_LRtunedHR.
In conjunction with this PR, new inputdata files have already been added
to the svn server. We have tested that these new compsets run using
short (day-long) simulations on cori-knl.

It should be BFB for all other compsets

[BFB]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Responsibility: CESM Responsibility to manage and accomplish this issue is through CESM ty: Bug
Projects
None yet
Development

No branches or pull requests

4 participants