Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reusing test suite - compare with baseline passes even if model does not run correctly #1

Closed
phil-blain opened this issue Jun 4, 2019 · 3 comments
Closed

Reusing test suite - compare with baseline passes even if model does not run correctly #1

phil-blain opened this issue Jun 4, 2019 · 3 comments
Assignees
@phil-blain
Labels
bug Something isn't working

Comments

@phil-blain
Copy link
Owner

Happens because restarts from previous successful runs of the suite are present in the runs/test-name/restart directories.
@phil-blain phil-blain added the bug Something isn't working label Jun 4, 2019
@phil-blain phil-blain self-assigned this Jun 4, 2019
@phil-blain
Copy link
Owner Author

Example:

$ cat test_output 
#---
COPY cesium_intel_smoke_gx3_1x1_diag1_diagimp_dynanderson_incremental_run3dt build
FAIL cesium_intel_smoke_gx3_1x1_diag1_diagimp_dynanderson_incremental_run3dt run -1 -1 -1
FAIL cesium_intel_smoke_gx3_1x1_diag1_diagimp_dynanderson_incremental_run3dt test 
PASS cesium_intel_smoke_gx3_1x1_diag1_diagimp_dynanderson_incremental_run3dt compare implicit-20190315T094936 6.02 5.16 0.58

phil-blain pushed a commit that referenced this issue Jul 18, 2019
@duvivier
Updating PR template, doc links to PR info (CICE-Consortium#324)
efdb29b 
* modifying PR template

* updating PR template

* adding link to documentation for PR (#1)

* modifying PR template

* typo

* modifying wording

* modifying link per PBsuggestion

* adding second link

* adding Tony's changes

* typo

* Making ECH suggestions
@phil-blain
Copy link
Owner Author

maybe test script should abort if model aborts

phil-blain pushed a commit that referenced this issue Nov 15, 2021
@apcraig
Merge pull request #1 from apcraig/cgridA
c6258dc 
Add a bunch of C-grid infrastructure
@phil-blain
Copy link
Owner Author

reported in CICE-Consortium#608 and fixed in CICE-Consortium@85531cf for smoke and other tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@phil-blain phil-blain

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@phil-blain