Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revamp Current Regression Testing Framework #174

Open
mandli opened this issue Jul 24, 2024 · 2 comments
Open

Revamp Current Regression Testing Framework #174

mandli opened this issue Jul 24, 2024 · 2 comments
Labels

Comments

@mandli
Copy link
Member

mandli commented Jul 24, 2024

This issue is intended as a place to document and plan for changes to the regression testing framework used in the Fortran based codes in Clawpack. This includes classic, amrclaw , and geoclaw. These changes would be implemented along side of the switch to PyTest as our testing framework.

A couple of items of note:

@mandli mandli added the testing label Jul 24, 2024
@mandli
Copy link
Member Author

mandli commented Jul 24, 2024

Failure Handling

Handling test failure is one of the big items on the list of things to address. Currently everything that would have been placed in the _output directory should be copied into the current working directory by default. This tends to fail if a test is switching working directories during the test. Other suggestions for behavior is welcome.

@mandli
Copy link
Member Author

mandli commented Jul 24, 2024

Placement of tests

Currently all tests are in the $CLAW/package/tests directory. Another way of doing this is to put them in the corresponding example. There is not currently a 1-to-1 correspondence between all the tests and examples but we could do that. Testing data could also reside in these directories as well. One reason we did not do this previously was that nosetests needed some treatment to find tests without adding __init__ everywhere. PyTest does not have this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant