Test run work and results dir; relative path rules #1005
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This patch consists of three changes to the test suite:
Tests are now run in dedicated work directories. This allows for
parallel execution of tests inside of make.
Unexpected improvements are a 3-4x speedup on test time, and the
disappearance of several anomalous "negative zero" issues which were
otherwise unreproducible outside of the test, suggesting that
replacing the serial runs inside of the tc directories has resolved
some otherwise unknown problems.
Makefile rules for running tests are now defined relative to the
.testing directory, rather than an explicit base directory based on
the path of the Makefile.
Although this method is slightly less robust and slightly more prone
to error, it makes it easier to build and run individual files within
the project.
Build paths are still absolute, and will be updated in a separate
commit.
Test output is now stored in a
results
directory, rather than insidethe tc* configuration directories.