Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression Test #23

Closed
wants to merge 132 commits into from
+886 −3
Closed

Regression Test #23

Changes from 1 commit
Commits
Show all changes
132 commits
Select commit Hold shift + click to select a range
fb6b74e
add the initial regression testing files and script for Test01
rafmudaf May 1, 2017
5eaecd4
enable ctest in through cmake
rafmudaf May 1, 2017
3f11b84
gitignore the install directory
rafmudaf May 1, 2017
d780845
wire shell and python scripts to compare Test01 local and gold standard
rafmudaf May 1, 2017
a9a3d4a
gitignore .pyc
rafmudaf May 1, 2017
1cdb41b
add the cmake and ctest configs to reg_tests
rafmudaf May 1, 2017
d713f83
add sim links to some required data directories
rafmudaf May 1, 2017
ed20dad
cleanup the build/reg_tests directory structure
rafmudaf May 1, 2017
7e5954e
pass the tolerance through to the python script from the cmake config
rafmudaf May 1, 2017
dc82e3e
update the baseline input files and solution files; NOTE: .outb's wer…
rafmudaf May 1, 2017
a8ff7d1
add baseline binary output and required 5MW data directory
rafmudaf May 1, 2017
e5b1188
add required AOC directory
rafmudaf May 1, 2017
92f2949
write out binary .out for all tests
rafmudaf May 1, 2017
9aaed62
include more required files for CertTest cases
rafmudaf May 1, 2017
0d64449
include the sim link for required files in CertTest cases
rafmudaf May 1, 2017
34b0fe0
enable all CertTest cases
rafmudaf May 1, 2017
e04627e
copy the source input files and solution directly from CertTest with …
rafmudaf May 2, 2017
2ef8b90
add more descriptive comments
rafmudaf May 2, 2017
ac3d4df
add more descriptive comment
rafmudaf May 2, 2017
03bd836
set tolerance for windows; code cleanup
rafmudaf May 2, 2017
0b0492c
improve argument validation and error handling
rafmudaf May 2, 2017
f65f07e
bug fix on machine/compiler check
rafmudaf May 2, 2017
ff40c83
remove the extraneous shell script in favor of the python comparison …
rafmudaf May 2, 2017
26726a0
rename pass/fail python script
rafmudaf May 2, 2017
af0f26d
allow comparison of ascii to binary output files
rafmudaf May 2, 2017
fdef7e8
use the compiled binary rather than the installed binary to avoid the…
rafmudaf May 2, 2017
eca7522
extract regression test files to a git submodule
rafmudaf May 2, 2017
a3a85f7
remove executable bit on python script since it will be run by callin…
rafmudaf May 2, 2017
8f35721
Merge branch 'dev' into feature/add-submodule
rafmudaf May 2, 2017
da34aab
added the RegressionTestData repo as a submodule
rafmudaf May 2, 2017
0b4fd2a
bug fix on ctest config
rafmudaf May 2, 2017
9a083e1
bug fix on ctest config
rafmudaf May 2, 2017
11db334
reroute ctest config after including submodule
rafmudaf May 2, 2017
d1dde90
bug fix on ctest directory structure config
rafmudaf May 2, 2017
35bb734
Merge branch 'feature/add-submodule' into dev
rafmudaf May 3, 2017
ea1ff86
update RegressionTestData submodule to its latest HEAD
rafmudaf May 3, 2017
2857c59
update submodule HEAD to latest
rafmudaf May 3, 2017
33f7a50
update the failure exit code to a positive non 0 number -> 1
rafmudaf May 3, 2017
bfd725b
update ctest configuration after regression test directory structure …
rafmudaf May 3, 2017
6805f75
replace bash execution of regression test with a python script to do …
rafmudaf May 4, 2017
8eac312
update submodule to latest HEAD
rafmudaf May 4, 2017
1305b32
add tests 20-26
rafmudaf May 4, 2017
5f4029a
replace unused code from development with a more descriptive TODO
rafmudaf May 4, 2017
0b5dd55
Merge remote-tracking branch 'upstream/dev' into dev
rafmudaf May 4, 2017
6348088
use the cmake intrinsic 'file(COPY' rather than 'execute_process' to …
rafmudaf May 4, 2017
de948b9
reference the regression test script directly in the reg_tests direct…
rafmudaf May 4, 2017
1179730
add better argument checking and error handling; run openfast before …
rafmudaf May 4, 2017
f98ce39
update submodule to latest HEAD
rafmudaf May 4, 2017
b1687a3
update submodule to latest HEAD
rafmudaf May 5, 2017
23d2521
check for Fortran compiler not CXX compiler type in CTest
rafmudaf May 5, 2017
4f80719
remove the Clang check, theres no clang fortran compiler
rafmudaf May 8, 2017
e091ab3
rename RegressionTestData -> r-test in gitmodule
rafmudaf May 8, 2017
4d922dd
remote the RegressionTestData repo from submodules
rafmudaf May 8, 2017
6e6e5f1
add r-test submodule referencing the openfast/r-test repo
rafmudaf May 8, 2017
9e97af9
specify a branch in the r-test submodule
rafmudaf May 8, 2017
edc555c
update CMake input files with new regression test data repo name
rafmudaf May 10, 2017
22f92aa
add ctest config files and the steering script
rafmudaf May 10, 2017
91428d2
gitignore the ctest-build directory
rafmudaf May 10, 2017
a2850ba
remove debug print statement
rafmudaf May 10, 2017
a6d3019
add more genericness to the python scripts to ensure cross platform a…
rafmudaf May 10, 2017
30083a2
add configuration for a local cdash to ctest
rafmudaf May 10, 2017
6bff453
update test list file
rafmudaf May 10, 2017
af5872c
configure the steering script for local cdash and to execute the tests
rafmudaf May 10, 2017
b6109aa
add support for multiple solution sets, and automatically choose the …
rafmudaf May 8, 2017
e946b12
add all certtest cases to the test file
rafmudaf May 10, 2017
aee3904
remove unnecessary configurations in ctestconfig; keep file to suppre…
rafmudaf May 10, 2017
51301bb
customize steering script for only running the test -> remove the bui…
rafmudaf May 10, 2017
b205a62
use a variable for the openfast executable in ctest
rafmudaf May 11, 2017
725678d
check for a given openfast executable when running ctest independently
rafmudaf May 11, 2017
3e8e7fb
add a driver to run ctest independently
rafmudaf May 11, 2017
d27f332
updates for windows support
rafmudaf May 11, 2017
5ec4fb8
convert paths to cmake style
rafmudaf May 11, 2017
12c2039
revert a bug fix that wasnt actually a bug fix
rafmudaf May 11, 2017
6135421
automatically determine the test tolerance and leave the option for u…
rafmudaf May 11, 2017
c1d91d8
Merge branch 'feature/ctest-without-cmake' into feature/goldstandard-…
rafmudaf May 11, 2017
e87545c
fix merge conflicts: move submodule to corresponding feature branch
rafmudaf May 11, 2017
43fc58d
add support for optional system and compiler types to the regression …
rafmudaf May 11, 2017
a769c1f
Merge remote-tracking branch 'upstream/dev' into dev
rafmudaf May 11, 2017
6f91311
rename script to manually execute the regression test
rafmudaf May 11, 2017
37d4dbe
update submodule to latest HEAD; rework scripts for updated submodule
rafmudaf May 11, 2017
647bc5f
upgrade r-test submodule to a feature branch
rafmudaf May 12, 2017
31c1916
move submodule remote off of the openfast repo while in development
rafmudaf May 12, 2017
a845e13
bug fix in parsing input variables
rafmudaf May 12, 2017
8a977cf
update call signature to regression test python script
rafmudaf May 12, 2017
543fdd5
update submodule to latest HEAD
rafmudaf May 12, 2017
b92b7f7
update submodule to latest HEAD
rafmudaf May 12, 2017
649d8ba
extend the timeout to 25 minutes, some of the higher cert test cases …
rafmudaf May 15, 2017
7a134f8
update the doc strings of the python programs to more consistent and …
rafmudaf May 15, 2017
69c35ac
add a README to the reg_tests directory
rafmudaf May 15, 2017
f2856b1
include info on running the regression test in the reg_tests README
rafmudaf May 15, 2017
9d94fe2
add a docstring
rafmudaf May 15, 2017
fcd90ee
typo fixes and updates to the README
rafmudaf May 15, 2017
27dc954
typo fix to the README
rafmudaf May 15, 2017
3c7608c
updates to docstrings and the reg_tests README for better clarity
rafmudaf May 15, 2017
03bb880
update the sphinx documentation with automated testing description an…
rafmudaf May 15, 2017
1f346f6
rename r-test gold standard directory from rhel-intel to linux-intel
rafmudaf May 15, 2017
9724970
better handling for system-compiler combinations that dont exist in g…
rafmudaf May 15, 2017
dfeb059
update submodule to latest HEAD
rafmudaf May 16, 2017
5fbb51d
use intrinsic cmake options for including ctest
rafmudaf May 16, 2017
3ef59e8
use more explicit input argument for python script call; refactor cod…
rafmudaf May 16, 2017
633d7df
remote print statement for debugging
rafmudaf May 16, 2017
b18b924
compile the 5MW ServoDyn controllers when building cmake with tests e…
rafmudaf May 16, 2017
ffbde48
verify that the test data submodule was initialized before building t…
rafmudaf May 16, 2017
95843eb
run cmake's ctest in the ctest-build directory for consistency with s…
rafmudaf May 16, 2017
255fe5c
code and comment refactor
rafmudaf May 16, 2017
fcf10ad
convert the executable path to CMAKE style for cross platform compati…
rafmudaf May 16, 2017
a76a5fc
add README to ctest directory
rafmudaf May 16, 2017
cc44d57
automatically determine archtecture type for input to ServoDyn contro…
rafmudaf May 17, 2017
3e2bc3a
add an input argument check for the test tolerance
rafmudaf May 18, 2017
c03f84d
propagate errors upstream for better error reporting, test the given …
rafmudaf May 18, 2017
003a6b2
handle CYGWIN system name in CMake
rafmudaf May 18, 2017
ca15ed5
print updates in the order they are generated; check for valid execut…
rafmudaf May 18, 2017
1fbc8bd
add a print statement for the pass-fail script command
rafmudaf May 19, 2017
75787d2
use a norm rather than variance with an input tolerance to determine …
rafmudaf May 19, 2017
66e9c67
update config file path to use CTest intrinsic variables rather than …
rafmudaf May 22, 2017
587660b
update the comments and README documentation with links, more clear l…
rafmudaf May 22, 2017
044e4f7
update comment
rafmudaf May 22, 2017
a3eeb7d
update README with new scheme determining pass/fail in the regression…
rafmudaf May 22, 2017
1d85041
remove deprecated code
rafmudaf May 23, 2017
5d892f7
update python scripts to Python 3 syntax
rafmudaf May 23, 2017
a78ad74
find the highest python interpreter available in CMake and use it for…
rafmudaf May 23, 2017
85de90d
update all python call signatures in documentation to python3; update…
rafmudaf May 23, 2017
d44fdb1
update submodule to latest HEAD
rafmudaf May 23, 2017
352bc47
update the readthedocs test documentation to reflect an updated pass/…
rafmudaf May 23, 2017
ddd75cd
update the regression test readthedocs with more clear language
rafmudaf May 23, 2017
fa79010
configure reg_tests as a cmake subproject so it can be built independ…
rafmudaf May 24, 2017
a1a8abf
update python program after changes to cmake driver; accept more expl…
rafmudaf May 24, 2017
09f5368
update submodule to latest HEAD
rafmudaf May 24, 2017
b8f221e
remove deprecated ctest standalone configuration files
rafmudaf May 24, 2017
adb6184
remove deprecated python ctest driver
rafmudaf May 24, 2017
e0a1619
add license summary to the top of source code
rafmudaf May 24, 2017
5ad56fb
update the documentation after regression test rework
rafmudaf May 24, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
update submodule to latest HEAD
@rafmudaf
rafmudaf committed May 23, 2017

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode
commit d44fdb1cbb096a27b9e6b908832f28c10c248c68
2 changes: 1 addition & 1 deletion reg_tests/r-test
Submodule r-test updated from 5fc787 to efb1e8