-
Notifications
You must be signed in to change notification settings - Fork 317
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
New Feature: Automatic generation of test code #1650
Conversation
Commented out `ClearSolutions` from the list of `preprocessors`
Restructured tests.yml file to support multiple kernel types including Python and R Modified instantiatetests.py to support the new changes
…nment-specific sstuff
Nevermind, found it in |
… the extension branch files and changes moved to the limit_test_cell_height_extension branch
Compares the dataframes after sorting them based on their column names
Modified the check statement in tests.yml to be more robust in handling string quotation marks in python expressions passed to autotest
@jhamrick we've handled all of your comments now. Should be ready for you again! One question did come up. Running |
…the nbgrader repo
…y in the quickstartapp
Hi @jhamrick -- it's been a few months now, and the PR has fallen behind the main branch a bit. This will need a bit of cleanup to get ready for review again. I'm happy to do the cleanup to bring it back up to speed, but I'll hold off on doing that until you let me know that you're ready! |
This PR is superceded by #1817 . We can close this one I think (hopefully the milestone tag can be transferred over to the new PR). |
After #1817 was merged this PR is no longer needed. Closing! |
This is a PR related to Discussion #1633 -- please see that discussion for context!
Alright @jhamrick, as promised, here is the PR for the autotest functionality built into nbgrader. Major changes in this PR:
nbgrader/preprocessors/instantiatetests.py
: A new preprocessor that converts### AUTOTEST
statements into test code. This preprocessor is included in thegenerate_assignments
app and theinstantiate_tests
app.nbgrader/converters/instantiate_tests.py
: A new converter that creates asource_with_tests
folder to see the source copy of the assignment with autogenerated test codethis was removed per @jhamrick request.nbgrader/apps/instantiatetestsapp.py
: A newinstantiate_tests
app that allows instructors to generate the test code in their solution version (this is useful for checking/playing with/debugging the test code that gets generated). The instantiated version of the notebook still contains all solutions and appears in theinstantiated/
folder.This was moved to a separate PR New Feature: Limit test cell height extension #1656 per @jhamrick requestnbgrader/preprocessors/limittestcellheights.py
: A new preprocessor that edits test code cell metadata with a cell height property to ensure they don't get too large/unwieldy in the release version. This is included in thegenerate_assignments
app.This was moved to a separate PR New Feature: Limit test cell height extension #1656 per @jhamrick requestnbgrader/nbextensions/limit_cell_height/
: A new javascript extension responsible for making sure test cells don't get too large in the browser. Any test cell that would be larger than the max height gets a scroll bar instead.nbgrader/docs/source/user_guide/source
folder that illustrate the use of autotest, with test template YaML code innbgrader/docs/source/user_guide/tests.yml
illustrating multiple languagesclearsolutions
preprocessorPlease let @Alireza-Iranpour and myself know if you need any additional info!