-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Develop #52
Merged
Merged
Develop #52
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This behavior is now more like other utilities where specifying the flag multiple times extends the value of the argument. For example, -e '.nc .h5 .zip' becomes -e '.nc' -e '.h5' -e '.zip' This is less fragile for the user and possibly less confusing how the argument should be formatted on the command line.
I did it this way so each file could be compressed without hard-coding the compression algorithm. But I could see this being used to run a pre-processing script on each downloaded file.
Don't consume all arguments after --extensions
Add ability to execute arbitrary commands on each downloaded file
* Develop (#32) * Don't consume all arguments after --extensions This behavior is now more like other utilities where specifying the flag multiple times extends the value of the argument. For example, -e '.nc .h5 .zip' becomes -e '.nc' -e '.h5' -e '.zip' This is less fragile for the user and possibly less confusing how the argument should be formatted on the command line. * Add ability to execute arbitrary commands on each downloaded file I did it this way so each file could be compressed without hard-coding the compression algorithm. But I could see this being used to run a pre-processing script on each downloaded file. * updated README and tests for additive -e examples * force 'action' * merged code for extensions, process call, and updated documentation * fix for #28 * updated CHANGELOG Co-authored-by: Joe Sapp <joe.sapp@noaa.gov> Co-authored-by: mgangl <mike.gangl@gmail.com> * closes #33 added 'files to download' to non-verbose output * updated changelog Co-authored-by: Joe Sapp <joe.sapp@noaa.gov> Co-authored-by: mgangl <mike.gangl@gmail.com>
* added pypi release badge to README * began separating out functionality for data downloader * 1.7.2 merge into develop (#43) * Don't consume all arguments after --extensions This behavior is now more like other utilities where specifying the flag multiple times extends the value of the argument. For example, -e '.nc .h5 .zip' becomes -e '.nc' -e '.h5' -e '.zip' This is less fragile for the user and possibly less confusing how the argument should be formatted on the command line. * Add ability to execute arbitrary commands on each downloaded file I did it this way so each file could be compressed without hard-coding the compression algorithm. But I could see this being used to run a pre-processing script on each downloaded file. * updated README and tests for additive -e examples * force 'action' * merged code for extensions, process call, and updated documentation * fix for #28 * updated CHANGELOG * Issue 33 (#35) * Develop (#32) * Don't consume all arguments after --extensions This behavior is now more like other utilities where specifying the flag multiple times extends the value of the argument. For example, -e '.nc .h5 .zip' becomes -e '.nc' -e '.h5' -e '.zip' This is less fragile for the user and possibly less confusing how the argument should be formatted on the command line. * Add ability to execute arbitrary commands on each downloaded file I did it this way so each file could be compressed without hard-coding the compression algorithm. But I could see this being used to run a pre-processing script on each downloaded file. * updated README and tests for additive -e examples * force 'action' * merged code for extensions, process call, and updated documentation * fix for #28 * updated CHANGELOG Co-authored-by: Joe Sapp <joe.sapp@noaa.gov> Co-authored-by: mgangl <mike.gangl@gmail.com> * closes #33 added 'files to download' to non-verbose output * updated changelog Co-authored-by: Joe Sapp <joe.sapp@noaa.gov> Co-authored-by: mgangl <mike.gangl@gmail.com> * updated changelog to reflect accurate versions released * version bump for master delivery Co-authored-by: Joe Sapp <joe.sapp@noaa.gov> Co-authored-by: mgangl <mike.gangl@gmail.com> * fixed tests * removed erroneous printouts for pytest fixes * fixed some bugs closes #39 closes #40 * Update README.md * updates for flake8 * fixed issue with time_offset variables, added manual tests * flake8 updates for access, subscriber * added downloader tests, flake8 updates for download client Co-authored-by: Joe Sapp <joe.sapp@noaa.gov> Co-authored-by: mgangl <mike.gangl@gmail.com>
* Ignore error if directory already exists Fixes #46 * issues/46: Ignore errors if destination directory already exists. Co-authored-by: Frank Greguska <Francis.Greguska@jpl.nasa.gov>
* Added functionality to name .update file to .update__<COLLECTION> so that the same directory can be re-used. Added tests to fix this functionality closes #44 * flake8 fixes * added updates to .update file
* added cycle based downloads * udpated changelog
* added changelog info for 1.80, created initial markdown files * added subsriber/downloader links * added documentation * Added downloader/subscriber specific docs. fixed some issues with imports
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
deliver 1.8.0