v24.46.0

What's Changed

• Add additional delta_hours helper function to config loader by @iwilson-oa in #114
• PostCopy Action Improvements by @atroiano-glue in #115

Full Changelog: v24.45.1...v24.46.0

v24.42.0

What's Changed

• fix: Lazy loading fails when evaluating nested vars by @adammcdonagh in #98
• Bump black from 24.1.1 to 24.10.0 by @dependabot in #103
• v24.42.0 by @adammcdonagh in #109

New Contributors

• @dependabot made their first contribution in #103

Full Changelog: v24.37.2...v24.42.0

v24.21.0

What's Changed

• Fix issue with decryption and improve logging by @adammcdonagh in #72
• Add option to sign encrypted files using a private key by @adammcdonagh in #73
• Fix/makedirs by @iwilson-oa in #74
• v24.19 by @adammcdonagh in #78
• Allow choice of file extension for encryption by @adammcdonagh in #84
• Fix WRAPPER log not closing on SFTP timeout by @adammcdonagh in #85
• Fixes unencrypted files being transferred by @adammcdonagh in #86

New Contributors

• @iwilson-oa made their first contribution in #74

Full Changelog: v24.17.3...v24.21.0

v24.17.3

What's Changed

• Add custom variable files by @adammcdonagh in #42
• Fixes for no error, log renaming & exit status by @adammcdonagh in #43
• Importing modules in batch tasks fail when there's more than 2 tasks by @adammcdonagh in #45
• Update versioning format and fix file transfers by @adammcdonagh in #47
• Allow passing an RSA key into SSH type handlers by @adammcdonagh in #48
• Add batch config validator and update --noop functionality by @adammcdonagh in #49
• v24.9 - Batch/logging improvments. SSH retry logic by @adammcdonagh in #58
• Minor bug fixes by @adammcdonagh in #62
• Fix timeout issue in batch transfers by @adammcdonagh in #64
• Add PGP encryption to transfers and fix file transfer issue by @adammcdonagh in #65
• Replace now Jinja function with utc_now by @adammcdonagh in #67
• Update pre-commit config, VSCode settings, and linting config by @adammcdonagh in #69
• New supportsStatAfterUpload SFTP protocol option by @adammcdonagh in #70
• Fix encryption and decryption when using non-local protocols by @adammcdonagh in #71

Full Changelog: 0.15.0...v24.17.3

v0.15.0

What's Changed

• Additional test coverage by @adammcdonagh in #33
• Fix issue with schema definitions by @adammcdonagh in #34
• Allow jinja2 template task definitions by @adammcdonagh in #35
• Fix schema for port config by @adammcdonagh in #36
• Logging update by @adammcdonagh in #37
• 40 local push files from worker fails when cross filesystem by @adammcdonagh in #41

Full Changelog: 0.13.0...0.15.0

v0.13.0 - Logging & test improvments

• Add additional tests to improve coverage
• Fix some SSH code to use SFTP client whenever possible
• Improve logging for batch tasks
• Fix a bug in local executions where timeouts were failing to parse the process listing, and run the kill command correctly
• Altered log format to include filename and lineno for log messages
• Remove transfer.py script. All transfer related commands for SSH protocol are now done natively using the SSH connection or SFTP commands

https://pypi.org/project/opentaskpy/0.13.0/

v0.12.0 - Improving logging

• Added JSON formatter for logging to stderr. This replaces the default Python logging format with structured JSON output. This is enabled by setting the OTF_LOG_JSON environment variable to 1. Log files are not impact, as these are always in standard format, as this is required for the batch log parsing to allow for rerunability.
• Tidy up logging
• Fix SSH transfers to ensure that SSH connections are fully closed after use
• Update SFTP transfers to use .partial file extension while files are being uploaded, and then rename them to their final name the transfer is complete.
• Altered log level for some messages
• Added OTF_BATCH_RESUME_LOG_DATE to allow resuming of batch runs from a specific date. This is useful if you want to rerun a batch from a specific date, especially if the failure happens just after midnight and the date is no longer the same as the original run.

0.11.0 - Local transfers and executions

What's Changed

• Allow local transfers and executions #29

Full Changelog: 0.10.0...0.11.0

v0.9.0 - New linting

What's Changed

• Update to Python 3.11
• Migrate to better linting
• Refactor code to match new linting rules etc
• Add security scanning via bandit
• Update devcontainer config

Full Changelog: 0.8.1...0.9.0