2.0.5 (Apr 30th, 2020)
Metaflow 2.0.5 Release Notes
- Improvements
- Fix logging of prefixes in
datatools.S3._read_many_files
. - Increase retry count for AWS Batch logs streaming.
- Upper-bound
pylint
version to< 2.5.0
for compatibility issues.
- Fix logging of prefixes in
The Metaflow 2.0.5 release is a minor patch release.
Improvements
Fix logging of prefixes in datatools.S3._read_many_files
Avoid a cryptic error message when datatools.S3._read_many_files
is unsuccessful by converting prefixes
from a generator to a list.
Increase retry count for AWS Batch logs streaming.
Modify the retry behavior for log fetching on AWS Batch by adding jitters to exponential backoffs as well as reset the retry counter for every successful request.
Additionally, fail the metaflow task when we fail to stream the task logs back to the user's terminal even if AWS Batch task succeeds.
Upper-bound pylint version to < 2.5.0.
pylint
version 2.5.0
would mark Metaflow's self.next()
syntax as an error. As a result, python helloworld.py run
would fail at the pylint check step unless we run with --no-pylint
. This version upper-bound is supposed to automatically downgrade pylint
during metaflow
installation if pylint==2.5.0
has been installed.