2.8.4 (BROKEN)
This release is broken due to #2628 .
Added:
luigi
- Added support for a detailed LuigiRunResult instead of a plain Boolean (#2630)
- Add worker option 'max_keep_alive_idle_duration (#2654)
- Added worker-id commandline parameter (#2655)
luigi.contrib
- Add support for specifying kubernetes namespace (#2629)
- Add a Task wrapper for MicroSoft OpenPAI (#2531)
- Provide automatic URL tracking for Spark applications (#2661) (#2669)
- add beam_dataflow_task to luigi/contrib (#2675)
Both
- Add Prometheus contrib for monitoring purpose (#2628)
Fixed:
luigi
- setup.py: Support older setuptools (<=20.1.1) (#2623)
- Fix broken aws tests (#2658)
- Accept pathlib based path as argument for LocalTarget (#2548)
- Fix durations in D3 graph (fixes #2620) (#2624)
- Import collections ABCs from collections.abc, not collections (#2683)
- Configuration documentation: remove deprecated/wrong [core]max_reschedules entry (#2692)
luigi.contrib
- fixes #2223 HdfsTarget is not working with snakebite (#2572)
- Add port field for PostgresQuery (fixes #2625) (#2627)
Both
- Fix flake errors after moving to python 3 (#2695)
Changed:
luigi
- Simplify implementation of temporary_path() (#2652)
- Prevent range-tasks from autoloading (#2656)
- Replace Python MapReduce example with Spark example. (#2668)
- Minor improvements to single-worker-timeout support (#2667)
- Require at least python-dateutil version 2.7.5 instead of only 2.7.5 (fixes #2662) (#2679)
- RangeMonthly should deal with whole months (#2666)
- Reconcile underscore/dash config style handling (#2688) #2691