3.0.3

Added:

luigi

• Adding retry on _obj_exists #3022
• don't use absolute path in redirect for visualizer #2785

luigi.contrib

• kubernetes: labels are applied to pod #3007

Fixed:

luigi

• Flush stream_for_searching_tracking_url #3000

luigi.contrib

• Fix azureblob tests: use json instead of numpy #3032

Changed:

luigi

• replace naive retry with tenacity #3026

3.0.2

3.0.2

Fixed:

luigi

• Garbage collect task result queue when worker context exits #2973
• Fixing problem with ListParameter and Dynamic Dependencies #2970

Changed:

luigi

• Drop Python 3.3 and 3.4 support #2978

luigi.contrib

• Use updated uri for gcs batch reqs #2998

3.0.1

Added:

luigi

• Worker_timeout can be 0. #2968
• Return bq job id from biquery.run_job() #2957
• Documentation for check_complete_on_run config #2961

3.0.0

3.0.0

This is a major release without many feature changes compared to 2.8.13. The reason we decided to give it a major bump is the drop of Python2 support. From this version on, Luigi stops supporting Python2 for the obvious reason. 3.0.0 release includes a series of PRs deprecating Python2, plus a few other changes listed below. Special thanks go to @drowoseque for doing all the great work!

Added:

luigi

• Show task progress in visualizer workers tab. #2932

Fixed:

luigi

• Fix TravisCI build #2948
• Use is_alive in favour of isAlive for Python 3.9 compatibility. #2940

2.8.13

Added:

luigi.contrib

• Presto support in Luigi (#2885)

Fixed:

luigi

• removed wrong type of Target.init path arg from doc master (#2927)
• remove StreamingBodyAdaptor that didn't allow choosing the chunk size (#2929)
• Fix docs explaining write modes for Luigi Targets. Closes #2783 (#2931)
• All configuration parameters in docs now use underscore in their names for consistency. (#2890)

Changed:

luigi

• Allowed wider popovers in grapth. (#2093)
• update documentation to prefer pykube-ng (#2924)

2.8.12

Added:

luigi

• EnumListParameter #2801

Fixed:

luigi

• Import ABC from collections.abc instead of collections for Python 3.9 compatibility #2895

Changed:

luigi.contrib

• [luigi.contrib.hive] HiveTableTarget inherits HivePartitionTarget #2872
• [luigi.contrib.pyspark_runner] SparkSession support in PySparkTask #2862

3.0.0b2

This the second 3.0.0 beta release including a series of PRs deprecating Python2, plus following:

Special thanks go to @drowoseque for doing all the great work!

Added:

luigi

• Add internal version info #2760
• EnumListParameter #2801 (new since 3.0.0b1)

luigi.contrib

• [luigi.contrib.spark] pyspark python options added #2818

Fixed:

luigi

• Fix params hashing #2540
• Check for autoload_range istead of autoload-range
• autoload_range doc fix #2878 (new since 3.0.0b1)

Removed:

luigi

• [luigi.file] removed #2832
• [luigi.mock.MockFile] removed #2839

Changed:

luigi

• Allow python-daemon >= 2.2.0 if not on windows #2796
• Make URLLibFetcher aware of basic auth info in scheduler URL. #2791

luigi.contrib

• [luigi.contrib.external_program.ExternalProgramTask] logs_output_pattern_to_url provided #2822
• [luigi.contrib.hive] HiveTableTarget inherits HivePartitionTarget #2872 (new since 3.0.0b1)
• [luigi.contrib.pyspark_runner] SparkSession support in PySparkTask #2862 (new since 3.0.0b1)

2.8.11

Added:

luigi

• Add internal version info #2760

luigi.contrib

• [luigi.contrib.spark] pyspark python options added #2818

Fixed:

luigi

• Fix params hashing #2540
• Check for autoload_range istead of autoload-range
• autoload_range doc fix #2878

Removed:

luigi

• [luigi.file] removed #2832
• [luigi.mock.MockFile] removed #2839

Changed:

luigi

• Allow python-daemon >= 2.2.0 if not on windows #2796
• Make URLLibFetcher aware of basic auth info in scheduler URL. #2791

luigi.contrib

• [luigi.contrib.external_program.ExternalProgramTask] logs_output_pattern_to_url provided #2822

2.8.10

Added:

luigi

• Add HEAD endpoint to scheduler server for status/health checks #2789

luigi.contrib

• [luigi.contrib.hive] WarehouseHiveClient #2826

Fixed:

luigi.contrib

• Add Python version-agnostic get_writer_schema. #2827
• PySparkTask: handle special characters in name (#2778) #2779

Changed:

luigi.contrib

• [luigi.contrib.spark] tracking_url_pattern as a property #2820
• Add pod_creation_wait_interal #2813
• Added optional argument 'aws_session_token' to S3Client #2798

2.8.9

Added:

luigi

• Adds "Force Commit" button in UI to set tasks to DONE #2751
• Show task history link in visualizer when recording. #2759

Fixed:

luigi

• Replace documentation reference to outdated test environment py27-nonhdfs #2762
• Issue 2644: Tasks can be run several times under certain conditions #2645

luigi & luigi.contrib

• Ensure ignored tests are picked up by tox #2758

Changed:

luigi

• Update tornado requirement for new enough python versions #2761

luigi.contrib

• contrib/ftp: Clean up temporary files #2755