luigi.contrib.azureblob needs updating

[marhoy]

The luigi.contrib.azureblob depends on the old version of the azure.storage.blob package.
It needs to be rewritten/updated to support the 12.x.y-series of azure.storage.blob.

@manish, @ckiosidis : You are listed as contributers. Any plans for updating? If you need to continue to support the old interface, then maybe make a new module that supports the new interface?

Old (aka Legacy):
https://docs.microsoft.com/en-us/python/api/azure-storage-blob/azure.storage.blob?view=azure-python-previous

New:
https://docs.microsoft.com/en-us/python/api/azure-storage-blob/azure.storage.blob?view=azure-python

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If closed, you may revisit when your time allows and reopen! Thank you for your contributions.

[icfly2]

Is the bot marking as won't fix accurate?

The old azure setup is pretty outdated now and a change / new contrib module shouldn't be too hard. What is the best way forward? Update the contrib.azure, make contrib.azure12 or switch to airflow?

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If closed, you may revisit when your time allows and reopen! Thank you for your contributions.

[kaydee-edb]

Any update on this ? Are there any plans to update the blob storage API's per new SDK ?

[lallea]

This is a community driven open source project. Hence, there are no plans and no roadmap. If you care about updated azure integration, you can drive the issue forward by submitting a patch or valuable information, or you can offer to pay someone to do the necessary work.

[kaydee-edb]

Thank you. I can pick it up. Will try to create a new contrib module for azure blob v12.

[Jpowell94]

@kaydee-edb Are you able to share any progress updates?

[bcamel]

I am going to bump this up because I intented to use a luigi task to upload some objects into Azure Blob, but noticed that the dependency required for the regarding contrib module are outdated as mentioned in this issue.

For now, I have only used the changes of the linked PR against a local instance of Azurite. Maybe unit tests need extension to cover various parametrisations for the AzureBlobClient?