Skip to content
This repository has been archived by the owner on Jul 19, 2024. It is now read-only.

Make Storage delated pojos Serializable #565

Open
pkgajulapalli opened this issue Aug 9, 2021 · 0 comments
Open

Make Storage delated pojos Serializable #565

pkgajulapalli opened this issue Aug 9, 2021 · 0 comments

Comments

@pkgajulapalli
Copy link

Which service(blob, file, queue, table) does this issue concern?

blob

Which version of the SDK was used?

Please note that if your issue is with v11, we are recommending customers either move back to v11 or move to v12 (currently in preview) if at all possible. Hopefully this resolves your issue, but if there is some reason why moving away from v11 is not possible at this time, please do continue to ask your question and we will do our best to support you. The README for this SDK has been updated to point to more information on why we have made this decision.

Storage SDK v8 for Java:
com.microsoft.azure
azure-storage
8.6.6

What problem was encountered?

I tried to use this SDK in our spark based code. Any task that is executed on top of a Dataframe/RDD will be serialized and sent to spark executors. As StorageCredentials and other blob related classes are not serializable, spark couldn't use them to upload/download files to azure file storage in parallel.

Have you found a mitigation/solution?

No

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant