Support az storage blob [upload-batch | sync] --follow-symlinks option

[djc]

Is your feature request related to a problem? Please describe.
I'm trying to update my static website from a continuous deployment process to the static website storage on Azure. The static files (CSS, images etc) live in the top of the repository, above the rest of the website contents, because they're shared with my actual project. I'd like to have a static symlink in the site directory linking to ../static dir, and for the Azure CLI to upload the files from the static dir (symlink) if I do so.

Funnily enough, the underlying azcopy command outputs a warning if I try to upload/sync my symlink, saying INFO: Skipping over symlink at /var/lib/gitlab-runner/builds/DsF6D-si/0/foo/bar/site/static because --follow-symlinks is false. However, the Azure CLI itself does not actually recognize --follow-symlinks, and will thus error out with ERROR: az: error: unrecognized arguments: --follow-symlinks.

Describe the solution you'd like
It would be great if Azure CLI recognized --follow-symlinks and propagated it to the underlying azcopy invocation.

[arrownj]

Hi @Juliehzl , could you please help take a look at this ?

[yonzhan]

add to S166.

[zhoxing-ms]

Hi @djc In fact, only the bottom of command az storage blob sync calls azcopy. In the case of supporting symbolic links, there is a lack of --follow-symlinks parameter. I will submit a PR to solve this problem.
Command az storage blob upload-batch on my side can support symbolic links, what's the problem with you? If there are some problems, Could you please add the --debug parameter to the original command and show me the printed information?

[djc]

I can't easily test this now. In any case I don't just want to upload, I want to fully sync such that old files get removed.

[zhoxing-ms]

@djc Hi, the sync operation of azcopy is not supported --follow-symlinks, while the copy operation of azcopy is supported --follow-symlinks.
So I submitted a PR to add the --follow-symlinks parameter to the command az storage blob copy to support symbolic link. May I ask if this can meet your needs?

[djc]

I really think the sync operation should be able to support following symlinks.

[Juliehzl]

@zezha-msft do you have any plan to add --follow-symlinks in sync?

[zezha-msft]

Hi @djc, we haven't added support for symlinks in the sync command due to the lack of understanding on its intended usage. It's great that you have reached out and provided insights.

I will log this feature request in the AzCopy backlog.

[ghost]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @xgithubtriage.

[tgalery]

Any updates on this one ? This is affecting us and it should be something relatively easy to fix. Happy to contribute as well.

[dav009]

it seems this was fixed here: Azure/azure-cli#13589

[tgalery]

@zezha-msft maybe we can close this ?

[zezha-msft]

Thanks @tgalery @dav009 for following up on this!

[marc-hb]

@zezha-msft do you have any plan to add --follow-symlinks in sync?

I will log this feature request in the backlog.

Looks like

• azcopy sync does not follow symlinks #718