Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azcopy list on subfolder #1546

Closed
brentmjohnson opened this issue Sep 9, 2021 · 4 comments
Closed

Azcopy list on subfolder #1546

brentmjohnson opened this issue Sep 9, 2021 · 4 comments

Comments

@brentmjohnson
Copy link

Which version of the AzCopy was used?

Note: The version is visible when running AzCopy without any argument

AzCopy 10.12.1

Which platform are you using? (ex: Windows, Mac, Linux)

Linux

What command did you run?

Note: Please remove the SAS to avoid exposing your credentials. If you cannot remember the exact command, please retrieve it from the beginning of the log file.

./azcopy list https://{STORAGE ACCOUNT}.blob.core.windows.net/{BLOB CONTAINER}/{SUBFOLDER}/
Note: executed using AAD OAUTH authentication

What problem was encountered?

Command returns blobs from all subfolders

How can we reproduce the problem in the simplest way?

Execute the above command on a blob container with subfolders

Have you found a mitigation/solution?

List everything in the container then filter client-side but this is very time consuming for containers with a lot of subfolders

This appears to have been addressed previously in #583? Maybe there was a reversion.

@adreed-msft
Copy link
Member

To be clear; you want a --recursive=false option for list?

@brentmjohnson
Copy link
Author

To be clear; you want a --recursive=false option for list?

This was actually a bug report because it didn't seem like #583 was working anymore, but it looks like I was wrong.

My issue in this case had to do with the container name: $web AzCopy doesn't seem to be URL encoding the remote source / destination args. As soon as I replaced $web with %24web the list command did exactly what I expected - list all blobs under the specified subfolder path recursively.

The URL encoding handling of "$" in remote source / destination args may be a separate issue. For reference, the generated SAS token URL for the $web container does not URL encode the "$"

@marc-hb
Copy link

marc-hb commented Dec 3, 2022

To be clear; you want a --recursive=false option for list?

I don't know about @brentmjohnson but I certainly do, otherwise the list command becomes totally unusable for top level folders. Is there already a request filed about this? I didn't find it yet.

EDIT, found it now:

Somewhat related:

@seanmcc-msft
Copy link
Member

Unfortunately, we are not going to add this functionality. We are focused on documentation, testing, and quality, and this feature would represent a large increase in scope for the product.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants