You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
wasn't being downloaded/recursed correctly with pelican object get -r pelican://<fed url>/my-prefix3/dir1 .. As it turns out, we do recurse, we just don't unpack things in the local filesystem like I expected. Instead of the previous command creating this:
I double checked both mc and cp to see how they handled recursion. Both behave the same where cp -r /some/dir/path . creates path/ and copies files into it and mc cp -r some/s3/path . creates a local path/ where /s in the object names are used for subdirectory nesting. I think we should modify Pelican to behave the same.
The text was updated successfully, but these errors were encountered:
The discussion in #1638 and the ones we've had in the proverbial hallway are perhaps relevant here.
If I recall correctly, I was the one who argued, for example, that given pelican object get -r pelican://<fed url>/my-prefix3/dir1 ., it should be the case that dir1/<sequence_of_chars> should map to (be written into) ./<sequence_of_chars>.
But I suppose I hadn't considered the case where the local destination is ..
This is a followup refinement from #1820, where I claimed that a directory structure a la:
wasn't being downloaded/recursed correctly with
pelican object get -r pelican://<fed url>/my-prefix3/dir1 .
. As it turns out, we do recurse, we just don't unpack things in the local filesystem like I expected. Instead of the previous command creating this:we lose the
dir1
and unpack like this:I double checked both
mc
andcp
to see how they handled recursion. Both behave the same wherecp -r /some/dir/path .
createspath/
and copies files into it andmc cp -r some/s3/path .
creates a localpath/
where/
s in the object names are used for subdirectory nesting. I think we should modify Pelican to behave the same.The text was updated successfully, but these errors were encountered: