Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Extend ImportArtifacts to be able to "import" artifacts where the data already exists in the given storage backend. #1608

Closed
umesh-timalsina opened this issue Apr 8, 2020 · 2 comments
Closed

Extend ImportArtifacts to be able to "import" artifacts where the data already exists in the given storage backend. #1608

umesh-timalsina opened this issue Apr 8, 2020 · 2 comments
Labels
storage
Milestone
v2.3.0

Comments

@umesh-timalsina
Copy link
Contributor

umesh-timalsina commented Apr 8, 2020 •
edited
Loading

It would be nice if we are able to symlink paths from all the storage backends. Currently, we are just able to upload data from local storage file system.
@brollb
Copy link
Contributor

brollb commented Apr 8, 2020

By "symlink paths from all storage backends", you mean that we should be able to "import" artifacts where the data already exists in the given storage backend, right?

@umesh-timalsina
Copy link
Contributor Author

Yeah. It might be helpful to bring data availability to upper lever operation interface. This can be done at the operation (Python script), but since we already can gather metadata on an artifact stored in a Storage Backend, it might be nicer to bring this capability to the user.

@umesh-timalsina umesh-timalsina changed the title ImportArtifact needs some enhancement Extend ImportArtifacts to be able to "import" artifacts where the data already exists in the given storage backend. Apr 8, 2020
umesh-timalsina added a commit that referenced this issue Apr 9, 2020
@umesh-timalsina
WIP #1608- Extend symLink to S3 Storarge(Initial Implementation)
34e3b28
umesh-timalsina added a commit that referenced this issue Apr 10, 2020
@umesh-timalsina
WIP- #1608- Add Stat method in sciserver-files and complete plugin ex…
1b6fc03 
…tension

1. Add stat method in sciserver-files
2. Complete plugin for transfering arbitrary paths
3. Write tests for stat method in StorageFeatures.spec.js
@brollb brollb added this to the v2.3.0 milestone Apr 13, 2020
umesh-timalsina added a commit that referenced this issue Apr 14, 2020
@umesh-timalsina
WIP- #1608: Move import path logic to a new Plugin
5a44b4f
@brollb brollb closed this as completed in 35e872a Apr 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
storage
Projects
None yet
Milestone
v2.3.0
Development

No branches or pull requests
2 participants
@brollb @umesh-timalsina