Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend SideAPI To Enable IPFS Data Imports #27

Open
bonedaddy opened this issue Feb 28, 2020 · 0 comments
Open

Extend SideAPI To Enable IPFS Data Imports #27

bonedaddy opened this issue Feb 28, 2020 · 0 comments

Comments

@bonedaddy
Copy link

bonedaddy commented Feb 28, 2020

Currently there is no way to take existing data on IPFS and import it into S3X. As this functionality isn't related to MinIO, we can't extend the front-facing MinIO API, and need to implement this via the SideAPI.

Essentially this SideAPI call should allow users to:

  • Specify the bucket name
  • Specify the object name to store the data under
  • Specify the IPFS CID to "import"

We should then perform a set of operation similar to the following:

  • If bucket doesn't exist, create it
  • If object doesn't exist, create it referencing the IPFS CID
  • If object does exist, have the hash it points to updated to the IPFS CID we are importing

Edit:

One thing I realized is that we need to make sure that the IPFS CID is of type UnixFS, otherwise we may get inconsistency with the way S3X behaves. One possibility is that if the IPFS CID isn't a UnixFS object we simply read the data into memory and store it as a UnixFS object

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant