Document minio bucket setup

[knl88]

    **STORAGE**

Lorand@Sigma2 has now confirmed that we have the granted 10TB storage available for SeaBee.

Next steps is to:

a) Decide/confirm folder structure for data being uploaded (and to be migrated from temporary SharePoint);

Question is whether we should introduce a 'top-level' based on who (i.e. which institution/organization) is responsible for the respective mission (e.g. folders for NINA, NTNU, IMR, NIVA, Spectrofly, GRID, and perhaps "External"?) and distribute/segregate data accordingly...

=> Action point: post question and/or call for short dedicated meeting aimed at concluding on this as soon as possible.

b) Based on the above:

=> Establish/set up and verify relevant methods for uploading data from missions (ref. Rclone, MiniIO app, other?)

=> Migrate existing data from temporary storage (SeaBee SharePoint) to Sigma.

=> Establish/update user guidance and documentation for those uploading data from missions.

=> (Other steps/actions?)

Originally posted by @KristofferKa in https://github.com/SeaBee-no/seabee-iac/issues/9#issuecomment-1332366706

[knl88]

Also relevant for #11, but currently minio have the /data subpath as bucket root so that applications can use root

[knl88]

@deviirmr How was the structure you envisioned for dmc? Do you want to take point a? I would perhaps think a bit more granular setup like on seabirds or project would be better than one big bucket on organization, but I don't have any strong meaning on the topic:)

[knl88]

Also think #13 is relevant for both a) and b) , more specifically this section

For the first point on b) I have added a couple of short notes in storage.md

[JamesSample]

@knl88 When you get chance, could you provide an overview of the steps to setup RClone with Sigma2 here, please? Arnt-Børre was asking about how to connect using RClone at a meeting yesterday, and I said we'd update the docs. Obviously credentials etc. should be provided separately, but a short guide describing the setup would be useful.

Thanks!

[knl88]

@knl88 When you get chance, could you provide an overview of the steps to setup RClone with Sigma2 here, please? Arnt-Børre was asking about how to connect using RClone at a meeting yesterday, and I said we'd update the docs. Obviously credentials etc. should be provided separately, but a short guide describing the setup would be useful.

Thanks!

Yep, updated the section in ee9aaef, okey? For some minio related tasks mc can also be a good option.

[JamesSample]

Perfect - thanks Kim!

I'll leave the open as a reminder for me to make some other edits later, but that looks great for RClone :-)