You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The reason I was interested in this tool was to merge ~2TB (3gb chunks) of data without downloading it to a middleman server first.
Doing this in serial will take too long.
I'm not great with rust but I I ended up creating a copycat project in javascript to do this https://gitlab.com/joshwillik/s3-concat (in case you want to read my implementation)
The text was updated successfully, but these errors were encountered:
The reason I was interested in this tool was to merge ~2TB (3gb chunks) of data without downloading it to a middleman server first.
Doing this in serial will take too long.
I'm not great with rust but I I ended up creating a copycat project in javascript to do this
https://gitlab.com/joshwillik/s3-concat (in case you want to read my implementation)
The text was updated successfully, but these errors were encountered: