-
Notifications
You must be signed in to change notification settings - Fork 1
Workflows
Victor Escorcia Castillo edited this page Sep 22, 2018
·
1 revision
WIP: intro of blah blah blah
By 2018 and good network connections, syncing data <50G can be done plainly with rsync.
However, if the "repository" has a lot of small files (<1MB) or is simply bigger. I prefer the following 3 steps procedure:
-
tar the data and split it in chunks of ~5G
-
rsync the chunks
-
join the chunks and untar
Where does the magic numbers come from?
Basically, the speed and robustness of your network 😉