Service Accounts are useful for those of us who wish to copy large amounts of data among/between Google Team/Shared drives. They will bypass the 750GB a day upload limit that is imposed upon all Google Drive accounts. Once this script is completed you can use any simple bash script along with the most recent version of the official RCLONE client to preform your drive to drive operations. Since you can utilize server to server transfers you will see very fast transfer speeds (I have seen over 5 GB/s so far!).
If you are trying to copy from a Shared/Team drive to a personal drive or vice versa this is not a good solution due to the fact that these service accounts can only carry up to 15GB of data each. However, when copying among Shared/Team drives since the storage never has to go to the SA's personal storage this will allow you to copy/transfer up to 75TB a day!
These scripts require Bash/WSL with v3.10 of Python already installed and configured.
- Create a google group of which you are the OWNER.
- Create an app in the Google Cloud Console at this link - https://console.cloud.google.com/
- Once you have created an app and have it selected click the hamburger menu in the top left and select Oauth Consent Screen under the APIS and Services item in the left menu -
- Set the app to EXTERNAL, enter your email in the required fields and click next.
- DO NOT CONFIGURE ANY SCOPES, instead just keep clicking next til you are finished. Once you have done this you will see a button that says PUBLISH YOUR APP in the Oauth Consent Screen section, click it to publish your app.
- Enable each of the APIs in this image for your app -
-
Inside your WSL/Bash terminal run the following command, ensuring that your Google Chrome window where you configured your app is the last google chrome windows you have clicked on.
-
Launch the script with
./__RUNMEFROMTHISFOLDER.sh(If you're running the script for the first time run this command first beforehand:chmod a+x ./__RUNMEFROMTHISFOLDER.sh) -
Follow the on screen prompts.
Here is a video of me completing the majority of the process:
https://gfycat.com/IdealisticAgonizingArgentinehornedfrog
[Note: due to this being uploaded to GFYCat you have to click on the button labeled SD to switch it to HD quality otherwise it will be mostly illegible.]
P.S. I will be adding an example config & my uploading scripts that automatically iterate through the 100 Service Accounts within the coming days.