Skip to content

RClone Cache

Jump to bottom Edit New page
PhysK edited this page Jan 22, 2020 · 2 revisions

.

WARNING! This has nothing to do with SuperTransfer2

Table of Contents: RClone (Cache)

Official Logo

About RClone

Is a "rsync for cloud storage" - Google Drive, Amazon Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Cloudfiles, Google Cloud Storage, Yandex Files

Installing RClone Unencrypted Cache via PTS

Launch PlexGuide

Select the following options once PTS is loaded: PTS Program Suite > Beta > RClone (Unencyrpted)

Configure RClone (Cache)

When you deploy the unencrypted portion of the program for the FIRST TIME, you should see RClone complaining about a file missing. Basically, you are creating a file for the first time. You may be asking if you catch on; why unionFS? Well, it was part of the prior setup we had, but it allows us to move data across on our terms, with better control. This also prevents endless amounts of data building up in the cache; where as everything that is ready to be transfered is sitting in /mnt/move... thus meaning while your waiting; your able to watch your media!

[Part 1 of 2 - Setting up Google Drive]

Demo Picture: New RClone Start Configuration

  • Type the Letter "n" to create a NEW Remote for RClone.

Next, call the remote "gdrive" <<< case sensitive

  • Drive Type: Select Option #11 for Google Drive (Version RClone 1.40)
  • Google Client ID: LEAVE BLANK and Press ENTER
  • Google Client Secret: LEAVE BLANK and Press ENTER
  • Drive Scope: Select Option Number 1 (From the Picture Above)
  • Root Folder ID: Just Press [ENTER]
  • Service Account File: Just Press [ENTER]
  • Asks you About Config?
    • y - only if you are physically on the machine (rarer these days)
      • Login with the CORRECT Google Account and Copy the Code
    • n - if using remotely, somewhere else (most cases these days)
      • Copy the http:// link & Paste it into your Browser
  • Login with the CORRECT Google Account and Copy the Code.
  • Paste the Code into Terminal and Press Enter
  • n - for 'Configure this as a team drive?'
  • y - Yes this is OK
  • DO NOT QUIT - Continue

[Part 2 of 2 - Setting up Cache]

  1. Setup a New Remote

  1. Name it cache - This is case senstive!

  2. Press 6 for Cache (make sure to check, the numbers can change)

  1. Type gdrive: - This is case senstive!

  1. Leave the URL Blank

  1. Type in your PLEX User Name (Recommend to keep it case sensitive)

  1. Type in your PLEX Password

  1. Chunk Size: 10MB - You can type exactly

  1. Info Age: 6h - You can type exactly

  1. Chunk Total Size: 10G - You can type exactly

  1. Check your config, type y and press ENTER to SAVE! Then press q and then ENTER to exit!

  2. To check on everything, type:

  • ls -la /mnt/gdrive
  • ls -la /mnt/unionfs

They should mirror each other (it's recommend to drop some kind of file in Google to verify that it's correct)

-----

Installing RClone Encrypted Cache via PTS

NOTE: Still in testing - Do Not Use!!!!

Launch PlexGuide

Select the following options once PTS is loaded: PTS Program Suite > Beta > RClone (Encyrpted)

Configure RClone (Cache Encryption)

When you deploy the encrypted portion of the program for the FIRST TIME, you should see RClone complaining about a file missing. Basically, you are creating a file for the first time. You may be asking if you catch on; why unionFS? Well, it was part of the prior setup we had, but it allows us to move data across on our terms, with better control. This also prevents endless amounts of data building up in the cache; where as everything that is ready to be transfered is sitting in /mnt/move... thus meaning while your waiting; your able to watch your media!

[Part 1 of 4 - Setting up Google Drive]

Demo Picture: New RClone Start Configuration

  • Type the Letter "n" to create a NEW Remote for RClone.

Next, call the remote "gdrive" <<< case sensitive

  • Drive Type: Select Option #11 for Google Drive (Version RClone 1.40)
  • Google Client ID: LEAVE BLANK and Press ENTER
  • Google Client Secret: LEAVE BLANK and Press ENTER
  • Drive Scope: Select Option Number 1 (From the Picture Above)
  • Root Folder ID: Just Press [ENTER]
  • Service Account File: Just Press [ENTER]
  • Asks you About Config?
    • y - only if you are physically on the machine (rarer these days)
      • Login with the CORRECT Google Account and Copy the Code
    • n - if using remotely, somewhere else (most cases these days)
      • Copy the http:// link & Paste it into your Browser
  • Login with the CORRECT Google Account and Copy the Code.
  • Paste the Code into Terminal and Press Enter
  • n - for 'Configure this as a team drive?'
  • y - Yes this is OK
  • DO NOT QUIT - Continue

[Part 2 of 4 - Setting up Cache]

  1. Setup a New Remote

  1. Name it cache - This is case senstive!

  2. Press 6 for Cache (make sure to check, the numbers can change)

  1. Type gdrive:/encrypt - This is case senstive!

  1. Leave the URL Blank

  2. Type in your PLEX User Name (Recommend to keep it case sensitive)

  1. Type in your PLEX Password

  1. Chunk Size: 10MB - You can type exactly

  1. Info Age: 6h - You can type exactly

  1. Chunk Total Size: 10G - You can type exactly

  1. Check your config, type y and press ENTER to SAVE!

  1. DO NOT QUIT - Continue

[Part 3 of 4 - Setting up Encryption side of cache]

This encrypted mount will be for unionfs.service.

  • n < For New remote
  • cachecrypt < for the name
  • 8 < For Encrypt/Decrypt (double check the number select incase)
  • cache: (this will already point to the encrypted folder within your gdrive)
  • 2 < Encrypt standard
  • 1 < Turn on Directory Encryption
  • y < type your own password (make up a secure one and write it down somewhere safe otherwise use the one from before if you already created it for whichever original encrypted folder you want to use - for example DTHBCH434G45)
  • y < type your own salt password (make up a different secure one and write it down somewhere safe otherwise use the one from before if you already created it for whichever original encrypted folder you want to use - for example ER7UNK7UB6C44)

Should see something like this:

[N|Demo]

[Part 4 of 4 - Setting up Encryption for move script]

This encrypted mount will be used for the move.sh to upload stuff to your Google Drive.

  • n < For New remote
  • gcrypt < for the name
  • 8 < For Encrypt/Decrypt (double check the number select in case)
  • gdrive:/encrypt (encrypt being the name of the rclone encrypted folder within your gdrive)
  • 2 < Encrypt standard
  • 1 < Turn on Directory Encryption
  • Y < type your own password (use the same password as above for crypt - for example DTHBCH434G45)
  • Y < type your own salt password (use the same SALT password as above for crypt - for example ER7UNK7UB6C44)

Should see something like this:

[N|Demo]

  • Then press q and then ENTER to exit!

To check on everything, type:

  • ls -la /mnt/gdrive
  • ls -la /mnt/unionfs

They should mirror each other (it's recommended to drop some kind of file in Google to verify that it's correct)

PTS Forum Support: RClone

https://PTS/forums/PTS-3rd-party-programs.148/

N|Demo

N|Solid N|Solid

IGNORE ALL THIS (Notes)

DEVELOPMENT: RClone Cache is being implemented for PlexGuide, but is not fully ready.

RClone Cache basically is ... (will continue to be improved upon).

RClone Beta Install: Before you proceed onward an as a warning for now, install RClone Beta before proceeding onward for testing with

curl https://rclone.org/install.sh | sudo bash -s beta

Below are two major ways you can utilized RClone Cache for PlexGuide:

RClone Cache Unencrypted

In rclone config, make a Google Drive mount (type 11 as of RClone 1.40). Name it "gdrive". Select type 1, "Drive" Put in your API and Secret from console.developers.google.com. Note that this can be from a different account than your unlimited. Say no to the token question, then copy paste this into your web browser. Sign in to the account with unlimited GD storage, then copy the confirmation code it gives you back into RClone. Finally, confirm the mount.

Next, make a Cache mount (type 6 as of RClone 1.40) and name it "cache". It is currently unknown what settings are ideal for PTS users. Point it at gdrive: (or whatever your PTS folder in GD is) and put in your Plex credentials if auto-sync is desired. All reading traffic (Sonarr, Radarr, Plex, etc) should be passed through this mount, whereas uploading traffic (Move script) should point at the direct mount.

RClone Cache Encrypted

In rclone config, make a Google Drive mount (type 11 as of RClone 1.40). Name it "gdrive". Select type 1, "Drive" Put in your API and Secret from console.developers.google.com. Note that this can be from a different account than your unlimited. Say no to the token question, then copy paste this into your web browser. Sign in to the account with unlimited GD storage, then copy the confirmation code it gives you back into RClone. Finally, confirm the mount.

Next, make a Cache mount (type 6 as of RClone 1.40) and name it "cache". It is currently unknown what settings are ideal for PTS users. Point it at gdrive:/encrypt (or whatever your PTS folder in GD is) and put in your Plex credentials if auto-sync is desired.

Next, make a Crypt mount (type 8 as of RClone 1.40) and name it "crypt" and point it at "cache::". This will be the output directory that will be read by Plex. Secure it with a Password and Salt. All reading traffic (UnionFS, Plex, Sonarr, Radarr) should read from here as to avoid API bans.

Finally, make another Crypt mount and name it "gcrypt". Point this at "gdrive:/encrypt" directly. This should be used by the Move script and all other write-traffic.

Use or RClone guide if you need more info.

Visit our Website By Click the Picture Below! N|Demo

N|Solid N|Solid

Wiki - Wiki

Useful Starter Links

  1. Introduction
  2. G-Suite Signup
  3. Recommended NewsHosts
  4. Change Log

Prior Planning 101

  1. Recommended Pre-Reading
  2. Server - Storage Planning
  3. Usenet or BitTorrent
  4. PTS Editions
  5. PTS Folder Structure
  6. PTS-Repos
  7. Common Issues

Deploy & Config

PTS-Team
  1. SSH Server Access
  2. Install PTS
  3. WatchTower
  4. Remote Path Mappings

Data Transport
  1. PTS Clone
    1. Google OAuth Keys
    2. PTS Move
    3. PTS Blitz
    4. 2nd HD Option

Key Components

  1. Traefik
  2. Port Guard
  3. PTS Shield
  4. PTS Press
  5. Google Cloud - GCE
    1. Automated setup
  6. Hetzner Cloud
  7. PTS Fork
  8. Extra PTS Commands

Blitz App Info

  1. Accessing PTS Apps
  2. App Port Scheme

Tools & Services

Core Apps [Expand]
  1. Emby
  2. Jackett
  3. Jellyfin
  4. LazyLibrarian
  5. Lidarr
  6. Netdata
  7. NZBGet
  8. Ombi
  9. Plex
  10. Portainer
  11. qBittorrent
  12. Radarr
  13. Radarr4k
  14. RadarrHDR
  15. RuTorrent
  16. SABnzbd
  17. Sonarr
  18. Sonarr4k
  19. SonarrHDR
  20. Tautulli
  21. JDownloader2
Community Apps [Expand]
  1. AirSonic
  2. Bazarr
  3. Bitwarden
  4. BookSonic
  5. cAdvisor
  6. Cloud Commander
  7. Deluge
  8. DelugeVPN
  9. Dozzle
  10. Duplicati
  11. Filebrowser
  12. FlexGet
  13. Gazee
  14. Headphones
  15. Heimdall
  16. HomeAssistant
  17. jd2-openvpn
  18. Kitana
  19. Logarr
  20. MakeMKV
  21. MariaDB
  22. McMyadmin
  23. MEDUSA
  24. Mellow
  25. Miniflux
  26. Monitorr
  27. Muximux
  28. Mylar
  29. NextCloud
  30. NowShowing
  31. NZBHydra2
  32. Organizr
  33. plpp
  34. pyLoad
  35. qBittorrent
  36. QBittorrent VPN
  37. radarrsyncarr
  38. Resilio
  39. rflood-openvpn
  40. rutorrent-openvpn
  41. Shoko Anime Server
  42. SpeedTest
  43. SyncLounge
  44. Teamspeak3
  45. The Lounge
  46. Transmission
  47. Trakt.or
  48. Ubooquity
  49. Varken
  50. vnc-xfce
  51. vnstat
  52. ZeroTier

Misc Info & Articles

  1. Change Server Time
  2. Fail2Ban
  3. Custom Containers
  4. Deploying Varken, Influx, Telegraf, Grafana
  5. cloneclean commands
  6. Understanding htop
Scripts
  1. Scripting Area
    1. Auto Upload for Sonarr and Lidarr
    2. Auto Delete Log
    3. Plex Plugin DB Backup
    4. Plex fast BACKUP
    5. Delete All Unmonitored from Radarr
Clone this wiki locally