[EPIC] Ensure disaster recovery backups for home directories

[yuvipanda]

(Part of the new internal engineering roadmap, see https://github.com/2i2c-org/meta/issues/1234 for more information)

User home directories contain very important data, and we must have backups for disaster recovery. We currently have it for AWS (and it has saved us multiple times), but we need to have that for all cloud providers.

Tasks

Beta Give feedback

1. Enable home directory backups with Azure File backups #624
   3 of 3
   +0
   
2. [EPIC] Setup a system for automated GCP filestore backups #4391
   9 of 10
   +0
3. deployer exec feature - exec into a shell with the NFS storage filesystem root mounted #4291
   +0
   
4. Test and document AWS EFS home directory restore functionality #4424
   +0
   
5. Test and document GCP filestore home directory restore functionality #4425
   +0
   
6. [Spike: 2h] Fix storage backups for Azure clusters #4487
   +0
   
7. Test and document Azure Files home directory restore functionality #4426
   +0

[sgibson91]

Are we tracking exploration for an Azure solution for this beyond the work already done?

I met with a Microsoft rep at UKRSECon24 who recommended snapshots as a DR solution for NFS. However, it is only available on the Premium storage tier.

[yuvipanda]

@sgibson91 I think we should let Azure be for now, and perhaps plan on moving people to jupyterhub-home-nfs eventually.