Convert AWS cluster deployment workflow to eksctl

[choldgraf]

Description

Our current process for deploying AWS clusters is to use kops (e.g., docs on how to deploy an AWS cluster with kops). However, in #431 (comment) we've provided a rationale for moving from kops to eksctl. This issue will track that migration.

Value / benefit

See #431 (comment) for the rationale about "why eksctl" but more generally if we standardize on a single system for deploying clusters on AWS, it will help us reduce complexity and standardize our team practices, which will reduce uncertainty and information silos.

Tasks to complete

• Implement features needed to deploy a new cluster with EKS
  • Automate EFS creation for AWS #622
• Document how to deploy a cluster with eksctl: Automate and document setting up eksctl clusters #885
• Migrate the hubs that use kops to instead use eksctl
  • OpenScapes
  • Farallon Convert AWS cluster deployment workflow to eksctl #737

(probably needs to be done by either @yuvipanda or @damianavila)

Updates

• 2021-11-23: We've re-scoped this to focus on migrating to eksctl

[damianavila]

I think we could just add another section, or a sub-page to our current AWS cluster deployment docs:

👍

Another option is that we simply deprecate one of these two pathways, and only use kops or eksctl, even if one of them is sometimes sub-optimal.

I think we are still in the "getting info" phase, I would wait a little bit more...
Maybe wait until having experienced one "openscapes" - educational style - cluster on EKS to compare with the existing ones in kops (since carbonplan - research style - is not really comparable with the "educational" ones).

[damianavila]

@yuvipanda, do you have any notes from the eksctl-based deployment for the Carbonplan cluster?
IIRC you did the transition from kops into EKS, so maybe you already have some notes available to use as seed for the docs.

[yuvipanda]

This is done! https://github.com/2i2c-org/infrastructure/blob/master/docs/howto/operate/new-cluster/aws.md. However, I think farallon still needs to be moved.

[yuvipanda]

I've created #737 to track kops migration of farallon, but we can close this now.