[Bug]: Update Amazon Linux 2 to Amazon Linux 2023

[grallewellyn]

Checked for duplicates

Yes

Describe the bug

Can't deploy Airflow because of the previous AMI being deleted

What did you expect?

To have a SPS instance that can successfully deploy

Reproducible steps

Follow these steps https://unity-sds.gitbook.io/docs/developer-docs/science-processing/docs/admin-guide/sps-deployment-with-terraform

What is your environment?

M1 Mac

[grallewellyn]

This is best to do when transitioning from MCP to SMCE

The upgrade to AL2023 using the MCP versions is incredibly painful- i was able to do it with an EKS cluster, but getting the third party software to work for me was a no go. this wasn't airflow, so there might be better support for the airflow components. The problem is that AL2023 linux versions set FIPS compliance to enabled and it restricts many endpoints from working correctly (even ones like EFS).
i think we'll want to continue deploying Airflow via EKS- the MAAP and Science Cloud systems are not enforcing FIPS compliance (i think) so we should have more success there. We will not have the multiple layers of proxies in the MAAP deployment, so we should have fewer issues with access and linkages working in those environments.