How do we upgrade DeepOps? Upgrade documentation needs to be improved

[mtusman]

Documentation relating to upgrading DeepOps needs to be improved. Currently, the only steps mentioned are that you need to checkout the latest tag release, run ./scripts/setup.sh and update components such as Kubespray by following their respective guides. However, it doesn't detail how upgrades related to the GPU operator, the device plugin, etc. will be applied.

After upgrading the components, are we expected to re-run the playbooks that we used to set them up in the first place? For example, if we’ve used DeepOps 21.03 for deploying a GPU Cluster with Kubernetes by following this guide and we want to upgrade to DeepOps 21.06; after checking out the tag, running ./scripts/setup.sh and the deepops/submodules/kubespray/upgrade-cluster.yml playbook, are we expected to be done with the upgrade or should we then also re-run the deepops/playbooks/k8s-cluster playbook that we used to setup up the cluster to begin with?

[github-actions]

This issue is stale because it has been open for 60 days with no activity. Please update the issue or it will be closed in 7 days.