Instead of installing Intel Gaudi software stack (drivers, container runtime, device plugin and etc.) manually, Intel Habana provides the Intel® Gaudi® Base Operator for Kubernetes to ease the task.
Intel® Gaudi® Base Operator for Kubernetes automates the management of all necessary Intel Gaudi software components on a Kubernetes cluster. These include drivers, Kubernetes device plugin, container runtime, feature discovery, and monitoring tools.
Here is the support matrix for Kubernetes versions.
For more detailded information and steps to proceed, please refer to the Intel® Gaudi® Base Operator for Kubernetes manual page.