Distributed inference via MPI #3595

Job	Run time
ubuntu-latest-cmake	1m 25s
ubuntu-focal-make	1m 30s
macOS-latest-cmake	2m 9s
macOS-latest-make	1m 56s
windows-latest-cmake (avx2, -DLLAMA_BUILD_SERVER=ON)	2m 35s
windows-latest-cmake (avx, -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX2=OFF)	2m 28s
windows-latest-cmake (avx512, -DLLAMA_BUILD_SERVER=ON -DLLAMA_AVX512=ON -DBUILD_SHARED_LIBS=ON)	2m 30s
windows-latest-cmake (clblast, -DLLAMA_BUILD_SERVER=ON -DLLAMA_CLBLAST=ON -DCMAKE_PREFIX_PATH="$e...	2m 46s
windows-latest-cmake (openblas, -DLLAMA_BUILD_SERVER=ON -DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenB...	2m 40s
ubuntu-latest-cmake-sanitizer (ADDRESS, Debug)	1m 1s
ubuntu-latest-cmake-sanitizer (ADDRESS, Release)	2m 20s
ubuntu-latest-cmake-sanitizer (THREAD, Debug)	1m 11s
ubuntu-latest-cmake-sanitizer (THREAD, Release)	1m 34s
ubuntu-latest-cmake-sanitizer (UNDEFINED, Debug)	1m 33s
ubuntu-latest-cmake-sanitizer (UNDEFINED, Release)	2m 54s
windows-latest-cmake-cublas (12.1.0, cublas)	22m 55s
windows-latest-cmake-cublas (11.7.1, cublas)	24m 15s
ubuntu-latest-cmake-mpi (mpich)	1m 21s
ubuntu-latest-cmake-mpi (libopenmpi-dev)	1m 58s
release	0s
	1h 21m 1s

Provide feedback