[Fix] Several bugs when using HvdAllToAllEmbedding to train model and save/restore KV files. #1630

Job	Run time
Clang C++ code format	9s
Bazel code format	7s
Check that we can build the docs	10m 6s
Notebook format	16s
Notebook lint	14s
Check that the pre-commit works	45s
Check that the source code is compliant	10m 9s
Run the cpu tests in a small python docker image	21m 59s
Valid build files	1m 37s
Check that the CODEOWNERS is valid	6s
Yapf Python code format	46s
	46m 14s

Provide feedback