ASoC: SOF: Intel/ipc4: Follow the hardware proramming sequence for library loading #5101

Job	Run time
Clang build x86_64	27m 12s
GCC build arm64	27m 17s
GCC static -fanalyzer	6m 18s
GCC build arm64 allmodconfig	2m 23s
GCC build i386	21m 6s
GCC build X86_64	24m 1s
GCC build X86_64 with W=1	3m 46s
GCC build X86_64 with W=1 allmodconfig	2m 31s
Sparse check	6m 8s
	2h 0m 42s

Provide feedback