fix(pt): invalid type_map when multitask training

fix(pt): invalid type_map when multitask training #4841