Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
fixed multiplechoice tokenization (#12362)
* fixed multiplechoice tokenization The model would have seen two sequences: 1. [CLS]prompt[SEP]prompt[SEP] 2. [CLS]choice0[SEP]choice1[SEP] that is not correct as we want a contextualized embedding of prompt and choice * removed outer brackets for proper sequence generation
- Loading branch information