Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[fsmt] deal with -100 indices in decoder ids (huggingface#18592)
* [fsmt] deal with -100 indices in decoder ids Fixes: huggingface#17945 decoder ids get the default index -100, which breaks the model - like t5 and many other models add a fix to replace -100 with the correct pad index. For some reason this use case hasn't been used with this model until recently - so this issue was there since the beginning it seems. Any suggestions to how to add a simple test here? or perhaps we have something similar already? user's script is quite massive. * style
- Loading branch information