You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Some models such as the "translate and embed" models can't be used for cross-lingual tasks, ideally their scores should just be nan.
I am unsure what the best solution is. We could naturally raise an error (but then it seems like it failed). We could also return nan (but then we would have to handle it in mteb, which is also
Seems like the best solution is to raise a specific error something like ModelNotValidForThisTaskError
The text was updated successfully, but these errors were encountered:
Some models such as the "translate and embed" models can't be used for cross-lingual tasks, ideally their scores should just be nan.
I am unsure what the best solution is. We could naturally raise an error (but then it seems like it failed). We could also return nan (but then we would have to handle it in mteb, which is also
Seems like the best solution is to raise a specific error something like ModelNotValidForThisTaskError
The text was updated successfully, but these errors were encountered: