You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There is a bug that has long been in the word vectors module that has been uncovered by the migration to staticvectors.
When passing a list of strings for vectorization, the current code tokenizes each row to a list of tokens. It doesn't handle the case when no tokens are returned.
This change will pass the original string as a token list if no tokens are parsed.
The text was updated successfully, but these errors were encountered:
There is a bug that has long been in the word vectors module that has been uncovered by the migration to
staticvectors
.When passing a list of strings for vectorization, the current code tokenizes each row to a list of tokens. It doesn't handle the case when no tokens are returned.
This change will pass the original string as a token list if no tokens are parsed.
The text was updated successfully, but these errors were encountered: