Mistake in simplemma.py

[hivaze]

The crash passed like a knife in the back, if you pass an empty string to the lemmatization or knowledge test method, then you get such an error, please at least make an assert with the corresponding message if you want this to be an exception.

~/miniconda3/envs/text/lib/python3.8/site-packages/simplemma/simplemma.py in is_known(token, lang)
    362     lang = _update_lang_data(lang)
    363     for language in LANG_DATA:
--> 364         if _simple_search(token, language.dict) is not None:
    365             return True
    366     return False

~/miniconda3/envs/text/lib/python3.8/site-packages/simplemma/simplemma.py in _simple_search(token, datadict, initial)
    206     if candidate is None:
    207         # try upper or lowercase
--> 208         if token[0].isupper():
    209             candidate = datadict.get(token.lower())
    210         else:

IndexError: string index out of range

[adbar]

Hi @hivaze, I would have expected users to control the input type but it's not difficult to add a corresponding function. Thanks for your feedback!