You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Traceback (most recent call last):
File "error.py", line 30, in <module>
main()
File "error.py", line 25, in main
ja_sent = pyknp_tokenize(ja_sent)
File "error.py", line 13, in pyknp_tokenize
return " ".join([mrph.midasi for mrph in jumanpp.analysis(ja_sent).mrph_list()])
File "/path_to_venv/lib/python3.8/site-packages/pyknp/juman/juman.py", line 98, in analysis
return self.juman(input_str, juman_format)
File "/path_to_venv/venv/lib/python3.8/site-packages/pyknp/juman/juman.py", line 85, in juman
result = MList(self.juman_lines(input_str), juman_format)
File "/path_to_venv/venv/lib/python3.8/site-packages/pyknp/juman/mlist.py", line 26, in __init__
self._mrph[-1].push_doukei(Morpheme(line[2:], mid, juman_format))
IndexError: list index out of range
The text was updated successfully, but these errors were encountered:
Tokenization fails when a sentence starts with "@".
This doesn't seem to be an issue when jumanpp is called through subprocess or rhoknp.
To reproduce:
Standard error:
The text was updated successfully, but these errors were encountered: