Named Entities ending with s are being lemmatized #325
Labels
bug
Bugs and behaviour differing from documentation
Comments
Closed
|
Thanks for the report. Will add tests and fix. |
honnibal
added a commit
that referenced
this issue
Apr 14, 2016
…n't receiving the PROPN tag, and personal pronouns weren't receiving the PRON tag. This should fix Issue #191, and also Issue #325, which reported that proper nouns were being lemmatized using the common noun policies. This lemmatization will be prevented if the universal tag is PROPN, not NOUN, as no lemmatization rules are loaded for the PROPN tag.
|
This should be fixed in the next release of the data. There are some details in the associated commit. Thanks again |
|
This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Named entities ending with
swill be treated by the lemmatizer as if they are plurals, e.g.Bernie Sandersturns intobernie sander,ISISbecomesisi,United Statesbecomesunited state. It probably also applies to other suffixes.This may be intentional, so maybe adding a flag would be a good solution. Or is there another work around?
[Update] Somewhat related: when something like
CIAis at the end of a sentence, the named entity becomesCIA.. My guess is that this is done to account for acronyms likeA.M., but the trend seems to be to eliminate periods from acronyms, so punctuation can probably be stripped from the Named Entity altogether (avoiding the inconsistency).The text was updated successfully, but these errors were encountered: