You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
WB3c and WB3c interact in the same way LB8a and LB9 do.
A correct implementation of that would require either duplicating every state as in #4389, or hoisting the two rules into the logic as in #5001.
The latter seems more attractive, both for data size and sanity of the maintainer; note that since rule_segmenter.rs is shared with extended grapheme cluster and sentence breaking, this will require passing a flag for that logic.
The text was updated successfully, but these errors were encountered:
All of it? It was created to allow us to close the specific issue reported in #4417, but word segmentation is still wrong and hasn’t changed since this was filed.
WB3c and WB3c interact in the same way LB8a and LB9 do.
A correct implementation of that would require either duplicating every state as in #4389, or hoisting the two rules into the logic as in #5001.
The latter seems more attractive, both for data size and sanity of the maintainer; note that since
rule_segmenter.rs
is shared with extended grapheme cluster and sentence breaking, this will require passing a flag for that logic.The text was updated successfully, but these errors were encountered: