Skip to content

3.0.0

Compare
Choose a tag to compare
@azu azu released this 24 Dec 11:45
· 91 commits to master since this release

Rewrite library

It is inspired by diasks2/pragmatic_segmenter: Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages..

Concepts

Sentence Splitter for text and AST.

Changes

  • Remove all options
    • BREAKING CHANGE
  • Correct handlong number, ABBREVIATIONS, .<space> etc.. #6
  • Can accept AST and Output AST
    • textlint needs is from AST to AST textlint/textlint#366
    • It allow the user to transform Paragraph node to Paragraph node with sentence
    • function splitAST(paragraphNode: TxtParentNode): TxtParentNode;
    • See also TxtAST

TODO

Remove all options and drop extensibility.
We want to get an extensibility based on UseCase.
Please file an issue if you want to extend this library.

Migration

From v2 to v3.

When not to use option

Do not noting.

When use some option

v3 remove all option temporary.
If you want to get extensibility, please file issue.