Skip to content

A simple word breaker written in Python

Notifications You must be signed in to change notification settings

bashell-com/wordcutpy

This branch is 15 commits behind veer66/wordcutpy:master.

Repository files navigation

wordcutpy

wordcutpy is a simple Thai word breaker written in Python 3+

Installation

pip install wordcutpy

Example

Conventional verison

#! -*- coding: UTF8 -*-
from wordcut import Wordcut
if __name__ == '__main__':
    with open('bigthai.txt', encoding="UTF-8") as dict_file:
        word_list = list(set([w.rstrip() for w in dict_file.readlines()]))
        wordcut = Wordcut(word_list)
        print(wordcut.tokenize("āļāļēāļāļē cat āļŦāļĄāļē"))

Simplified version

#! -*- coding: UTF8 -*-
from wordcut import Wordcut
wordcut = Wordcut.bigthai()
print(wordcut.tokenize("āļāļēāļāļē cat āļŦāļĄāļē"))

About

A simple word breaker written in Python

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%