Skip to content

Paebbels/pyTokenizer

Repository files navigation

Sourcecode on GitHub License GitHub tag (latest SemVer incl. pre-release) GitHub release (latest SemVer incl. including pre-releases) GitHub release date
GitHub Workflow Status PyPI PyPI - Status PyPI - Python Version Dependent repos (via libraries.io)
Libraries.io status for latest release Requires.io
Codacy - Quality Codacy - Coverage Codecov - Branch Coverage Libraries.io SourceRank
Read the Docs

pyTokenizer

A streaming tokenizer.

Contributors

License

This Python package (source code) is licensed under Apache License 2.0.


SPDX-License-Identifier: Apache-2.0