Skip to content

Releases: danieldk/sentencepiece

0.8.2

30 Jul 09:42
Compare
Choose a tag to compare

0.8.1

04 Jan 10:52
Compare
Choose a tag to compare
  • Update to prost 0.9.

0.8.0

04 Jan 10:52
Compare
Choose a tag to compare

0.7.1

17 Jun 18:18
Compare
Choose a tag to compare

Update to sentencepiece 0.1.96.

0.7.0

17 Jun 18:07
Compare
Choose a tag to compare
  • Add support for string containing NUL characters (#43)
  • Return an error when a model filename contains NUL, rather than unwrap()ing the C string conversion.

0.6.0

25 Jan 13:33
Compare
Choose a tag to compare
  • The constructor SentencePieceProcessor::load was renamed to SentencePieceProcessor::open.

Protobuf handling changes

07 Oct 08:33
Compare
Choose a tag to compare
  • Replace protobuf by prost-derive. This allows us to use nicer types on the Rust side. Also, protoc is not requirement anymore.
  • Improve SentencePieceError. SentencePieceError is now also non-exhaustive.