v0.3.0

What's new in 0.3.0 (2023-09-04)

These are the changes in inference v0.3.0.

Enhancements

• ENH: help message for CLI by @Bojun-Feng in #367

Bug fixes

• BUG: Asking to pad but the tokenizer does not have a padding token by @jiayini1119 in #407
• BUG: empty results for non-stream inference by @UranusSeven in #415
• BUG: Make context_length optional in model family by @Bojun-Feng in #394

Others

• EHN: auto retry download on network errors by @jiayini1119 in #405
• FEAT : Add Model Dashboard by @Bojun-Feng in #366

Full Changelog: v0.2.3...v0.3.0