v0.11.3

What's new in 0.11.3 (2024-05-31)

These are the changes in inference v0.11.3.

New features

• FEAT: support Yi-1.5-chat-16k by @qinxuye in #1544
• FEAT: Support XINFERENCE_DISABLE_METRICS env by @codingl2k1 in #1547
• FEAT: Support new model CogVLM by @amumu96 in #1551
• FEAT: telechat model by @LIKEGAKKI in #1567

Enhancements

• ENH: added engines options to model launch details by @qinxuye in #1546
• ENH: rm mini-internvl by @amumu96 in #1563
• ENH: add additional_option at vl gradio by @amumu96 in #1561
• ENH: add real paths column by @hainaweiben in #1555

Bug fixes

• BUG: fix launch model error when use torch 2.3.0 by @amumu96 in #1543
• BUG: fix vl-model img path error by @amumu96 in #1559
• BUG: Fix validation errors when define a custom baichuan-chat LLM model by @buptzyf in #1557

Documentation

• DOC: update readme and fix description about model engine by @qinxuye in #1566

Others

• Correct ModelActor import path in worker & supervisor by @frostyplanet in #1550

New Contributors

• @buptzyf made their first contribution in #1557
• @LIKEGAKKI made their first contribution in #1567

Full Changelog: v0.11.2...v0.11.3