Skip to content

gpt_server v0.3.2

Compare
Choose a tag to compare
@shell-nlp shell-nlp released this 15 Oct 13:54
· 26 commits to main since this release

gpt_server v0.3.2

What's Changed

  1. 支持了多模态模型 qwen VL #14 、minicpmv
  2. 支持了 embedding 模型 puff
  3. 修复了lmdeploy后端的bug
  4. 开放 prefix_caching能力
  5. 优化架构