- Add docker image build
- Support list input of text on embeddings API
- Support downloading model from huggingface
- Support auto-batching on chat API
- Support
top_p
,temperature
andseed
parameters in chat API - Update OpenVINO to 2024.3.0
- Update IPEX-LLM to 2.1.0