Skip to content

Commit

Permalink
ENH: upgrade sglang in Docker (#2668)
Browse files Browse the repository at this point in the history
  • Loading branch information
amumu96 authored Dec 13, 2024
1 parent d4f358f commit b132fca
Showing 1 changed file with 12 additions and 7 deletions.
19 changes: 12 additions & 7 deletions xinference/deploy/docker/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -90,13 +90,18 @@ deepcache # for sd
verovio>=4.3.1 # For got_ocr2

# sglang
outlines>=0.0.44
decord
hf_transfer
packaging
huggingface_hub
interegular
zmq
rpyc
outlines>=0.0.44,<0.1.0
packaging
prometheus-client>=0.20.0
psutil
aiohttp
anthropic>=0.20.0
litellm>=1.0.0
python-multipart
pyzmq>=25.1.2
torchao>=0.7.0
uvloop
xgrammar>=0.1.6
vllm>=0.6.3.post1,<=0.6.4.post1
cuda-python

0 comments on commit b132fca

Please sign in to comment.