Skip to content

Commit 9325d45

Browse files
krishung5nv-anants
authored andcommitted
docs: Update supported model in readme for multimodal (#2651)
1 parent 6eb0fc3 commit 9325d45

File tree

1 file changed

+2
-6
lines changed

1 file changed

+2
-6
lines changed

examples/multimodal/README.md

Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -59,14 +59,12 @@ flowchart LR
5959
pd_worker --> encode_worker
6060
```
6161

62+
***Note*** Only the LLaVA 1.5 7B model is supported. Qwen2.5-VL and Phi3V support will be added in the future.
63+
6264
```bash
6365
cd $DYNAMO_HOME/examples/multimodal
6466
# Serve a LLaVA 1.5 7B model:
6567
bash launch/agg.sh --model llava-hf/llava-1.5-7b-hf
66-
# Serve a Qwen2.5-VL model:
67-
# bash launch/agg.sh --model Qwen/Qwen2.5-VL-7B-Instruct
68-
# Serve a Phi3V model:
69-
# bash launch/agg.sh --model microsoft/Phi-3.5-vision-instruct
7068
```
7169

7270
### Client
@@ -100,8 +98,6 @@ curl http://localhost:8080/v1/chat/completions \
10098
}'
10199
```
102100

103-
If serving the example Qwen model, replace `"llava-hf/llava-1.5-7b-hf"` in the `"model"` field with `"Qwen/Qwen2.5-VL-7B-Instruct"`. If serving the example Phi3V model, replace `"llava-hf/llava-1.5-7b-hf"` in the `"model"` field with `"microsoft/Phi-3.5-vision-instruct"`.
104-
105101
You should see a response similar to this:
106102
```json
107103
{"id": "c37b946e-9e58-4d54-88c8-2dbd92c47b0c", "object": "chat.completion", "created": 1747725277, "model": "llava-hf/llava-1.5-7b-hf", "choices": [{"index": 0, "message": {"role": "assistant", "content": " In the image, there is a city bus parked on a street, with a street sign nearby on the right side. The bus appears to be stopped out of service. The setting is in a foggy city, giving it a slightly moody atmosphere."}, "finish_reason": "stop"}]}

0 commit comments

Comments
 (0)