Skip to content

Commit 66c39c5

Browse files
ywang96JC1DA
authored andcommitted
[Doc] Update VLM doc about loading from local files (vllm-project#9999)
Signed-off-by: Roger Wang <ywang@roblox.com> Signed-off-by: Loc Huynh <jc1da.3011@gmail.com>
1 parent c64f351 commit 66c39c5

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/source/models/vlm.rst

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -242,6 +242,10 @@ To consume the server, you can use the OpenAI client like in the example below:
242242
243243
A full code example can be found in `examples/openai_chat_completion_client_for_multimodal.py <https://github.com/vllm-project/vllm/blob/main/examples/openai_chat_completion_client_for_multimodal.py>`_.
244244

245+
.. tip::
246+
Loading from local file paths is also supported on vLLM: You can specify the allowed local media path via ``--allowed-local-media-path`` when launching the API server/engine,
247+
and pass the file path as ``url`` in the API request.
248+
245249
.. tip::
246250
There is no need to place image placeholders in the text content of the API request - they are already represented by the image content.
247251
In fact, you can place image placeholders in the middle of the text by interleaving text and image content.

0 commit comments

Comments
 (0)