Skip to content

Commit 6e056bc

Browse files
authored
[Doc] Update VLM doc about loading from local files (#9999)
Signed-off-by: Roger Wang <ywang@roblox.com>
1 parent 5208dc7 commit 6e056bc

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/source/models/vlm.rst

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -242,6 +242,10 @@ To consume the server, you can use the OpenAI client like in the example below:
242242
243243
A full code example can be found in `examples/openai_chat_completion_client_for_multimodal.py <https://github.com/vllm-project/vllm/blob/main/examples/openai_chat_completion_client_for_multimodal.py>`_.
244244

245+
.. tip::
246+
Loading from local file paths is also supported on vLLM: You can specify the allowed local media path via ``--allowed-local-media-path`` when launching the API server/engine,
247+
and pass the file path as ``url`` in the API request.
248+
245249
.. tip::
246250
There is no need to place image placeholders in the text content of the API request - they are already represented by the image content.
247251
In fact, you can place image placeholders in the middle of the text by interleaving text and image content.

0 commit comments

Comments
 (0)