Skip to content
This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Commit

Permalink
[Docs][TPU] Add installation tip for TPU (vllm-project#5761)
Browse files Browse the repository at this point in the history
  • Loading branch information
WoosukKwon authored and robertgshaw2-neuralmagic committed Jun 23, 2024
1 parent 960a022 commit dc211cd
Showing 1 changed file with 18 additions and 0 deletions.
18 changes: 18 additions & 0 deletions docs/source/getting_started/tpu-installation.rst
Original file line number Diff line number Diff line change
Expand Up @@ -73,3 +73,21 @@ Next, build vLLM from source. This will only take a few seconds:
.. code-block:: console
$ VLLM_TARGET_DEVICE="tpu" python setup.py develop
.. tip::

If you encounter the following error:

.. code-block:: console
from torch._C import * # noqa: F403
ImportError: libopenblas.so.0: cannot open shared object file: No such file or directory
You can install OpenBLAS with the following command:

.. code-block:: console
$ sudo apt-get install libopenblas-base libopenmpi-dev libomp-dev

0 comments on commit dc211cd

Please sign in to comment.