[Bug]: VLLM TPU docker image includes ~3GB of pip cache.

[tvalentyn]

Your current environment

N/A

🐛 Describe the bug

The vllm/vllm-tpu image includes ~3.6 G of extra bloat of pip cache.

Dockerfile: https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile.tpu

Evidence

docker run --rm -it --entrypoint=/bin/bash vllm/vllm-tpu:4823ff7989603be3183536268fff79ebdca07a2c
root@119d09c98723:/workspace/vllm# du -ah / | sort -rh | head -n 10
...
3.6G    /root/.cache/pip
...

~500GB seems to come from the base image.

docker run --rm -it --entrypoint=/bin/bash us-central1-docker.pkg.dev/tpu-pytorch-releases/docker/xla:nightly_3.12_tpuvm
root@e50aede2a830:/# du -hs /root/.cache/pip 
532M	/root/.cache/pip

3 GB was accidentally added due with #17374 since: pip install command will install package dependencies, while python setup.py develop didn't.

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[tvalentyn]

Fix avenues: add --no-cache-dir in pip install commands, or better use --no-deps when installing VLLM, since there is a prior step installing VLLM dependencies. Adding pip check would be advisable in this case to ensure all dependencies are present.

[tvalentyn]

Fix avenues: add --no-cache-dir in pip install commands, or better use --no-deps when installing VLLM, since there is a prior step installing VLLM dependencies. Adding pip check would be advisable in this case to ensure all dependencies are present.

somehow none of that helped, but using a cache mount helps. sent a PR.