Install Pydantic>=2.0 after vLLM installation

[rlouf]

Outlines and vLLM currently clash because installing vLLM after outlines downgrades to Pydantic<2. Either we can dictate the order in which packages are installed, or we document the fact that we need to run pip install pydantic>=2

[soodoshll]

Same issue here. In fact it fails to run pip install outlines[serve] as well.

[chrispr8]

I think this should get fixed on this side: vllm-project/vllm#1396

[rlouf]

There is a PR open on vLLM to bump the version. In the meantime I updated the documentation in #547.

[chrispr8]

The issue got fixed in the vLLM-repo. Until they release v0.2.8 you can use

pip install git+https://github.com/vllm-project/vllm

to install the current main branch.

[rlouf]

Have you tried it?

[chrispr8]

I got it running with poetry yesterday, because the workaround to reinstall pydantic after installation did not work for me.

I just tested it again with a normal venv and pip and it seems the newly added LoRa-support to vllm broke something:

AttributeError: 'TokenizerGroup' object has no attribute 'get_vocab'

For now, pinning the commit still works:

pip install git+https://github.com/vllm-project/vllm@71d63ed72e8e528e3131af79b2c1ad853065ccb8

[viktor-ferenczi]

With the current doc this was needed: pip install diskcache

But pip install pydantic>=2 was unnecessary.