Pydantic v2 breaking FastAPI & Ray

[anttttti]

Pydantic v2 came out last week. It seems to be breaking some dependencies, including those used by VLLM.

Pydantic v2 throws an error on serializing Ray results, at least pydantic.fields.ModelField. Current VLLM requirements.txt doesn't specify the version of Pydantic, so v2 can get installed.

Until requirements.txt gets updated with version for Pydantic or depending libraries fix their compatibilities, you can do "pip install pydantic==1.10.11" to fix issues.

[jens-create]

Any news on this issue?

[Changgeng-Wei]

Pydantic v2 came out last week. It seems to be breaking some dependencies, including those used by VLLM.

Pydantic v2 throws an error on serializing Ray results, at least pydantic.fields.ModelField. Current VLLM requirements.txt doesn't specify the version of Pydantic, so v2 can get installed.

Until requirements.txt gets updated with version for Pydantic or depending libraries fix their compatibilities, you can do "pip install pydantic==1.10.11" to fix issues.

Current VLLM requirements.txt specify the version of Pydantic to "pydantic>=2.0", but thd issue still occur

[ruifengma]

Pydantic v2 came out last week. It seems to be breaking some dependencies, including those used by VLLM.
Pydantic v2 throws an error on serializing Ray results, at least pydantic.fields.ModelField. Current VLLM requirements.txt doesn't specify the version of Pydantic, so v2 can get installed.
Until requirements.txt gets updated with version for Pydantic or depending libraries fix their compatibilities, you can do "pip install pydantic==1.10.11" to fix issues.

Current VLLM requirements.txt specify the version of Pydantic to "pydantic>=2.0", but thd issue still occur

exactly the same issue here @jens-create