[Installation]: Could not find a version that satisfies the requirement xgrammar>=0.1.6; platform_machine == "x86_64" (from vllm) (from versions: none)

[Xingkangze]

Your current environment

 # 创建环境
 conda create -n online_model_v4  python=3.10.13
 
 # 激活环境
 conda activate online_model_v4


pip install vllm==0.6.6.post1

How you are installing vllm

pip install vllm==0.6.6.post1




问题
Collecting prometheus-fastapi-instrumentator>=7.0.0 (from vllm==0.6.6.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/59/66/2e93a8f56adb51ede41d0ef5f4f0277522acc4adc87937f5457b7b5692a8/prometheus_fastapi_instrumentator-7.0.0-py3-none-any.whl (19 kB)
Collecting tiktoken>=0.6.0 (from vllm==0.6.6.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/2e/28/cf3633018cbcc6deb7805b700ccd6085c9a5a7f72b38974ee0bffd56d311/tiktoken-0.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)
Collecting lm-format-enforcer<0.11,>=0.10.9 (from vllm==0.6.6.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/c1/01/e78fdf09de2b4e7750a402eaa4f6783c7215ededd4bc6fe4a3f6d69c49da/lm_format_enforcer-0.10.9-py3-none-any.whl (43 kB)
Collecting outlines==0.1.11 (from vllm==0.6.6.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/13/b4/99ea4a122bef60e3fd6402d19665aff1f928e0daf8fac3044d0b73f72003/outlines-0.1.11-py3-none-any.whl (87 kB)
Collecting lark==1.2.2 (from vllm==0.6.6.post1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/2d/00/d90b10b962b4277f5e64a78b6609968859ff86889f5b898c1a778c06ec00/lark-1.2.2-py3-none-any.whl (111 kB)
INFO: pip is looking at multiple versions of vllm to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement xgrammar>=0.1.6; platform_machine == "x86_64" (from vllm) (from versions: none)
ERROR: No matching distribution found for xgrammar>=0.1.6; platform_machine == "x86_64"

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[VegetaPn]

+1

[suxuanning]

+1

[DarkLight1337]

cc @russellb

[russellb]

I wonder if it's an issue with this pypi mirror in China? xgrammar is up to 0.1.9 here: https://pypi.org/project/xgrammar/#history

[Li-Qingyun]

I wonder if it's an issue with this pypi mirror in China? xgrammar is up to 0.1.9 here: https://pypi.org/project/xgrammar/#history

yes maybe,

but i tried

pip install xgrammar --index-url https://pypi.org/simple

also does not work

[Li-Qingyun]

This issue work

#11542

upgrade your glibc is all required.

[russellb]

@Xingkangze can you confirm that you were able to get it working?

[Li-Qingyun]

@russellb I think it is. My cluster server got a lower version of glibc (<2).
All the wheel for xgrammar here are built with glibc>2.27.
I downloaded the wheel with wget and pip install the wheel, ERROR: xgrammar-0.1.9-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl is not a supported wheel on this platform. The platform is only mismatched on glibc version.
I patched my interpreter with patchelf on glibc 2.27 (because sudo/root is not available) and then just pip install xgrammar, it worked.
Hence, the installation error seems not from the f**king internet ''wall'' of china, but a mismatched version of glibc.

[Xingkangze]

@russellb I cannot upgrade to the glibc version, so it cannot work

[Li-Qingyun]

@russellb I cannot upgrade to the glibc version, so it cannot work

The glibc in your enviroment have to be newer. The root/sudo is also not available to me.

You are recommand to use patchelf to match your python interpreter with glibc 2.27.

Or you can also prepare your enviroment with docker.

[Li-Qingyun]

@russellb It can also be resolved by the release of xgrammar, if there will be wheels that will be build with glibc<2.0

[eduardzl]

Also not working for me on Amazon Linux 2. Trying to install vLLM 0.6.6.post1
The latest version of glibc available is 2.26.
When trying to compile glibc 2.29 from source, I am getting error that "make" is too old.

[russellb]

have you tried building xgrammar yourself instead of installing a wheel to see if you can build a version compatible with your environment?

[eduardzl]

@russellb
Getting error when trying to compile xgrammar.

[11/30] Building CXX object CMakeFiles/xgrammar.dir/cpp/grammar_matcher_base.cc.o FAILED: CMakeFiles/xgrammar.dir/cpp/grammar_matcher_base.cc.o /usr/bin/c++ -I/home/ec2-user/SageMaker/vllm/xgrammar/3rdparty/picojson -I/home/ec2-user/SageMaker/vllm/xgrammar/3rdparty/dlpack/include -I/home/ec2-user/SageMaker/vllm/xgrammar/include -Wall -Wextra -Werror -Wno-pedantic -Wno-unused-parameter -Woverloaded-virtual -flto=auto -Ofast -O2 -g -DNDEBUG -std=gnu++1z -fPIC -MD -MT CMakeFiles/xgrammar.dir/cpp/grammar_matcher_base.cc.o -MF CMakeFiles/xgrammar.dir/cpp/grammar_matcher_base.cc.o.d -o CMakeFiles/xgrammar.dir/cpp/grammar_matcher_base.cc.o -c /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc: In member function ‘bool xgrammar::GrammarMatcherBase::CheckIfAccepted(const xgrammar::StackElement&, uint8_t) const’: /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc:30:41: error: unused variable ‘codepoint’ [-Werror=unused-variable] auto [accepted, num_bytes, codepoint] = HandleUTF8FirstByte(char_value); ^ /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc: In member function ‘xgrammar::StackElement xgrammar::GrammarMatcherBase::AdvanceStackElementWithChar(const xgrammar::StackElement&, uint8_t)’: /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc:79:43: error: unused variable ‘codepoint’ [-Werror=unused-variable] auto [accepted, num_bytes, codepoint] = HandleUTF8FirstByte(char_value); ^ /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc:92:45: error: unused variable ‘codepoint’ [-Werror=unused-variable] auto [accepted, num_bytes, codepoint] = HandleUTF8FirstByte(char_value); ^ cc1plus: all warnings being treated as errors [12/30] Building CXX object cpp/pybind/CMakeFiles/xgrammar_bindings.dir/__/grammar_matcher_base.cc.o FAILED: cpp/pybind/CMakeFiles/xgrammar_bindings.dir/__/grammar_matcher_base.cc.o /usr/bin/c++ -Dxgrammar_bindings_EXPORTS -I/home/ec2-user/SageMaker/vllm/xgrammar/3rdparty/picojson -I/home/ec2-user/SageMaker/vllm/xgrammar/3rdparty/dlpack/include -I/home/ec2-user/SageMaker/vllm/xgrammar/include -isystem /home/ec2-user/SageMaker/envs/conda_vllm_xgrammar/include/python3.10 -isystem /home/ec2-user/SageMaker/envs/conda_vllm_xgrammar/lib/python3.10/site-packages/pybind11/include -Wall -Wextra -Werror -Wno-pedantic -Wno-unused-parameter -Woverloaded-virtual -flto=auto -Ofast -O2 -g -DNDEBUG -std=gnu++1z -fPIC -fvisibility=hidden -MD -MT cpp/pybind/CMakeFiles/xgrammar_bindings.dir/__/grammar_matcher_base.cc.o -MF cpp/pybind/CMakeFiles/xgrammar_bindings.dir/__/grammar_matcher_base.cc.o.d -o cpp/pybind/CMakeFiles/xgrammar_bindings.dir/__/grammar_matcher_base.cc.o -c /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc: In member function ‘bool xgrammar::GrammarMatcherBase::CheckIfAccepted(const xgrammar::StackElement&, uint8_t) const’: /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc:30:41: error: unused variable ‘codepoint’ [-Werror=unused-variable] auto [accepted, num_bytes, codepoint] = HandleUTF8FirstByte(char_value); ^ /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc: In member function ‘xgrammar::StackElement xgrammar::GrammarMatcherBase::AdvanceStackElementWithChar(const xgrammar::StackElement&, uint8_t)’: /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc:79:43: error: unused variable ‘codepoint’ [-Werror=unused-variable] auto [accepted, num_bytes, codepoint] = HandleUTF8FirstByte(char_value); ^ /home/ec2-user/SageMaker/vllm/xgrammar/cpp/grammar_matcher_base.cc:92:45: error: unused variable ‘codepoint’ [-Werror=unused-variable] auto [accepted, num_bytes, codepoint] = HandleUTF8FirstByte(char_value); ^ cc1plus: all warnings being treated as errors [28/30] Building CXX object cpp/pybind/CMakeFiles/xgrammar_bindings.dir/pybind.cc.o