-
-
Notifications
You must be signed in to change notification settings - Fork 11.1k
Labels
Description
Your current environment
Currently, Xgrammar does not work with MistralTokenizer. This means we cannot use MistralTokenizer with V1
How would you like to use vllm
I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.