Skip to content

[Usage]: [V1] Support MistralTokenizer on V1 #14522

@robertgshaw2-redhat

Description

@robertgshaw2-redhat

Your current environment

Currently, Xgrammar does not work with MistralTokenizer. This means we cannot use MistralTokenizer with V1

How would you like to use vllm

I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Sub-issues

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions