We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 8020248 commit 9de060aCopy full SHA for 9de060a
examples/prompt_embedding_inference.py
@@ -1,7 +1,6 @@
1
import torch
2
from transformers import (AutoModelForCausalLM, AutoTokenizer,
3
PreTrainedTokenizer)
4
-
5
from vllm import LLM
6
7
0 commit comments