We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 731e3f8 commit 0bd6624Copy full SHA for 0bd6624
examples/prompt_embedding_inference.py
@@ -1,7 +1,6 @@
1
import torch
2
from transformers import (AutoModelForCausalLM, AutoTokenizer,
3
PreTrainedTokenizer)
4
-
5
from vllm import LLM
6
7
0 commit comments