File tree Expand file tree Collapse file tree 2 files changed +21
-1
lines changed Expand file tree Collapse file tree 2 files changed +21
-1
lines changed Original file line number Diff line number Diff line change @@ -938,6 +938,26 @@ The following table lists those that are tested in vLLM.
938938 * ✅︎
939939:::
940940
941+ #### Transcription (` --task transcription ` )
942+
943+ Speech2Text models trained specifically for Automatic Speech Recognition.
944+
945+ :::{list-table}
946+ :widths: 25 25 25 5 5
947+ :header-rows: 1
948+
949+ - * Architecture
950+ * Models
951+ * Example HF Models
952+ * [ LoRA] ( #lora-adapter )
953+ * [ PP] ( #distributed-serving )
954+ - * ` Whisper `
955+ * Whisper-based
956+ * ` openai/whisper-large-v3-turbo `
957+ * 🚧
958+ * 🚧
959+ :::
960+
941961_________________
942962
943963## Model Support Policy
Original file line number Diff line number Diff line change @@ -421,7 +421,7 @@ def generate(
421421 instead pass them via the ``inputs`` parameter.
422422 """
423423 runner_type = self .llm_engine .model_config .runner_type
424- if runner_type != "generate" :
424+ if runner_type not in [ "generate" , "transcription" ] :
425425 messages = [
426426 "LLM.generate() is only supported for (conditional) generation "
427427 "models (XForCausalLM, XForConditionalGeneration)." ,
You can’t perform that action at this time.
0 commit comments