diff --git a/examples/other/tensorize_vllm_model.py b/examples/other/tensorize_vllm_model.py index b1f2ce871bb4..d1b4e0116053 100644 --- a/examples/other/tensorize_vllm_model.py +++ b/examples/other/tensorize_vllm_model.py @@ -106,12 +106,10 @@ the LoRA artifacts are in your model artifacts directory and specifying `--enable-lora`. For instance: -``` vllm serve \ --load-format tensorizer \ --model-loader-extra-config '{"tensorizer_uri": ".tensors"}' \ --enable-lora -``` """