[Feature]: Support LoRA of rank 1 #26428
Description
🚀 The feature, motivation and pitch
I'm working on finetuning / RL / GRPO, and I'm working with VLLM as my rollout engine. At the moment, I only support for LoRA of rank 8, 16, etc.. I'm trying to reproduce the LoRA without Regret blog post, but this validation, and I presume support, is a bit in the way. Is this something vLLM would consider supporting?
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.