Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Why vllm cli not provide a config arg? #7350

Closed
dsp6414 opened this issue Aug 9, 2024 · 4 comments · Fixed by #7737
Closed

[Feature]: Why vllm cli not provide a config arg? #7350

dsp6414 opened this issue Aug 9, 2024 · 4 comments · Fixed by #7737
Labels
feature request good first issue Good for newcomers

Comments

@dsp6414
Copy link

dsp6414 commented Aug 9, 2024

🚀 The feature, motivation and pitch

for examaple:
vllm serve --config config.json

Alternatives

No response

Additional context

No response
@DarkLight1337 DarkLight1337 added the good first issue Good for newcomers label Aug 9, 2024
@DarkLight1337
Copy link
Member

This is a great idea! Any help on this would be welcome!

@youkaichao
Copy link
Member

it is possible to have a config format, json or yaml.

@ashwin-phadke
Copy link

I'll take this up.

@maxDavid40 maxDavid40 mentioned this issue Aug 13, 2024
Closed
@KaunilD KaunilD mentioned this issue Aug 21, 2024
Merged
@dsp6414
Copy link
Author

dsp6414 commented Aug 30, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Frontend]-config-cli-args KaunilD/vllm
4 participants
@dsp6414 @youkaichao @ashwin-phadke @DarkLight1337