Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ability to configure runtime and model hyperparameters #13

Closed
zakkor opened this issue Apr 14, 2023 · 2 comments
Closed

Add ability to configure runtime and model hyperparameters #13

zakkor opened this issue Apr 14, 2023 · 2 comments
Assignees
@alexrozanski
Labels
enhancement New feature or request
Milestone
v1.2

Comments

@zakkor
Copy link

zakkor commented Apr 14, 2023

Some essential ones that come to mind:

  • -t {n} to specify number of threads. From what I can tell, LlamaChat uses 3 threads by default, but on my machine 8 threads gets the best performance.
  • --temp and the rest of the useful params
@alexrozanski
Copy link
Owner

@zakkor Yep this is definitely coming ☺️

@alexrozanski alexrozanski added the enhancement New feature or request label Apr 14, 2023
@alexrozanski alexrozanski changed the title Add ability to configure commandline parameters Add ability to configure runtime and model hyperparameters Apr 17, 2023
@alexrozanski alexrozanski added this to the v1.2 milestone Apr 17, 2023
@alexrozanski alexrozanski self-assigned this Apr 17, 2023
This was referenced Apr 17, 2023
Open
Open
@alexrozanski
Copy link
Owner

Added in v1.2.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alexrozanski alexrozanski

Labels
enhancement New feature or request
Projects
LlamaChat
Status: Done
Milestone
v1.2
Development

No branches or pull requests
2 participants
@alexrozanski @zakkor