Skip to content

Commit

Permalink
server : add single-client multi-prompt support (ggerganov#4232)
Browse files Browse the repository at this point in the history
* * add multiprompt support

* * cleanup

* * more cleanup

* * remove atomicity of id_gen, and change lock_guard to unique_lock on completion requests

* * remove all references to mutex_multitasks

* Update examples/server/server.cpp

Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>

* Update examples/server/server.cpp

Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>

* Update examples/server/server.cpp

Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>

* Update examples/server/server.cpp

Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>

* * change to set
  • Loading branch information
mounta11n committed Dec 1, 2023
1 parent 323e29a commit 8f26a66
Showing 0 changed files with 0 additions and 0 deletions.

0 comments on commit 8f26a66

Please sign in to comment.