Skip to content

Conversation

@npolshakova
Copy link
Contributor

Fixes: #158

server.Serve was blocking indefinitely, updated to pass ctx into startServer.

Signed-off-by: npolshakova <nina.polshakova@solo.io>
Signed-off-by: npolshakova <nina.polshakova@solo.io>
@mayabar mayabar merged commit 859d8c2 into llm-d:main Aug 24, 2025
4 checks passed
pancak3 pushed a commit to pancak3/llm-d-inference-sim that referenced this pull request Aug 24, 2025
* pass ctx to startServer

Signed-off-by: npolshakova <nina.polshakova@solo.io>

* fix sim test to use ctx

Signed-off-by: npolshakova <nina.polshakova@solo.io>

---------

Signed-off-by: npolshakova <nina.polshakova@solo.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Simulator does not stop on Ctrl+C

2 participants