Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[prover] Handle connection between orchestrator and broker with multiple pending requests #8490

Open
spalladino opened this issue Sep 11, 2024 · 0 comments

Comments

@spalladino
Copy link
Collaborator

spalladino commented Sep 11, 2024

As @alexghr has identified, the orchestrator(s) may have 1000s of requests pending sent to the broker. If we use the default json-rpc abstraction, that means one awaited promise on an http connection per request, which will quickly exhaust the number of connections we can handle.

Instead, consider a long-lived connection like a websocket. The broker should have a stub on the orchestrator's side that handles this, and the interface to the orchestrator should be a simple one where it sends a request and eventually receives a callback. The broker should accept a job id for each request, and include it in the callback with the response.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant