Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multi AZ Gateway #593

Open
cesr opened this issue Nov 12, 2024 · 2 comments
Open

Multi AZ Gateway #593

cesr opened this issue Nov 12, 2024 · 2 comments
Assignees

Comments

@cesr
Copy link
Contributor

cesr commented Nov 12, 2024

For some users in the US the latency cost of the roundtrip between our EU servers and them is too high. We can fix this by implementing a global deployment of gateway via cloudflare workers and leveraging hyperdrive to minimize the penalty costs of reaching our regional database

@cesr cesr converted this from a draft issue Nov 12, 2024
@cesr
Copy link
Contributor Author

cesr commented Nov 12, 2024

@geclos I don't think this should be prioritized right now, moving to backlog p2

@cesr cesr moved this from Next to Backlog in Latitude LLM Roadmap Nov 12, 2024
@geclos
Copy link
Collaborator

geclos commented Nov 14, 2024

hmm I think this is very important actually, I would do it asap

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Development

No branches or pull requests

2 participants