-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Proposal: Granular Endpoint Configuration #5505
Conversation
Signed-off-by: Srushti Sapkale <srushtiisapkale@gmail.com>
Signed-off-by: Srushti Sapkale <srushtiisapkale@gmail.com>
Having something like this would be great for using Queriers with Prometheus sidecars. However, I think it can be a big pitfall when federating multiple queriers through a single query endpoint. A common use case with Thanos to have cluster-local or regional Queriers which are connected globally through one central Querier. The advantage of using Envoy in this case is that it can load-balance gRPC connections, something we currently don't support natively in Thanos. If people used the endpoints config to connect the global to the regional queriers, they will not be able to scale regional queriers due to the persistent nature of gRPC connections. Because of that, I think this feature should be very clear on when the endpoint config can be useful versus using something like Envoy. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for awesome work! 🌟
Some small suggestions! 🙂
Yes, thanks! we need to keep in mind that if the endpoint config is implemented we need a solution for scaling the querier. Also as @saswatamcode suggested, I think per store endpt configuration can a better option for distributed querier 👍 |
Signed-off-by: Srushti Sapkale <srushtiisapkale@gmail.com>
Signed-off-by: Srushti Sapkale <srushtiisapkale@gmail.com>
@saswatamcode can you review the changes in the proposal once again?:slightly_smiling_face: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Amazing! Some suggestions,
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
Signed-off-by: Srushti Sapkale <srushtiisapkale@gmail.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great job! Some suggestions we made during our 1:2
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
docs/proposals-accepted/202207-granular-endpoint-configuration.md
Outdated
Show resolved
Hide resolved
|
||
A new CLI option `--endpoints.config`, with no dynamic reloading, which will accept the path to a yaml file is proposed which contains a list as follows : | ||
|
||
```yaml |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I wonder if we want to tacle the @yeya24 request to enable different API
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I or @saswatamcode will add more context
mode: "" | ||
``` | ||
|
||
The YAML file contains set of endpoints (e.g Store API) with optional TLS options. To enable TLS either use this option or deprecated ones --grpc-client-tls* . |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can I specify multiple endpoint.config
flags?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cc me @saswatamcode
Signed-off-by: Srushti Sapkale <srushtiisapkale@gmail.com>
Hello 👋 Looks like there was no activity on this amazing PR for the last 30 days. |
What's the status of this proposal and the implementation @SrushtiSapkale @saswatamcode @bwplotka? Looks like this was marked stale now. |
Yup, so the proposal has some bits that need improvement! Will TAL. 🙂 |
This proposal was a part of my lfx mentorship about implementing the endpoint configuration. Need to add some more points, would be happy to take this forward whenever it gets reviewed again 😅 |
Hello 👋 Looks like there was no activity on this amazing PR for the last 30 days. |
Closing for now as promised, let us know if you need this to be reopened! 🤗 |
Signed-off-by: Srushti Sapkale srushtiisapkale@gmail.com