Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question: Recommended way to disable an entire source #3277

Closed
DavidR91 opened this issue Aug 7, 2023 · 3 comments
Closed

Question: Recommended way to disable an entire source #3277

DavidR91 opened this issue Aug 7, 2023 · 3 comments
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. triage/needs-user-input Issues which are waiting on a response from the reporter

Comments

@DavidR91
Copy link

DavidR91 commented Aug 7, 2023

Scenario

We are switching between a live and a standby cluster, where we want the standby to no longer be pulling events off of Kafka - but ideally we don't want to delete every broker / every trigger each time this switch happens

Question

Is there a recommended way to drive a setup where an entire source may need to be disabled or disconnected without causing too much 'churn'? (And ideally while allowing any events already in the system to safely drain and complete)

Additional Info

We're using a Kafka source, and then a number of brokers (10-20) and then per broker we have a number of Triggers (5-10). Deletion/recreation of these triggers etc. each time we switch live and standby would be very awkward (and probably error prone)

@Cali0707
Copy link
Member

@DavidR91 just to make sure we are on the same page here: when speaking of a live and a standby cluster do you mean a live and a standby Kafka cluster or a live and a standby k8s/knative cluster?

/triage needs-user-input

@knative-prow knative-prow bot added the triage/needs-user-input Issues which are waiting on a response from the reporter label Aug 22, 2023
@Cali0707
Copy link
Member

@DavidR91 we are currently working on implementing autoscaling of various eventing kafka broker components, such as triggers and sources (see #1537). The current first step is to add in KEDA autoscaling of the Kafka Source, although there is also an issue for adding KEDA autoscaling of triggers (see #1408). Do you think this would solve your use case?

Copy link
Contributor

This issue is stale because it has been open for 90 days with no
activity. It will automatically close after 30 more days of
inactivity. Reopen the issue with /reopen. Mark the issue as
fresh by adding the comment /remove-lifecycle stale.

@github-actions github-actions bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Nov 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. triage/needs-user-input Issues which are waiting on a response from the reporter
Projects
None yet
Development

No branches or pull requests

2 participants