Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[controller] do not delay RT topic deletion if the store is no longer hybrid #1358

Merged
merged 4 commits into from
Dec 4, 2024

Conversation

arjun4084346
Copy link
Contributor

@arjun4084346 arjun4084346 commented Dec 2, 2024

Avoid getStore from the controller which is not the leader of cluster this store is a part of

When TopicCleanupService tries to delete RT topics, it does not have to wait for all the corresponding VT topics to get deleted if all the versions of the store has changed from hybrid to batch. If all the versions are batch, it can be safely assumed that no VT topic is consuming from that RT topic.
This was already done in #1234 but that commit was reverted in #1355
It was reverted because TCS was trying to get Store for which it was not the leader controller. Only leader controller caches and stores the information for all the stores in the cluster it is leader of.

So this time, isRTTopicDeletionPermittedByAllControllers will not take Store object, it will use the ControllerClientMap to get Store information for all the stores.

Resolves #XXX

How was this PR tested?

Does this PR introduce any user-facing changes?

  • No. You can skip the rest of this section.
  • Yes. Make sure to explain your proposed changes and call out the behavior change.

@arjun4084346 arjun4084346 changed the title Fixtcs Redo the work of #1234 Dec 2, 2024
@arjun4084346 arjun4084346 marked this pull request as draft December 2, 2024 23:02
@arjun4084346 arjun4084346 force-pushed the fixtcs branch 2 times, most recently from 60aefd2 to fcda64d Compare December 3, 2024 17:44
@arjun4084346 arjun4084346 changed the title Redo the work of #1234 [controller] do not delay RT topic deletion if the store is no longer hybrid Dec 3, 2024
@arjun4084346 arjun4084346 marked this pull request as ready for review December 3, 2024 18:32
@arjun4084346 arjun4084346 merged commit 8d73729 into linkedin:main Dec 4, 2024
51 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants