New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RefreshSegmentTaskGenerator: Evaluate and Use Server APIs to determine if refresh is needed. #14483

Open

vvivekiyer opened this issue Nov 18, 2024 · 0 comments

Contributor

vvivekiyer commented Nov 18, 2024

PR #14300 talks about the reasoning for triggering no-op minion tasks when there are table config updates.

Cons of this approach is that there will be minion tasks created for all segments for each table config update.

To overcome this problem, we can use a server side API that will return the list of segments to be refreshed. It is being developed in #14450.

vvivekiyer mentioned this issue

Minion Task to support automatic Segment Refresh #14300

Merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment