Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement incremental refresh for single-table, predicate-only MVs #20959

Merged
merged 6 commits into from
Jun 20, 2024

Commits on Jun 14, 2024

  1. Add incremental refresh support for simple Iceberg MVs

    When MV refresh is executing, the planner suggests either incremental or full refresh to the connector. In this first phase, incremental refresh is suggested only when Scan/Filter/Project nodes are present in the plan tree - otherwise full refresh. The Iceberg connector can act on this signal and use IncrementalAppendScan to scan the 'delta' records only and append them to the MV storage table (without truncation).
    marton-bod authored and Marton Bod committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    23af6c9 View commit details
    Browse the repository at this point in the history
  2. Empty commit

    marton-bod authored and Marton Bod committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    74418e1 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Address review comments

    marton-bod authored and Marton Bod committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    8c14f0c View commit details
    Browse the repository at this point in the history
  2. Address review comments

    marton-bod authored and Marton Bod committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    e8055f3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    85679a3 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. fixup

    sopel39 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    163dea5 View commit details
    Browse the repository at this point in the history