Code

feat: add kafka backfill frontend#15602

Code

Merged

xxchan merged 34 commits intomainrisingwavelabs/risingwave:mainfrom xxchan/backfill-ferisingwavelabs/risingwave:xxchan/backfill-feCopy head branch name to clipboardApr 2, 2024

+1,275-308

Commits

Commits on Mar 12, 2024

• fix: deny create MV on shared CDC source

  xxchan

  committed
  9c44201

• feat: add kafka backfill frontend

  xxchan

  committed
  55fde18

• add config for easy of testing

  xxchan

  committed
  2285c1f

Commits on Mar 13, 2024

• cleanup silly issues

  xxchan

  committed
  6aa8502

• fix shared cdc source

  xxchan

  committed
  4c7ae69

• fix test

  xxchan

  committed
  2daa0a8

Commits on Mar 15, 2024

• rename has_streaming_job -> is_shared

  xxchan

  committed
  8d996f4

• refine add_partition_offset_cols

  xxchan

  committed
  82afb30

• rename the plan SourceBackfill -> SourceScan

  xxchan

  committed
  5abbb11

• rename upstream_mview_actors->upstream_root_actors

  xxchan

  committed
  fef7611

Commits on Mar 18, 2024

• refine source_manager

  xxchan

  committed
  8805238

• refine rewrite_inner, unif CdcFilter and SourceBackfill

  xxchan

  committed
  d028469

• Merge branch 'main' into xxchan/backfill-fe

  xxchan

  committed
  cc8cb41

Commits on Mar 19, 2024

• Merge branch 'main' into xxchan/backfill-fe

  xxchan

  committed
  4f850de

• rename reuseable source -> shared source

  xxchan

  committed
  31b34f0

Commits on Mar 25, 2024

• Merge branch 'main' into xxchan/backfill-fe

  xxchan

  committed
  87c7cad

• fix compile

  xxchan

  committed
  27db3f6

• fix cdc table stuck. due to track id

  xxchan

  committed
  9f8f533

• fix

  xxchan

  committed
  78a783f

• fix pg_settings order

  xxchan

  committed
  06027ca

• really fix tracking_progress_actor_ids

  xxchan

  committed
  fa521f0

Commits on Mar 26, 2024

• - no need for a separated LogicalSourceScan node.

  Show description for 58034cc
  xxchan

  committed
  58034cc

• add (very simple) e2e tests

  xxchan

  committed
  18ea279

• fix executor bug: should ignore backfilled rows when the partition is done (note this is manually tested. no tests...)

  xxchan

  committed
  658cb52

• support scaling source backfill

  Show description for 231b93c
  xxchan

  committed
  231b93c

Commits on Mar 28, 2024

• Revert "support scaling source backfill" (For a new PR)

  Show description for 0339b38
  xxchan

  committed
  0339b38

• refine

  xxchan

  committed
  17e3779

• fix

  xxchan

  committed
  2e5c1c0

Commits on Mar 31, 2024

• Merge remote-tracking branch 'origin/main' into xxchan/backfill-fe

  xxchan

  committed
  144d7ae

Commits on Apr 1, 2024

• don't deprecate cdc_source_job for compatibility

  xxchan

  committed
  e174c12

• minor fix

  xxchan

  committed
  98cfb72

Commits on Apr 2, 2024

• proto: rename cdc_source_job without renaming

  xxchan

  committed
  f169dec

• rename backfillable -> shareable

  xxchan

  committed
  aafba45

• Merge remote-tracking branch 'origin/main' into xxchan/backfill-fe

  xxchan

  committed
  a3accdb