-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature][transforms-v2] Support append only stream from cdc source #7763
Conversation
ddc4331
to
16d0a4f
Compare
Is it possible to use the current SQL transform to turn one record into multiple records? |
...el-transforms-v2/src/main/java/org/apache/seatunnel/transform/cdc/CdcRowTransformConfig.java
Outdated
Show resolved
Hide resolved
...el-transforms-v2/src/main/java/org/apache/seatunnel/transform/cdc/CdcRowTransformConfig.java
Outdated
Show resolved
Hide resolved
seatunnel-transforms-v2/src/main/java/org/apache/seatunnel/transform/cdc/CdcRowTransform.java
Outdated
Show resolved
Hide resolved
bf9ff26
to
15395c2
Compare
|
d6f2cdf
to
6d5c70b
Compare
Please fix ci. |
...part-1/src/test/java/org/apache/seatunnel/e2e/transform/TestRowKindExtractorTransformIT.java
Outdated
Show resolved
Hide resolved
6d5c70b
to
ec905fe
Compare
ec905fe
to
83e6b18
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM If ci passed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Purpose of this pull request
issues: #7756
Add a new transform which can transform cdc row to append only row that contains the cdc rowkind or other needed info.
Example:
CDC row: +D 1, test1, test2
new Row: +I 1,test1,test2,DELETE
Does this PR introduce any user-facing change?
How was this patch tested?
UT: CdcRowTransformFactoryTest CdcRowTransformTest
ETE: TestCdcRowTransformIT
Check list
New License Guide
release-note
.