You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I searched in the issues and found nothing similar.
Flink version
FLINK 1.13 - FLINK 1.16 (all version)
Flink CDC version
Latest
Database and its version
Mysql (all version)
Minimal reproduce step
1、open scan.newly-added-table.enabled in mysql source
2、running in snapshot phase
3、stop and restart the job
The chunks that generated before stop will be generated again in the second start
So the data will be duplicated, this is unacceptable when table contains large chunk of data which will cause a lot of extra tim e
What did you expect to see?
no duplicate split when job restarts
What did you see instead?
duplicate split when job restarts
Anything else?
No response
Are you willing to submit a PR?
I'm willing to submit a PR!
The text was updated successfully, but these errors were encountered:
Search before asking
Flink version
FLINK 1.13 - FLINK 1.16 (all version)
Flink CDC version
Latest
Database and its version
Mysql (all version)
Minimal reproduce step
1、open scan.newly-added-table.enabled in mysql source
2、running in snapshot phase
3、stop and restart the job
The chunks that generated before stop will be generated again in the second start
So the data will be duplicated, this is unacceptable when table contains large chunk of data which will cause a lot of extra tim e
What did you expect to see?
no duplicate split when job restarts
What did you see instead?
duplicate split when job restarts
Anything else?
No response
Are you willing to submit a PR?
The text was updated successfully, but these errors were encountered: