Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cdc-composer] Add common and runtime JAR on submit #2795

Merged

Conversation

PatrickRen
Copy link
Contributor

This pull request adds a logic in composer that discovers runtime and common JARs (usually the same one flink-cdc-dist) and submit then to the Flink cluster together with job graph.

The dependencies of flink-cdc-pipeline-connectors are marked as provided, in order to not bundling flink-cdc-runtime and flink-cdc-common into connector JARs.

@PatrickRen PatrickRen self-assigned this Dec 2, 2023
Copy link
Contributor

@leonardBang leonardBang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, thanks @PatrickRen for the contribution

@leonardBang leonardBang merged commit 173deb5 into apache:master Dec 2, 2023
17 checks passed
lvyanquan added a commit to lvyanquan0624/flink-cdc-connectors that referenced this pull request Dec 3, 2023
* schema:
  [pipeline-common] use column name to judge whether a column is existed in a specific schema.
  [cdc-composer] Add common and runtime JAR when submit (apache#2795)
  [cdc-connector][debezium] Supports conversion  from binary bytes to base64 encoded string (apache#2435)
  [cdc-connector][mysql] MysqlTableSource return metadata in a fixed order (apache#2578)
  [cdc-connector][mysql] Fix snapshot fetch size conf does not take effect (apache#2766)
ChaomingZhangCN pushed a commit to ChaomingZhangCN/flink-cdc that referenced this pull request Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants