Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] When the paimon-flink-cdc module processes Kafka messages formatted in maxwell-json, if it encounters events lacking the "data" field, such as "table-alter", the program immediately throws an error and enters an unrecoverable state. #5092

Open
2 tasks done
jjrrzxc opened this issue Feb 14, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@jjrrzxc
Copy link

jjrrzxc commented Feb 14, 2025

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version

9d2a460

Compute Engine

flink 1.17

Minimal reproduce step

1.Establish a connection with the MySQL database, Maxwell collector, Kafka, and the paimon-flink-cdc program.
2.Initiate table-level modifications on MySQL tables, specifically table-alter events, such as ALTER TABLE xxx AUTO_INCREMENT = 2300.
3.The paimon-flink-cdc will throw an error message: "invalid maxwell-json format: missing 'data' field."

What doesn't meet your expectations?

The program encountered an error and cannot be recovered. It is expected to prevent such errors.

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@jjrrzxc jjrrzxc added the bug Something isn't working label Feb 14, 2025
jjrrzxc pushed a commit to jjrrzxc/incubator-paimon that referenced this issue Feb 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant