Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JSON column breaks changefeed #3624

Closed
ivanrubanau opened this issue Nov 25, 2021 · 1 comment · Fixed by #3643
Closed

JSON column breaks changefeed #3624

ivanrubanau opened this issue Nov 25, 2021 · 1 comment · Fixed by #3643
Assignees
Labels
affects-5.0 affects-5.1 affects-5.2 area/ticdc Issues or PRs related to TiCDC. severity/moderate type/bug The issue is confirmed as a bug.

Comments

@ivanrubanau
Copy link

What did you do?

I'm trying to replicate table with json column. Here is table definition:

CREATE TABLE `sample_table` (
                                    `id` bigint(20) unsigned primary key NOT NULL AUTO_INCREMENT,
                                    `json_payload` json DEFAULT NULL
)

I have changefeed configured to post updates to Kafka in AVRO format.

If I add row with json_payload equals NULL, everything works as expected, I can see updates in proper Kafka topic.

What did you expect to see?

If I add row with any valid JSON as json_payload column value, I expect to see proper event in Kafka topic.

What did you see instead?

Instead of emitting event, changefeed goes to broken state and stops replicating any future events as well.

Only suspicious thing that I found in logs is

[DEBUG] [client.go:635] ["region failed"] [regionID=7013] [error="[CDC:ErrEventFeedAborted]single event feed aborted"]

Versions of the cluster

Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):

Release Version: v5.2.2
Edition: Community
Git Commit Hash: da1c21fd45a4ea5900ac16d2f4a248143f378d18
Git Branch: heads/refs/tags/v5.2.2
UTC Build Time: 2021-10-20 06:08:33
GoVersion: go1.16.4
Race Enabled: false
TiKV Min Version: v3.0.0-60965b006877ca7234adaced7890d7b029ed1306
Check Table Before Drop: false

TiCDC version (execute cdc version):

Release Version: v5.2.2
Git Commit Hash: a04ddac9fe83c8bdff267e4c44150060ea05f5ec
Git Branch: heads/refs/tags/v5.2.2
UTC Build Time: 2021-10-29 03:21:45
Go Version: go version go1.16.4 linux/amd64
Failpoint Build: false
@ivanrubanau ivanrubanau added area/ticdc Issues or PRs related to TiCDC. type/bug The issue is confirmed as a bug. labels Nov 25, 2021
@dveeden
Copy link
Contributor

dveeden commented Nov 25, 2021

/assign

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-5.0 affects-5.1 affects-5.2 area/ticdc Issues or PRs related to TiCDC. severity/moderate type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants