Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ticdc lag is more than 4m after inject one tikv network partition to all #8809

Closed
Lily2025 opened this issue Apr 19, 2023 · 10 comments
Closed

Comments

@Lily2025
Copy link

Lily2025 commented Apr 19, 2023

What did you do?

1、run tpcc with threads 10 and warehouse 1000
2、After 10 minutes, simulates one of tikv is network isolated from other all pods
fault start time:2023-04-18 10:44:27
3、After 10 minutes, recovery the fault
fault recover time:2023-04-18 10:54:27

What did you expect to see?

changefeed lag is less than 30s

What did you see instead?

ticdc lag is more than 4m after inject fault
image

Versions of the cluster

git hash:5252420517ce5497ed053aa6322fdb2a33f898e1

@Lily2025 Lily2025 added area/dm Issues or PRs related to DM. type/bug The issue is confirmed as a bug. labels Apr 19, 2023
@Lily2025
Copy link
Author

/remove-area dm
/area ticdc
/assign overvenus

@ti-chi-bot ti-chi-bot added area/ticdc Issues or PRs related to TiCDC. and removed area/dm Issues or PRs related to DM. labels Apr 19, 2023
@nongfushanquan
Copy link
Contributor

/unassign @overvenus
/assign @hicqu

@ti-chi-bot ti-chi-bot assigned hicqu and unassigned overvenus Apr 20, 2023
@fubinzh
Copy link

fubinzh commented Apr 20, 2023

/severity major

@nongfushanquan
Copy link
Contributor

By the design
/close

@ti-chi-bot ti-chi-bot bot closed this as completed Jun 9, 2023
@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Jun 9, 2023

@nongfushanquan: Closing this issue.

In response to this:

By the design
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@zhangjinpeng87
Copy link
Contributor

@nongfushanquan what is the root cause?

@zhangjinpeng87
Copy link
Contributor

Does this issue can be fixed by #8858 ?

@nongfushanquan
Copy link
Contributor

nongfushanquan commented Sep 21, 2023

duplicated with #9741, fixed by the #9771

@nongfushanquan
Copy link
Contributor

/close

@ti-chi-bot ti-chi-bot bot closed this as completed Sep 28, 2023
@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Sep 28, 2023

@nongfushanquan: Closing this issue.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Development

No branches or pull requests

7 participants