Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

retry on unknown RPC error from TiKV #43291

Closed
Tracked by #43740
D3Hunter opened this issue Apr 21, 2023 · 0 comments · Fixed by #43293
Closed
Tracked by #43740

retry on unknown RPC error from TiKV #43291

D3Hunter opened this issue Apr 21, 2023 · 0 comments · Fixed by #43293
Assignees
@D3Hunter
Labels
affects-6.5 affects-7.1 component/lightning This issue is related to Lightning of TiDB. severity/moderate type/bug The issue is confirmed as a bug. type/enhancement The issue or PR belongs to an enhancement.

Comments

@D3Hunter
Copy link
Contributor

Enhancement

met a case when write to tikv, report error rpc error: code = Unknown desc = EngineTraits(Engine(Status { code: IoError, sub_code: None, sev: NoError, state: \"IO error: No such file or directory: while stat a file for size: /...../63992d9c-fbc8-4708-b963-32495b299027_32279707_325_5280_write.sst: No such file or directory\", should retry on this.

annotate write error with peer/region/store info to help debug

print log when failed to import table with real error stack. common.NormalizeOrWrapErr has bug that it may replace the stack.(will not fix in the related pr, can fix it later.)
@D3Hunter D3Hunter added type/enhancement The issue or PR belongs to an enhancement. component/lightning This issue is related to Lightning of TiDB. labels Apr 21, 2023
@D3Hunter D3Hunter mentioned this issue Apr 21, 2023
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Apr 21, 2023
@D3Hunter
lightning: retry on unknown RPC error, log more info to help debug (#…
69d9a7c 
…43293)

close #43291
This was referenced Apr 21, 2023
Closed
Merged
Merged
@D3Hunter D3Hunter added type/bug The issue is confirmed as a bug. severity/moderate labels Apr 24, 2023
@lance6716 lance6716 mentioned this issue May 12, 2023
Open
16 tasks
@ti-chi-bot ti-chi-bot mentioned this issue Jun 14, 2023
Merged
12 tasks
ti-chi-bot bot pushed a commit that referenced this issue Jun 14, 2023
@ti-chi-bot
lightning: retry on unknown RPC error, log more info to help debug (#…
3d3e7bc 
…43293) (#44664)

close #43291
@GMHDBJD GMHDBJD mentioned this issue Jun 25, 2023
Merged
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@D3Hunter D3Hunter

Labels
affects-6.5 affects-7.1 component/lightning This issue is related to Lightning of TiDB. severity/moderate type/bug The issue is confirmed as a bug. type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

lightning: retry on unknown RPC error, log more info to help debug pingcap/tidb
2 participants
@D3Hunter @niubell