Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lightning import data error summray trimmed #58085

Closed
fubinzh opened this issue Dec 9, 2024 · 2 comments · Fixed by #58148
Closed

Lightning import data error summray trimmed #58085

fubinzh opened this issue Dec 9, 2024 · 2 comments · Fixed by #58148
Labels
affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects the 5.4.x(LTS) versions. affects-6.1 This bug affects the 6.1.x(LTS) versions. affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. component/lightning This issue is related to Lightning of TiDB. severity/moderate type/bug The issue is confirmed as a bug.

Comments

@fubinzh
Copy link

fubinzh commented Dec 9, 2024

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

  1. Running lightning parallel import with duplicate-resolution on, and there are conflict data in data source.
[tikv-importer]
  backend = "local"
  duplicate-resolution = "record"
  incremental-import = true
  sorted-kv-dir = "/tmp/sorted-kv-dir"

  1. Check lighting import result

2. What did you expect to see? (Required)

Lighting imort should failed, and console message should let user know the table in TiDB where they can find detailed information for the conflict.

8.1.1 example
Image

3. What did you see instead (Required)

For lighting 6.5, the table name is trimmed in the console.

Image

information in log is correct.

2024/12/09 04:07:00.578 +00:00] [WARN] [errormanager.go:475] ["Detect 44 data type errors in total, please refer to table `lightning_task_info`.`conflict_error_v1_2` for more details"]

4. What is your TiDB version? (Required)

v6.5.11

@fubinzh fubinzh added the type/bug The issue is confirmed as a bug. label Dec 9, 2024
@fubinzh
Copy link
Author

fubinzh commented Dec 9, 2024

/component lightning

@ti-chi-bot ti-chi-bot bot added the component/lightning This issue is related to Lightning of TiDB. label Dec 9, 2024
@fubinzh
Copy link
Author

fubinzh commented Dec 9, 2024

/severity moderate

@lance6716 lance6716 added affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects the 5.4.x(LTS) versions. affects-6.1 This bug affects the 6.1.x(LTS) versions. affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. labels Dec 9, 2024
@ti-chi-bot ti-chi-bot bot closed this as completed in 7e34efa Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects the 5.4.x(LTS) versions. affects-6.1 This bug affects the 6.1.x(LTS) versions. affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. component/lightning This issue is related to Lightning of TiDB. severity/moderate type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants