Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve the performance of adding index #35983

Closed
20 tasks done
Benjamin2037 opened this issue Jul 6, 2022 · 1 comment
Closed
20 tasks done

Improve the performance of adding index #35983

Benjamin2037 opened this issue Jul 6, 2022 · 1 comment
Assignees
Labels
sig/sql-infra SIG: SQL Infra type/feature-request Categorizes issue or PR as related to a new feature. type/new-feature

Comments

@Benjamin2037
Copy link
Collaborator

Benjamin2037 commented Jul 6, 2022

Feature Request

Is your feature request related to a problem? Please describe:

Adding indexes is a high-frequency operation in the proof-of-concept scenarios. However, for the large tables, it is a time-consuming process that may affect the user experience. There is still room for improvement in TiDB. For the similar requests, see #12963 and #14454.

Describe the feature you'd like:

We would like to achieve a better performance for adding index in TiDB, and reduce the impact on DML transactions for foreground traffic.

Stage 1: support the ingest method (3X)

Feature branch: #36767

Design:

Refactoring:

Config:

Framework:

Tests:

Stage 2: optimize add index reorganization (10X)

Experimental branch: #38110

@Benjamin2037 Benjamin2037 added the type/feature-request Categorizes issue or PR as related to a new feature. label Jul 6, 2022
@Benjamin2037 Benjamin2037 self-assigned this Jul 6, 2022
@Benjamin2037 Benjamin2037 changed the title Add index Acceleration DDL:Add index Acceleration Jul 6, 2022
@Benjamin2037
Copy link
Collaborator Author

Track issue:
#36165 dead lock problem

Benjamin2037 added a commit to Benjamin2037/tidb that referenced this issue Jul 20, 2022
Benjamin2037 added a commit to Benjamin2037/tidb that referenced this issue Jul 25, 2022
Benjamin2037 added a commit to Benjamin2037/tidb that referenced this issue Jul 25, 2022
Add sysvars and config parameter.
Change the system variables name(pingcap#35983)
tidb_ddl_enable_fast_reorg
tidb_ddl_disk_quota
fast-reorg-local-path.
@tangenta tangenta reopened this Oct 26, 2022
@tangenta tangenta assigned tangenta and unassigned Benjamin2037 Oct 26, 2022
@Ivy-YinSu Ivy-YinSu mentioned this issue Aug 5, 2024
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
sig/sql-infra SIG: SQL Infra type/feature-request Categorizes issue or PR as related to a new feature. type/new-feature
Projects
None yet
Development

No branches or pull requests

2 participants