Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better Performance of MergePartitionStats2GlobalStats #47219

Closed
hawkingrei opened this issue Sep 25, 2023 · 0 comments · Fixed by #47391
Closed

Better Performance of MergePartitionStats2GlobalStats #47219

hawkingrei opened this issue Sep 25, 2023 · 0 comments · Fixed by #47391
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@hawkingrei
Copy link
Member

Enhancement

Currently, the performance of the MergePartitionStats2GlobalStats function may not meet the requirements under certain complex scenarios or large data volumes, which may affect overall system performance and efficiency.
@hawkingrei hawkingrei added the type/enhancement The issue or PR belongs to an enhancement. label Sep 25, 2023
This was referenced Sep 25, 2023
Merged
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Sep 25, 2023
@hawkingrei
statistics: first calculate NDV to better reuse memory (#47220)
f3ea9b0 
ref #47219
@hawkingrei hawkingrei mentioned this issue Sep 26, 2023
Open
ti-chi-bot bot pushed a commit that referenced this issue Sep 26, 2023
@hawkingrei
*: remove useless cache in the MergePartitionStats2GlobalStats (#47217)
3f09e35 
ref #47219
ti-chi-bot bot pushed a commit that referenced this issue Sep 26, 2023
@hawkingrei
analyze: add more test for global stats (#47229)
2dc75cc 
ref #47219
This was referenced Sep 28, 2023
Merged
Merged
@hawkingrei hawkingrei mentioned this issue Oct 7, 2023
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue Oct 7, 2023
@hawkingrei
statistics: quickly exit FindTopN and LocateBucket (#47373)
5e89d28 
ref #47219
ti-chi-bot bot pushed a commit that referenced this issue Oct 7, 2023
@hawkingrei
statistics: reduce the copy when to merge global status (#47372)
0b0032b 
ref #47219
ti-chi-bot bot pushed a commit that referenced this issue Oct 11, 2023
@hawkingrei
statistics: async merge global stats to reduce memory usage (#47391)
7f9ab7f 
close #47219
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

statistics: async merge global stats to reduce memory usage hawkingrei/tidb
1 participant
@hawkingrei