Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make it easier to observe data skew between different pipelines in TiFlash #4403

Open
windtalker opened this issue Mar 24, 2022 · 0 comments
Open

Make it easier to observe data skew between different pipelines in TiFlash #4403

windtalker opened this issue Mar 24, 2022 · 0 comments
Assignees
@fuzhe1989
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@windtalker
Copy link
Contributor

windtalker commented Mar 24, 2022 •
edited
Loading

Enhancement

When running MPP/BatchCop Task, TiFlash usually use multiple pipeline to process the data, sometimes there maybe an unexpected data skew between different pipeline, and this will hurt the overall performance, but we do not have an easy way to observe the data skew, need to provide an easier way to observe this.
@windtalker windtalker added the type/enhancement The issue or PR belongs to an enhancement. label Mar 24, 2022
@windtalker windtalker self-assigned this Mar 24, 2022
@windtalker windtalker mentioned this issue Mar 24, 2022
Merged
12 tasks
@windtalker windtalker changed the title Make it easier to observe data skew between different BlockInputStreams in TiFlash Make it easier to observe data skew between different pipelines in TiFlash Mar 24, 2022
@windtalker windtalker assigned SeaRise and unassigned windtalker Mar 24, 2022
@windtalker windtalker mentioned this issue Mar 24, 2022
Closed
@windtalker windtalker assigned fuzhe1989 and unassigned SeaRise Mar 24, 2022
ti-chi-bot pushed a commit that referenced this issue Mar 25, 2022
@windtalker
Add some log to make it easier to observe data skew (#4404)
928e919 
ref #4403, close #4427
@ti-chi-bot ti-chi-bot mentioned this issue Mar 25, 2022
Merged
12 tasks
ti-chi-bot added a commit that referenced this issue Mar 25, 2022
@ti-chi-bot
Add some log to make it easier to observe data skew (#4404) (#4430)
f8feb5c 
ref #4403, close #4427
@fuzhe1989 fuzhe1989 mentioned this issue Apr 3, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fuzhe1989 fuzhe1989

Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@windtalker @fuzhe1989 @SeaRise