[Proposal] Show all MemTrackers on BE's website #3714
Description
When we want to trouble shoot some online memory usage problems, MemTracker can provide many helpful information, it can show us its label, how many memory it consumed now and what's its history peak. But there are some barriers:
- MemTrackers are not well organized: there are many root mem trackers (has no parent), and they are distributed in many modules/submodules in BE
- Not well labeld: many of them has a very general label so can't be distinguished for users.
- Not well unlimited: many of them has unlimited memory usage (-1)
- MemTracker class is out of date, Impala and Kudu's MemTracker have fixed some bugs and improved some features
Describe the solution you'd like
I want to display all memtrackers on website like how Kudu do:
Steps
- update MemTracker to the latest Impala and Kudu's, combine Doris, Impala and Kudu's modification.
- Optimize use mode: use shared_ptr to manage memtrackers, and organize them in a or some trees
- Use distinguishable labels and reasonable memory limit
- Show memtrackers on web