Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MemoryTracker: tracing the memory usage of MPPPacketData #4479

Closed
SeaRise opened this issue Mar 28, 2022 · 1 comment
Closed

MemoryTracker: tracing the memory usage of MPPPacketData #4479

SeaRise opened this issue Mar 28, 2022 · 1 comment
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@SeaRise
Copy link
Contributor

SeaRise commented Mar 28, 2022 •
edited
Loading

Enhancement

Now MemoryTracker doesn't track MPPPacketData's memory usage.

In grpc sync mode, the min size of ExchangeReceiverBase.msg_channel is batch_packet_count = 16.
The max size of MPPPacketData is 2gb.

If msg_channel is full, 2gb * 16 = 32gb of memory may be used.
@SeaRise SeaRise added the type/enhancement The issue or PR belongs to an enhancement. label Mar 28, 2022
@SeaRise SeaRise changed the title MemoryTracker: tracing the memory useage of MPPPacketData MemoryTracker: tracing the memory usage of MPPPacketData Mar 28, 2022
@SeaRise
Copy link
Contributor Author

SeaRise commented Aug 24, 2022

Repeat with #5609

@SeaRise SeaRise closed this as completed Aug 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@SeaRise