Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

Spill support in Window Sort #467

Open
zhouyuan opened this issue Aug 12, 2021 · 0 comments
Open

Spill support in Window Sort #467

zhouyuan opened this issue Aug 12, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@zhouyuan
Copy link
Collaborator

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Window sort used too much memory, e.g., on TPC-DS Q67, probably due to data skew. Yarn will kill the containers if we enable memory check

Describe the solution you'd like
Support spill feature in Window Sort and limit the memory usage

Describe alternatives you've considered
N/A

Additional context
N/A

@zhouyuan zhouyuan added the enhancement New feature or request label Aug 12, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant