chore: Reserve memory for native shuffle writer per partition (#1022)

* Revert "chore: Revert "chore: Reserve memory for native shuffle writer per partition (#988)" (#1020)"

This reverts commit 8d097d5.

* fix

* fix

* fix

* fix