You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The rechunker algorithm has support for multi-stage rechunking, which reduces the number of IO operations.
It would be good to enable this in Cubed rechunk. The simplest way to do this would be to expose the min_mem parameter, but it might be interesting to see if there is a way of automatically finding the number of stages that optimizes for something we care about (e.g. min IO ops).
The text was updated successfully, but these errors were encountered:
The rechunker algorithm has support for multi-stage rechunking, which reduces the number of IO operations.
It would be good to enable this in Cubed
rechunk
. The simplest way to do this would be to expose themin_mem
parameter, but it might be interesting to see if there is a way of automatically finding the number of stages that optimizes for something we care about (e.g. min IO ops).The text was updated successfully, but these errors were encountered: