Skip to content

Commit

Permalink
Tidying up docs
Browse files Browse the repository at this point in the history
Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
  • Loading branch information
alexeykudinkin committed Oct 25, 2024
1 parent 1230500 commit 314dbba
Showing 1 changed file with 6 additions and 3 deletions.
9 changes: 6 additions & 3 deletions python/ray/data/_internal/output_buffer.py
Original file line number Diff line number Diff line change
Expand Up @@ -89,10 +89,13 @@ def next(self) -> Block:
# into appropriately sized ones:
#
# - (Finalized) Target blocks sliced from the original one
# are *copied* to avoid holding up original one
# and are *copied* to avoid referencing original blocks
# - Temporary remainder of the block should *NOT* be copied
# such as to avoid repeatedly copying the remainder of the
# block, resulting in O(N^2) total bytes being copied
# such as to avoid repeatedly copying the remainder bytes
# of the block, resulting in O(M * N) total bytes being
# copied, where N is the total number of bytes in the original
# block and M is the number of blocks that will be produced by
# this iterator
block_to_yield = block.slice(0, target_num_rows, copy=True)
block_remainder = block.slice(
target_num_rows, block.num_rows(), copy=False
Expand Down

0 comments on commit 314dbba

Please sign in to comment.