Skip to content

Conversation

@bveeramani
Copy link
Member

Description

test_preserve_hash_shuffle_blocks has been flaking consistently. To mitigate the flakiness, this PR bumps the test size from "small" to "medium".

[2025-12-06T07:06:32Z] //python/ray/data:test_preserve_hash_shuffle_blocks                     TIMEOUT in 3 out of 3 in 63.4s
--
[2025-12-06T07:06:32Z]   Stats over 3 runs: max = 63.4s, min = 60.1s, avg = 62.3s, dev = 1.6s
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test.log
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test_attempts/attempt_1.log
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test_attempts/attempt_2.log
[2025-12-06T07:06:32Z]

See also #58988

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request intends to increase the timeout for the flaky test test_preserve_hash_shuffle_blocks by changing its size to 'medium'. However, the code change incorrectly modifies the size of test_download_expression. This appears to be a mistake, as the change does not address the flakiness issue described in the pull request. The size modification should be applied to test_preserve_hash_shuffle_blocks instead.

py_test(
name = "test_download_expression",
size = "small",
size = "medium",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

critical

The pull request title and description state the goal is to increase the timeout for test_preserve_hash_shuffle_blocks. However, this change modifies the test_download_expression test instead. This seems to be an error. Please revert this change and apply the size increase to the py_test definition for test_preserve_hash_shuffle_blocks to resolve the flakiness issue.

Suggested change
size = "medium",
size = "small",

py_test(
name = "test_download_expression",
size = "small",
size = "medium",
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bug: Wrong test modified - intended test_preserve_hash_shuffle_blocks

The PR intends to increase the timeout for test_preserve_hash_shuffle_blocks which is flaking, but the size change from "small" to "medium" was accidentally applied to test_download_expression instead. The test_preserve_hash_shuffle_blocks test at line 1793-1794 still has size = "small", so the flakiness issue will not be resolved.

Fix in Cursor Fix in Web

@ray-gardener ray-gardener bot added the data Ray Data-related issues label Dec 8, 2025
@bveeramani bveeramani enabled auto-merge (squash) December 8, 2025 21:27
@github-actions github-actions bot added the go add ONLY when ready to merge, run all tests label Dec 8, 2025
@bveeramani bveeramani merged commit 7c2274f into master Dec 8, 2025
7 checks passed
@bveeramani bveeramani deleted the increase-preserve-hash-shuffle-blocks-size branch December 8, 2025 22:11
bveeramani added a commit that referenced this pull request Dec 12, 2025
## Description

`test_preserve_hash_shuffle_blocks` has been flaking consistently. To
mitigate the flakiness, this PR bumps the test size from "small" to
"medium".

This is a follow-up to #59256,
which accidentally bumped the wrong test.

```
[2025-12-06T07:06:32Z] //python/ray/data:test_preserve_hash_shuffle_blocks                     TIMEOUT in 3 out of 3 in 63.4s
--
[2025-12-06T07:06:32Z]   Stats over 3 runs: max = 63.4s, min = 60.1s, avg = 62.3s, dev = 1.6s
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test.log
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test_attempts/attempt_1.log
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test_attempts/attempt_2.log
[2025-12-06T07:06:32Z]
```

See also #58988

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Yicheng-Lu-llll pushed a commit to Yicheng-Lu-llll/ray that referenced this pull request Dec 22, 2025
…ect#59399)

## Description

`test_preserve_hash_shuffle_blocks` has been flaking consistently. To
mitigate the flakiness, this PR bumps the test size from "small" to
"medium".

This is a follow-up to ray-project#59256,
which accidentally bumped the wrong test.

```
[2025-12-06T07:06:32Z] //python/ray/data:test_preserve_hash_shuffle_blocks                     TIMEOUT in 3 out of 3 in 63.4s
--
[2025-12-06T07:06:32Z]   Stats over 3 runs: max = 63.4s, min = 60.1s, avg = 62.3s, dev = 1.6s
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test.log
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test_attempts/attempt_1.log
[2025-12-06T07:06:32Z]   /root/.cache/bazel/_bazel_root/1df605deb6d24fc8068f6e25793ec703/execroot/io_ray/bazel-out/k8-opt/testlogs/python/ray/data/test_preserve_hash_shuffle_blocks/test_attempts/attempt_2.log
[2025-12-06T07:06:32Z]
```

See also ray-project#58988

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Ray Data-related issues go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants