Skip to content

Conversation

@bveeramani
Copy link
Member

@bveeramani bveeramani commented Nov 17, 2025

Description

#58711 decreased the scale of the map_groups tests from scale-factor 100 to scale-factor 10 because some of the map_groups release tests were failing. However, after more investigation, I realized that the only variant that doesn't work with scale-factor 100 is the hash shuffle with autoscaling variant (see #58734).

This PR re-increases the scale and only disables the cases that fail.

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
@bveeramani bveeramani marked this pull request as draft November 17, 2025 21:26
Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds a fixed_size cluster variant to the map_groups release test. To make it pass, the scale factor (sf) was reduced from 100 to 10. My review points out that this change also reduces the test scale for the existing autoscaling variant, potentially lowering test coverage. I've suggested a way to use different scale factors for each cluster type. I also noted that a comment explaining why the test was limited to autoscaling clusters is now outdated and should be updated or removed.

bveeramani and others added 3 commits November 17, 2025 15:54
Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
@bveeramani bveeramani changed the title [Data] Add fixed-size variant of map_groups release test [Data] Increase scale of map_groups release tests from SF10 to SF100 Nov 25, 2025
@bveeramani bveeramani marked this pull request as ready for review November 25, 2025 02:58
@bveeramani bveeramani enabled auto-merge (squash) November 25, 2025 02:58
@github-actions github-actions bot added the go add ONLY when ready to merge, run all tests label Nov 25, 2025
@bveeramani bveeramani merged commit f88c49b into master Nov 25, 2025
8 checks passed
@bveeramani bveeramani deleted the fixed-size-map-groups branch November 25, 2025 05:36
SheldonTsen pushed a commit to SheldonTsen/ray that referenced this pull request Dec 1, 2025
ray-project#58710)

> Thank you for contributing to Ray! 🚀
> Please review the [Ray Contribution
Guide](https://docs.ray.io/en/master/ray-contribute/getting-involved.html)
before opening a pull request.

> ⚠️ Remove these instructions before submitting your PR.

> 💡 Tip: Mark as draft if you want early feedback, or ready for review
when it's complete.

## Description
> Briefly describe what this PR accomplishes and why it's needed.

ray-project#58711 decreased the scale of the
`map_groups` tests from scale-factor 100 to scale-factor 10 because some
of the `map_groups` release tests were failing. However, after more
investigation, I realized that the only variant that doesn't work with
scale-factor 100 is the hash shuffle with autoscaling variant (see
ray-project#58734).

This PR re-increases the scale and only disables the cases that fail.

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants