Skip to content

[Improvement] refactor getPartitionRange to calculate range directly #443

@advancedxy

Description

@advancedxy

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

ShuffleStorageUtils.getPartitionRange is not performant...

It could be calculated directly in O(1).. However current impl is about O(n) where n is the number of partition ranges. when partition range size =1, n is corresponding to partition numbers.

How should we improve?

refactor ShuffleStorageUtils.getPartitionRange to calculate range directly.

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions