Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: Add ForkJoinPool.commonPool()-based OperationInitializer for nested parallel DataIndex building #5789

Merged
merged 1 commit into from
Jul 18, 2024

Conversation

rcaudy
Copy link
Member

@rcaudy rcaudy commented Jul 17, 2024

Introduce a very simple ForkJoinPool-based OperationInitializer, wrapping the common pool, and use that to ensure parallelism in MergedDataIndex and TransformedDataIndex deferred initialization.

Fixes #5736

…ping the common pool, and use that to ensure parallelism in MergedDataIndex deferred initialization.
@rcaudy rcaudy requested a review from abaranec July 17, 2024 19:48
@rcaudy rcaudy self-assigned this Jul 17, 2024
@rcaudy rcaudy added this to the 0.36.0 milestone Jul 17, 2024
@rcaudy rcaudy changed the title feat: Add ForkJoinPool.commonPool()-based OperationInitializer for nested parallel DataIndex building perf: Add ForkJoinPool.commonPool()-based OperationInitializer for nested parallel DataIndex building Jul 17, 2024
@abaranec abaranec merged commit d9d1b71 into deephaven:main Jul 18, 2024
26 of 28 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Jul 18, 2024
@rcaudy rcaudy deleted the rwc-fjp branch July 18, 2024 18:30
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow DataIndex deferred materialization to parallelize when nested inside a parallel operation
2 participants