Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow users to configure partitioning for pipe APIs #1863

Closed
3 tasks
fnothaft opened this issue Jan 5, 2018 · 2 comments
Closed
3 tasks

Allow users to configure partitioning for pipe APIs #1863

fnothaft opened this issue Jan 5, 2018 · 2 comments
Assignees
Milestone

Comments

@fnothaft
Copy link
Member

fnothaft commented Jan 5, 2018

I'd like users to be able to configure the partitioning for piped commands. Specifically, I'd like to be able to choose between a few strategies, such as:

  • Default (our current strategy, where we partition by contiguous genomic region)
  • Partition by target (allows users to provide a second GenomicRDD, and does something like a regionJoinAndGroupByLeft using the second RDD) --> This would be useful for things like calling variants on an exome panel
  • Skip partitioning (what happens if no sequence dictionary is attached)

Thoughts/comments?

@fnothaft fnothaft added this to the 0.24.0 milestone Jan 5, 2018
@fnothaft fnothaft self-assigned this Jan 5, 2018
@heuermh
Copy link
Member

heuermh commented Feb 14, 2018

From what I see, #1758 fits into this use case.

@fnothaft fnothaft modified the milestones: 0.24.0, 0.25.0 Mar 1, 2018
@heuermh heuermh modified the milestones: 0.26.0, 1.0.0 Jan 14, 2019
@heuermh heuermh modified the milestones: 1.0.0, 0.37.0 Aug 23, 2021
@heuermh
Copy link
Member

heuermh commented Aug 23, 2021

Closing as WontFix

@heuermh heuermh closed this as completed Aug 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants