-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Minor: Update quarterly_roadmap.md #8044
Conversation
- Improve data output (`COPY`, `INSERT` and DataFrame) output capability [#6569](https://github.com/apache/arrow-datafusion/issues/6569) | ||
- Implementation of `ARRAY` types and related functions [#6980](https://github.com/apache/arrow-datafusion/issues/6980) | ||
- Write an industrial paper about DataFusion for SIGMOD [#6782](https://github.com/apache/arrow-datafusion/issues/6782) | ||
- Faster Merging with Parallel Cascaded Merge: [#7181](https://github.com/apache/arrow-datafusion/issues/7181) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
FYI @wiedld
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are several potential non trivial changes underway that I think would benefit significantly from additional help - both design feedback, as well as code review, and assistance communicating, etc.
I would really love to help them all but I am running out of time, and I want to be as clear as possible that I am unlikely to be able to help with all of this.
My ask for other maintainers to offer to help guide contributors through some of the following efforts, ideally focused on areas that are aligned with their interests
|
||
- Improved planning speed, especially for schemas with large numbers of columns [#5637](https://github.com/apache/arrow-datafusion/issues/5637) / [#7698](https://github.com/apache/arrow-datafusion/issues/7698) | ||
- Make it easier to customize DataFusion, with split out function packages, etc. - [#7977](https://github.com/apache/arrow-datafusion/issues/7977) | ||
- User Defined Types [#7923](https://github.com/apache/arrow-datafusion/issues/7923) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fyi @yukkit
- Improved planning speed, especially for schemas with large numbers of columns [#5637](https://github.com/apache/arrow-datafusion/issues/5637) / [#7698](https://github.com/apache/arrow-datafusion/issues/7698) | ||
- Make it easier to customize DataFusion, with split out function packages, etc. - [#7977](https://github.com/apache/arrow-datafusion/issues/7977) | ||
- User Defined Types [#7923](https://github.com/apache/arrow-datafusion/issues/7923) | ||
- ORC Support [#4707](https://github.com/apache/arrow-datafusion/issues/4707) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The following work items are still in the planning / proposal stage. | ||
|
||
- Improved planning speed, especially for schemas with large numbers of columns [#5637](https://github.com/apache/arrow-datafusion/issues/5637) / [#7698](https://github.com/apache/arrow-datafusion/issues/7698) | ||
- Make it easier to customize DataFusion, with split out function packages, etc. - [#7977](https://github.com/apache/arrow-datafusion/issues/7977) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fyi @2010YOUY01
This seems not to have garnered much attention, so let's just shut it down |
Which issue does this PR close?
N/A
Rationale for this change
In general I think it would be good for us to communicate more broadly what we are working on, for at least two reasons:
I would love additional ideas about how to do this -- maybe weekly summaries of "this week in DataFusion" 🤔 Any takers for doing so?
What changes are included in this PR?
Update quarterly roadmap. See rendered version here: https://github.com/apache/arrow-datafusion/blob/alamb-patch-1/docs/source/contributor-guide/quarterly_roadmap.md
Are these changes tested?
Are there any user-facing changes?