Apache Arrow for table cells #315
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
mbostock
force-pushed
the
mbostock/arrow
branch
from
366bfb0 to
0e51076
Compare
mbostock
changed the title
mbostock
force-pushed
the
mbostock/arrow
branch
from
0e51076 to
e118e4c
Compare
mbostock
force-pushed
the
mbostock/arrow
branch
from
e118e4c to
36f4ace
Compare
Merged
mbostock
commented
Nov 7, 2022
Comment on lines
+409
to
+414
| // This function applies table cell operations to an in-memory Apache Arrow | ||
| // table; it should be equivalent to the corresponding SQL query. | ||
| function __arrow(source, operations) { | ||
| operations; | ||
| return source; // TODO | ||
| } |
There was a problem hiding this comment.
With the Arrow DataFrame class and predicates removed in Apache Arrow 7.0.0 and later (apache/arrow#10371), I’m not really sure there’s a practical way to implement basic data transformations like filter and sort directly on Arrow Tables.
|
Mostly folded into #313, leaving only the need to implement __table for Apache Arrow tables… which I’m not sure how to do, so closing for now. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
TODO