-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
GH-41272: [Java] LargeListViewVector Implementation #43516
Conversation
java/vector/src/main/java/org/apache/arrow/vector/TypeLayout.java
Outdated
Show resolved
Hide resolved
java/vector/src/main/java/org/apache/arrow/vector/complex/LargeListViewVector.java
Outdated
Show resolved
Hide resolved
java/vector/src/main/java/org/apache/arrow/vector/complex/LargeListViewVector.java
Outdated
Show resolved
Hide resolved
java/vector/src/main/java/org/apache/arrow/vector/complex/LargeListViewVector.java
Outdated
Show resolved
Hide resolved
@lidavidm Ready for another round of reviews. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work, @vibhatha ! I took a first pass at the PR.
@@ -53,6 +53,7 @@ private static void writeValue(FieldReader reader, FieldWriter writer) { | |||
case LIST: | |||
case LISTVIEW: | |||
case LARGELIST: | |||
case LARGELISTVIEW: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ListView is also referenced on lines 163, 187, 210. Do we need to add LargeListView there, too?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Right, good point. Arrow Java legacy implementation doesn't seem to support 64-bit cases.The places where I dropped it are similar in that regard. But in case I have really missed, please correct me 😌
this.parentContainer = null; | ||
this.listVector = null; | ||
this.listViewVector = null; | ||
this.largeListVector = null; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ListView is also referenced on lines 279, 344, 389, 575. Do we need to add LargeListView, too?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same as the above point.
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit b33f040. There were no benchmark performance regressions. 🎉 The full Conbench report has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them. |
Rationale for this change
This PR includes the initial integration of
LargeListViewVector
.What changes are included in this PR?
This PR includes the core functions associated with the
LargeListViewVector
.Are these changes tested?
Yes.
Are there any user-facing changes?
No
LargeListViewVector
Implementation #41272