Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-41272: [Java] LargeListViewVector Implementation #43516

Merged
merged 14 commits into from
Aug 9, 2024

Conversation

vibhatha
Copy link
Collaborator

@vibhatha vibhatha commented Aug 1, 2024

Rationale for this change

This PR includes the initial integration of LargeListViewVector.

What changes are included in this PR?

This PR includes the core functions associated with the LargeListViewVector.

Are these changes tested?

Yes.

Are there any user-facing changes?

No

@vibhatha vibhatha marked this pull request as ready for review August 6, 2024 01:03
@vibhatha vibhatha requested a review from lidavidm as a code owner August 6, 2024 01:03
@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting review Awaiting review labels Aug 6, 2024
@github-actions github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Aug 6, 2024
@vibhatha vibhatha requested a review from lidavidm August 6, 2024 08:05
@vibhatha
Copy link
Collaborator Author

vibhatha commented Aug 7, 2024

@lidavidm Ready for another round of reviews.

Copy link
Member

@danepitkin danepitkin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work, @vibhatha ! I took a first pass at the PR.

@@ -53,6 +53,7 @@ private static void writeValue(FieldReader reader, FieldWriter writer) {
case LIST:
case LISTVIEW:
case LARGELIST:
case LARGELISTVIEW:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ListView is also referenced on lines 163, 187, 210. Do we need to add LargeListView there, too?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Right, good point. Arrow Java legacy implementation doesn't seem to support 64-bit cases.The places where I dropped it are similar in that regard. But in case I have really missed, please correct me 😌

this.parentContainer = null;
this.listVector = null;
this.listViewVector = null;
this.largeListVector = null;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ListView is also referenced on lines 279, 344, 389, 575. Do we need to add LargeListView, too?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as the above point.

@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting change review Awaiting change review labels Aug 9, 2024
@lidavidm lidavidm merged commit b33f040 into apache:main Aug 9, 2024
15 checks passed
@lidavidm lidavidm removed the awaiting merge Awaiting merge label Aug 9, 2024
Copy link

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit b33f040.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants