Java pushdown filter

[noahfrn]

Conditional on #14287 - This adds an interface through JNI for strings to be passed, and then parsed into expressions to perform pushdown filtering via the datasets API.

[github-actions]

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

• Other pull requests
• Contribution Guidelines - How to contribute patches

[zinking]

@noahfournier could this be pushed forward ?

[noahfrn]

Hey @zinking, I think the future direction for filtering from Arrow Java will likely be provided via substrait. To work around this for now, you can take a look at: G-Research/datafusion-java to see if that unblocks you right away.

[zinking]

I think it's fine for now, there are plenty of serialization schemes for expressions.

[noahfrn]

What do you mean by serialization schemes for expressions ? Would be interested to know how you worked around this.

[zinking]

What do you mean by serialization schemes for expressions ? Would be interested to know how you worked around this.

you can see my workaround [here] (b1426b1) using json serializations.

subtrait might be the correct direction. but it's not progressing as expected.