Support for Delim Join/Get Relations #91
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR introduces support for generating and consuming query plans with flattening subquery operators (i.e., delim joins and gets). It also now supports full TPC-H roundtrip through DuckDB.
It's important to note that this is still highly experimental and depends on
algebra.proto
file. feat: add operators to support duplicate eliminated joins substrait-io/substrait#695Regarding the substrait changes, we need to add a
JOIN_TYPE_MARK
to theJoinRel
and add two new relations.DelimGetRel
andDelimJoinRel
.DelimGetRel
mainly has to store the types of delim columns.e.g.,
On the other hand,
DelimJoinRel
basically has the same attributes as aJoinRel
. The difference is that it adds theduplicate_eliminated_columns
and an optimization if the delim is flipped or not.e.g.,
Besides all that, it was also necessary to two join types. Namely
JOIN_TYPE_RIGHT_SEMI
andJOIN_TYPE_RIGHT_ANTI
;cc @EpsilonPrime @ianmcook