feat(optimizer): Implement ProjectJoin rule

[jon-chuang]

I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.

What's changed and what's your intention?

Merge projects into joins's output indices where project's expressions are all InputRefs

Checklist

• I have written necessary rustdoc comments
• I have added necessary unit tests and integration tests
• All checks passed in ./risedev check (or alias, ./risedev c)

Refer to a related PR or issue link (optional)

[codecov]

Codecov Report

Merging #4385 (a10b86a) into main (072b6e0) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #4385   +/-   ##
=======================================
  Coverage   74.48%   74.48%           
=======================================
  Files         846      846           
  Lines      123826   123832    +6     
=======================================
+ Hits        92226    92239   +13     
+ Misses      31600    31593    -7     

Flag	Coverage Δ
rust	74.48% <100.00%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...frontend/src/optimizer/plan_node/logical_expand.rs	94.67% <ø> (-0.04%)	⬇️
...c/frontend/src/optimizer/plan_node/logical_join.rs	90.55% <ø> (+0.02%)	⬆️
src/frontend/src/optimizer/mod.rs	91.16% <100.00%> (+0.08%)	⬆️
src/frontend/src/optimizer/rule/project_join.rs	100.00% <100.00%> (+100.00%)	⬆️
src/meta/src/manager/id.rs	95.10% <0.00%> (+0.54%)	⬆️

📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

[chenzl25]

IIRC, physical optimization likes toBatch or toStream always create project for LogicalJoin with a non-trivial output_indices. Can we benefit from this rule?

[st1page]

IIRC, physical optimization likes toBatch or toStream always create project for LogicalJoin with a non-trivial output_indices. Can we benefit from this rule?

IIRC, we have support output_indices in executor, what the non-trivial means

[chenzl25]

In this case trivial means identity.

[chenzl25]

In this case trivial means identity.

Oh, I just only focus on the pull_filter part which always create a project. No question Now.

[xxchan]

related issue #1922

Will we also need to similarly merge simple project into output indices of other nodes? 🤔

[jon-chuang]

Will we also need to similarly merge simple project into output indices of other nodes?

Possibly. One of these is scan. I'm not sure if its necessary to do this as it may already be facilitated by prune_cols?

Anw, we can open an issue on this.