[feature](nereids) Support dereference expression #57532
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
Contributor
Author
|
run buildall |
1 similar comment
Contributor
Author
|
run buildall |
ClickBench: Total hot run time: 29.12 s |
Contributor
FE Regression Coverage ReportIncrement line coverage |
924060929
force-pushed
the
dereference
branch
from
bd87a8d to
c277f2f
Compare
924060929
changed the title
Contributor
Author
|
run buildall |
924060929
changed the title
Contributor
Author
|
run buildall |
ClickBench: Total hot run time: 27.68 s |
Contributor
FE Regression Coverage ReportIncrement line coverage |
2 similar comments
Contributor
FE Regression Coverage ReportIncrement line coverage |
Contributor
FE Regression Coverage ReportIncrement line coverage |
starocean999
reviewed
Nov 3, 2025
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
Show resolved
Hide resolved
morrySnow
reviewed
Nov 3, 2025
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
Outdated
Show resolved
Hide resolved
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/ExpressionAnalyzer.java
Outdated
Show resolved
Hide resolved
924060929
force-pushed
the
dereference
branch
from
6d90687 to
7aea61e
Compare
Contributor
Author
|
run buildall |
TPC-H: Total hot run time: 34057 ms |
TPC-DS: Total hot run time: 181500 ms |
ClickBench: Total hot run time: 27.33 s |
Contributor
FE Regression Coverage ReportIncrement line coverage |
morrySnow
approved these changes
Nov 28, 2025
github-actions
bot
added
the
approved
Contributor
|
PR approved by at least one committer and no changes requested. |
starocean999
approved these changes
Nov 28, 2025
Contributor
|
PR approved by anyone and no changes requested. |
Contributor
FE Regression Coverage ReportIncrement line coverage |
Contributor
FE Regression Coverage ReportIncrement line coverage |
924060929
added a commit
to 924060929/incubator-doris
that referenced
this pull request
Dec 1, 2025
Support dereference expression for map/struct/variant
```sql
MySQL root@127.0.0.1:rqg> select
-> named_struct('c', named_struct('c', 100)).c.c,
-> map('a', 10, 'b', 20).a,
-> map('a', 10, 'b', 20).b,
-> cast('{"a":{"b":300}}' as variant).a.b;
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
| named_struct('c', named_struct('c', 100)).c.c | map('a', 10, 'b', 20).a | map('a', 10, 'b', 20).b | cast('{"a":{"b":300}}' as variant).a.b |
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
| 100 | 10 | 20 | 300 |
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
```
<b>the slot name parts binding priority:</b>
1. try to bind catalog, if binding failed, jump to 2
2. try to bind database, if binding failed, jump to 3
3. try to bind table, if binding failed, jump to 4
4. try to bind column
for example, `a.a.a.a.a`
first try to bind: catalog=a, database=a, table=a, column=a, sub
fields=a
second try to bind: catalog=<current catalog>, database=a,
table=a, column=a, sub fields=a.a
third try to bind: catalog=<current catalog>, database=<current
database>, table=a, column=a, sub fields=a.a.a
4th try to bind: catalog=<current catalog>, database=<current
database>, table=<underscore table>, column=a, sub
fields=a.a.a.a
(cherry picked from commit ac92fd4)
924060929
added a commit
to 924060929/incubator-doris
that referenced
this pull request
Dec 1, 2025
Support dereference expression for map/struct/variant
```sql
MySQL root@127.0.0.1:rqg> select
-> named_struct('c', named_struct('c', 100)).c.c,
-> map('a', 10, 'b', 20).a,
-> map('a', 10, 'b', 20).b,
-> cast('{"a":{"b":300}}' as variant).a.b;
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
| named_struct('c', named_struct('c', 100)).c.c | map('a', 10, 'b', 20).a | map('a', 10, 'b', 20).b | cast('{"a":{"b":300}}' as variant).a.b |
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
| 100 | 10 | 20 | 300 |
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
```
<b>the slot name parts binding priority:</b>
1. try to bind catalog, if binding failed, jump to 2
2. try to bind database, if binding failed, jump to 3
3. try to bind table, if binding failed, jump to 4
4. try to bind column
for example, `a.a.a.a.a`
first try to bind: catalog=a, database=a, table=a, column=a, sub
fields=a
second try to bind: catalog=<current catalog>, database=a,
table=a, column=a, sub fields=a.a
third try to bind: catalog=<current catalog>, database=<current
database>, table=a, column=a, sub fields=a.a.a
4th try to bind: catalog=<current catalog>, database=<current
database>, table=<underscore table>, column=a, sub
fields=a.a.a.a
(cherry picked from commit ac92fd4)
morrySnow
pushed a commit
that referenced
this pull request
Dec 1, 2025
yiguolei
pushed a commit
that referenced
this pull request
Dec 2, 2025
16 tasks
924060929
added a commit
that referenced
this pull request
Dec 3, 2025
fix can not prune dereference expression, introduced by #57532
nagisa-kunhah
pushed a commit
to nagisa-kunhah/doris
that referenced
this pull request
Dec 14, 2025
Support dereference expression for map/struct/variant
```sql
MySQL root@127.0.0.1:rqg> select
-> named_struct('c', named_struct('c', 100)).c.c,
-> map('a', 10, 'b', 20).a,
-> map('a', 10, 'b', 20).b,
-> cast('{"a":{"b":300}}' as variant).a.b;
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
| named_struct('c', named_struct('c', 100)).c.c | map('a', 10, 'b', 20).a | map('a', 10, 'b', 20).b | cast('{"a":{"b":300}}' as variant).a.b |
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
| 100 | 10 | 20 | 300 |
+-----------------------------------------------+-------------------------+-------------------------+----------------------------------------+
```
<b>the slot name parts binding priority:</b>
1. try to bind catalog, if binding failed, jump to 2
2. try to bind database, if binding failed, jump to 3
3. try to bind table, if binding failed, jump to 4
4. try to bind column
for example, `a.a.a.a.a`
first try to bind: catalog=a, database=a, table=a, column=a, sub
fields=a
second try to bind: catalog=<current catalog>, database=a,
table=a, column=a, sub fields=a.a
third try to bind: catalog=<current catalog>, database=<current
database>, table=a, column=a, sub fields=a.a.a
4th try to bind: catalog=<current catalog>, database=<current
database>, table=<underscore table>, column=a, sub
fields=a.a.a.a
nagisa-kunhah
pushed a commit
to nagisa-kunhah/doris
that referenced
this pull request
Dec 14, 2025
fix can not prune dereference expression, introduced by apache#57532
924060929
added a commit
that referenced
this pull request
Dec 23, 2025
924060929
added a commit
that referenced
this pull request
Dec 23, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Support dereference expression for map/struct/variant
the slot name parts binding priority:
for example,
a.a.a.a.afirst try to bind: catalog=a, database=a, table=a, column=a, sub fields=a
second try to bind: catalog=<current catalog>, database=a, table=a, column=a, sub fields=a.a
third try to bind: catalog=<current catalog>, database=<current database>, table=a, column=a, sub fields=a.a.a
4th try to bind: catalog=<current catalog>, database=<current database>, table=<underscore table>, column=a, sub fields=a.a.a.a
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)