Skip to content

Conversation

@vinaykpud
Copy link
Owner

Description

[Describe what this change achieves]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • New functionality has javadoc added.
  • New functionality has a user manual doc added.
  • New PPL command checklist all confirmed.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff or -s.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
@vinaykpud vinaykpud merged commit 7c2e4fb into feature/substrait-plan Dec 24, 2025
7 of 55 checks passed
abhita added a commit to abhita/sql that referenced this pull request Jan 5, 2026
Merge pull request vinaykpud#29 from expani/feature/substrait-plan

Adding agg_for_doc_count even if distinct count is present in query
Adding agg_for_doc_count even if distinct count is present in query

Signed-off-by: expani <anijainc@amazon.com>

Merge pull request vinaykpud#28 from expani/df_lucene_path_sql

Skip generating and setting the Substrait plan based on Index Setting
Updated to test to use new index setting

Signed-off-by: expani <anijainc@amazon.com>

Using Optimized index setting to not generate substrait for existing path

Signed-off-by: expani <anijainc@amazon.com>

Resolved Sort Pushdown and updated integration tests queries and results (vinaykpud#27)

* Added sort in pushdown context

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Removed unwanted sort pushdown in pushDownSortAggregateMeasure

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Accessed the fullReNodeTree in CalciteEnumerableIndexScan removed the redundancy in OpenSearchRequest

Also i did this since earlier way of accessing RelNode from ThreadLocal from OpenSearchRequest class
is not working as it looks like the thread which sets the variable and accesses it now are different

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Updated some integ test queries and results

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

---------

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Added substrait type conversion support for IP field (vinaykpud#26)

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Use Full RelNode tree for execution

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

Fixed the sort condition for queries with multiple aggregation (vinaykpud#24)

without this change if we have a PPL query with multiple aggregations
and sort condition, it will sort only based on the first aggregated field.
Also found similar changes done in latest mainline:
https://tinyurl.com/u32kpyk9

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Added sort after aggregarte relNode for pushdown context (vinaykpud#23)

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Added logs for reconstructPushedDownRelNodeTree (vinaykpud#22)

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Added min function for string field and fixed query 29 in tests (vinaykpud#20)

* Added min function for string field

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Fixed the query 29 PPL

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

---------

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
All changes related to convert only pushed down operations as RelNodeTree and Substrait (vinaykpud#19)

* Changes to convert only pushed down operations RelNode and Substrait

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Adding the missing Project operator after the filter

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Small refactors in PushDownContext and logs

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Added full relNode log

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Removed unwanted comments

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Use Direct RelNode.copy() Instead of RelBuilder

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

* Disabled CoreRules.FILTER_REDUCE_EXPRESSIONS

this is done to disable the calcite optimization on timerange queries
ie calcite optimizes `>=($0, TIMESTAMP('2013-07-01 00:00:00')) AND <=($0, TIMESTAMP('2013-07-31 00:00:00'))`
to `SEARCH($0, Sarg[['2013-07-01 00:00:00'..'2013-07-31 00:00:00']])`

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>

---------

Signed-off-by: Vinay Krishna Pudyodu <vinkrish.neo@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants