Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-128]Support Decimal in Aggregate/HashJoin #129

Merged
merged 7 commits into from
Mar 9, 2021

Conversation

xuechendi
Copy link
Collaborator

@xuechendi xuechendi commented Feb 25, 2021

Passed TPCDS and TPCH test on decimal non-partition sf500

Q54 and Q58 still saw failure

Fixed: #128

@github-actions
Copy link

#128

@xuechendi xuechendi force-pushed the wip_decimal_aggr branch 4 times, most recently from e17e9a1 to 99e56aa Compare March 4, 2021 02:42
@github-actions
Copy link

github-actions bot commented Mar 4, 2021


@github-actions
Copy link

github-actions bot commented Mar 4, 2021


@github-actions
Copy link

github-actions bot commented Mar 5, 2021


@github-actions
Copy link

github-actions bot commented Mar 5, 2021


rui-mo and others added 3 commits March 5, 2021 13:45
1. scala hashaggregate remove skip decimal check
2. support unscaledValue
3. support decimal aggregate

Signed-off-by: Chendi Xue <chendi.xue@intel.com>
1. Fix HashJoin with decimal as payload issues
  1. add decimal support to arrayappender
  2. add castStringFromDecimal, castIntegerFromDecimal and castFloatFromDecimal
  3. fix castDECIMAL
2. Support Decimal as HashJoin key
3. Support Decimal in BHJ
4. Remove ColumnarExpand decimal check
5. Support MakeDecimal
6. Remove not_in_use codegened ShuffledHashJoin codes and hard config to only do hashcheck HashJoin

Signed-off-by: Chendi Xue <chendi.xue@intel.com>
@xuechendi
Copy link
Collaborator Author

@zhouyuan , rebased

@xuechendi xuechendi changed the title [NSE-128][DNM]Support Decimal in Aggregate [NSE-128]Support Decimal in Aggregate Mar 5, 2021
@github-actions
Copy link

github-actions bot commented Mar 5, 2021


@zhouyuan
Copy link
Collaborator

zhouyuan commented Mar 5, 2021

note sure if this relates

The following tests FAILED:
	 10 - TestArrowComputeJoin.JoinTestUsingInnerJoin (SEGFAULT)
	 11 - TestArrowComputeJoin.JoinTestWithTwoKeysUsingInnerJoin (SEGFAULT)
	 12 - TestArrowComputeJoin.JoinTestUsingOuterJoin (SEGFAULT)
	 13 - TestArrowComputeJoin.JoinTestUsingAntiJoin (SEGFAULT)
	 14 - TestArrowComputeJoin.JoinTestUsingInnerJoinWithCondition (SEGFAULT)
	 15 - TestArrowComputeJoin.JoinTestUsingAntiJoinWithCondition (SEGFAULT)
	 16 - TestArrowComputeJoin.JoinTestUsingExistenceJoin (SEGFAULT)
	 17 - TestArrowComputeJoin.JoinTestUsingInnerJoinWithProjectedCondition (SEGFAULT)
Error: Process completed with exit code 8.

@xuechendi
Copy link
Collaborator Author

@zhouyuan , thanks
I forgot to remove unit tests, I have removed original codegened hashjoin codes since now we only use with out codegen Join and join inside codegen.

@github-actions
Copy link

github-actions bot commented Mar 5, 2021


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
@zhouyuan zhouyuan changed the title [NSE-128]Support Decimal in Aggregate [NSE-128]Support Decimal in Aggregate/HashJoin Mar 8, 2021
…loat

Signed-off-by: Chendi Xue <chendi.xue@intel.com>
@zhouyuan
Copy link
Collaborator

zhouyuan commented Mar 8, 2021

Can you cherry pick this commit? it's a small commit to fix the CI issue
zhouyuan@6ea418a

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
@xuechendi
Copy link
Collaborator Author

@zhouyuan , sorry, I just noticed your email, cherry-picked your commit zhouyuan/native-sql-engine@6ea418a here

@github-actions
Copy link

github-actions bot commented Mar 9, 2021


@zhouyuan zhouyuan merged commit 8860d2a into oap-project:master Mar 9, 2021
@zhouyuan
Copy link
Collaborator

zhouyuan commented Mar 9, 2021

Note: merge this first as several PR are pending on the general framework. TPC-DS results are not correct and will be fixed in later patches

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support Decimal in Aggregate
3 participants