Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

TPC-DS q47 failed on 576 shuffle partitons #475

Open
zhouyuan opened this issue Aug 16, 2021 · 0 comments
Open

TPC-DS q47 failed on 576 shuffle partitons #475

zhouyuan opened this issue Aug 16, 2021 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@zhouyuan
Copy link
Collaborator

Describe the bug

Job aborted due to stage failure: Task 330 in stage 1390.0 failed 4 times, most recent failure: Lost task 330.3 in stage 1390.0 (TID 446059) (vsr211 executor 8): java.lang.ArithmeticException: Decimal precision 21 exceeds max precision 17
	at org.apache.spark.sql.types.Decimal.set(Decimal.scala:122)
	at org.apache.spark.sql.types.Decimal$.apply(Decimal.scala:571)
	at org.apache.spark.sql.types.Decimal.apply(Decimal.scala)
	at com.intel.oap.vectorized.ArrowWritableColumnVector$DecimalAccessor.getDecimal(ArrowWritableColumnVector.java:1029)
	at com.intel.oap.vectorized.ArrowWritableColumnVector.getDecimal(ArrowWritableColumnVector.java:770)
	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source)
	at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
	at org.apache.spark.sql.execution.WholeStageCodegenExec$$anon$1.hasNext(WholeStageCodegenExec.scala:755)
	at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:458)
	at 

To Reproduce
run ok with 288 shuffle partitions, failed if run with 576 shuffle partitions

Expected behavior
Pass on all shuffle partitions

Additional context
N/A

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants