-
Notifications
You must be signed in to change notification settings - Fork 434
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[GLUTEN-3854][CORE][FOLLOWUP] Add ColumnarInputAdapter back to recover UI graph #3933
Conversation
Run Gluten Clickhouse CI |
cc @zhztheplayer thank you |
// This is not strictly needed because the codegen transformation happens after the columnar | ||
// transformation but just for consistency | ||
override def supportsColumnar: Boolean = child.supportsColumnar | ||
|
||
// this is the most important effect of this class | ||
override def supportCodegen: Boolean = false | ||
|
||
override def doExecuteColumnar(): RDD[ColumnarBatch] = { | ||
child.executeColumnar() | ||
} | ||
|
||
override def nodeName: String = s"InputAdapter" | ||
|
||
override def generateTreeString( | ||
depth: Int, | ||
lastChildren: Seq[Boolean], | ||
append: String => Unit, | ||
verbose: Boolean, | ||
prefix: String = "", | ||
addSuffix: Boolean = false, | ||
maxFields: Int, | ||
printNodeId: Boolean, | ||
indent: Int = 0): Unit = { | ||
child.generateTreeString( | ||
depth, | ||
lastChildren, | ||
append, | ||
verbose, | ||
prefix = "", | ||
addSuffix = false, | ||
maxFields, | ||
printNodeId, | ||
indent) | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It seems that we only need to override #supportCodegen
? Can we remove others to simply code? Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
sure, addressed
Run Gluten Clickhouse CI |
b3d995f
to
d6d6eb5
Compare
Run Gluten Clickhouse CI |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the fix!
===== Performance report for TPCH SF2000 with Velox backend, for reference only ====
|
What changes were proposed in this pull request?
This pr is followup fix of #3854. We can not remove
ColumnarInputAdapter
, otherwise the UI graph would be broken.How was this patch tested?
before:
after: