Skip to content

Commit a4d34c5

Browse files
authored
Count distinct error message
Update count distinct error message for streaming datasets/dataframes to match current behavior. These aggregations are not yet supported.
1 parent 63036ae commit a4d34c5

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -103,9 +103,8 @@ object UnsupportedOperationChecker {
103103
}
104104
throwErrorIf(
105105
child.isStreaming && distinctAggExprs.nonEmpty,
106-
"Distinct aggregations are not supported on streaming DataFrames/Datasets, unless " +
107-
"it is on aggregated DataFrame/Dataset in Complete output mode. Consider using " +
108-
"approximate distinct aggregation (e.g. approx_count_distinct() instead of count()).")
106+
"Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider " +
107+
"using approx_count_distinct() instead.")
109108

110109
case _: Command =>
111110
throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " +

0 commit comments

Comments
 (0)