diff options
| author | jtoka <jason.tokayer@gmail.com> | 2017-04-12 11:36:08 +0100 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2017-04-12 11:36:08 +0100 |
| commit | 2e1fd46e12bf948490ece2caa73d227b6a924a14 (patch) | |
| tree | 90af8247ee9fd8015b7bf041203365914b12c06f /sql | |
| parent | ffc57b0118b58de57520967d8e8730b11baad507 (diff) | |
| download | spark-2e1fd46e12bf948490ece2caa73d227b6a924a14.tar.gz spark-2e1fd46e12bf948490ece2caa73d227b6a924a14.tar.bz2 spark-2e1fd46e12bf948490ece2caa73d227b6a924a14.zip | |
[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming
## What changes were proposed in this pull request?
Update count distinct error message for streaming datasets/dataframes to match current behavior. These aggregations are not yet supported, regardless of whether the dataset/dataframe is aggregated.
Author: jtoka <jason.tokayer@gmail.com>
Closes #17609 from jtoka/master.
Diffstat (limited to 'sql')
| -rw-r--r-- | sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala | 5 |
1 files changed, 2 insertions, 3 deletions
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala index 7da7f55aa5..3f76f26dbe 100644 --- a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala +++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala @@ -139,9 +139,8 @@ object UnsupportedOperationChecker { } throwErrorIf( child.isStreaming && distinctAggExprs.nonEmpty, - "Distinct aggregations are not supported on streaming DataFrames/Datasets, unless " + - "it is on aggregated DataFrame/Dataset in Complete output mode. Consider using " + - "approximate distinct aggregation (e.g. approx_count_distinct() instead of count()).") + "Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider " + + "using approx_count_distinct() instead.") case _: Command => throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " + |