diff options
| author | Davies Liu <davies@databricks.com> | 2016-02-02 11:50:14 -0800 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-02-02 11:50:14 -0800 |
| commit | be5dd881f1eff248224a92d57cfd1309cb3acf38 (patch) | |
| tree | 7fdf890c80dc6a7e63028b0829f1020ca0c65a54 /sql/hive/compatibility/src/test/scala | |
| parent | 7f6e3ec79b77400f558ceffa10b2af011962115f (diff) | |
| download | spark-be5dd881f1eff248224a92d57cfd1309cb3acf38.tar.gz spark-be5dd881f1eff248224a92d57cfd1309cb3acf38.tar.bz2 spark-be5dd881f1eff248224a92d57cfd1309cb3acf38.zip | |
[SPARK-12913] [SQL] Improve performance of stat functions
As benchmarked and discussed here: https://github.com/apache/spark/pull/10786/files#r50038294, benefits from codegen, the declarative aggregate function could be much faster than imperative one.
Author: Davies Liu <davies@databricks.com>
Closes #10960 from davies/stddev.
Diffstat (limited to 'sql/hive/compatibility/src/test/scala')
| -rw-r--r-- | sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala index 554d47d651..61b73fa557 100644 --- a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala +++ b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala @@ -325,6 +325,9 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { "drop_partitions_ignore_protection", "protectmode", + // Hive returns null rather than NaN when n = 1 + "udaf_covar_samp", + // Spark parser treats numerical literals differently: it creates decimals instead of doubles. "udf_abs", "udf_format_number", @@ -881,7 +884,6 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { "type_widening", "udaf_collect_set", "udaf_covar_pop", - "udaf_covar_samp", "udaf_histogram_numeric", "udf2", "udf5", |