diff options
author | Tejas Patil <tejasp@fb.com> | 2017-02-24 09:46:42 -0800 |
---|---|---|
committer | Reynold Xin <rxin@databricks.com> | 2017-02-24 09:46:42 -0800 |
commit | 3e40f6c3d6fc0bcd828d09031fa3994925394889 (patch) | |
tree | e2ea90f5dfd743db6870917f5c5068ebae5f7880 /common | |
parent | a920a4369434c84274866a09f61e402232c3b47c (diff) | |
download | spark-3e40f6c3d6fc0bcd828d09031fa3994925394889.tar.gz spark-3e40f6c3d6fc0bcd828d09031fa3994925394889.tar.bz2 spark-3e40f6c3d6fc0bcd828d09031fa3994925394889.zip |
[SPARK-17495][SQL] Add more tests for hive hash
## What changes were proposed in this pull request?
This PR adds tests hive-hash by comparing the outputs generated against Hive 1.2.1. Following datatypes are covered by this PR:
- null
- boolean
- byte
- short
- int
- long
- float
- double
- string
- array
- map
- struct
Datatypes that I have _NOT_ covered but I will work on separately are:
- Decimal (handled separately in https://github.com/apache/spark/pull/17056)
- TimestampType
- DateType
- CalendarIntervalType
## How was this patch tested?
NA
Author: Tejas Patil <tejasp@fb.com>
Closes #17049 from tejasapatil/SPARK-17495_remaining_types.
Diffstat (limited to 'common')
-rw-r--r-- | common/unsafe/src/main/java/org/apache/spark/sql/catalyst/expressions/HiveHasher.java | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/common/unsafe/src/main/java/org/apache/spark/sql/catalyst/expressions/HiveHasher.java b/common/unsafe/src/main/java/org/apache/spark/sql/catalyst/expressions/HiveHasher.java index c7ea9085eb..73577437ac 100644 --- a/common/unsafe/src/main/java/org/apache/spark/sql/catalyst/expressions/HiveHasher.java +++ b/common/unsafe/src/main/java/org/apache/spark/sql/catalyst/expressions/HiveHasher.java @@ -20,7 +20,7 @@ package org.apache.spark.sql.catalyst.expressions; import org.apache.spark.unsafe.Platform; /** - * Simulates Hive's hashing function at + * Simulates Hive's hashing function from Hive v1.2.1 * org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils#hashcode() */ public class HiveHasher { |