diff options
| author | Daoyuan Wang <daoyuan.wang@intel.com> | 2015-02-02 15:49:22 -0800 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2015-02-02 15:49:22 -0800 |
| commit | 1646f89d967913ee1f231d9606f8502d13c25804 (patch) | |
| tree | 86e89b964e7cd8a596e54621544af0052abb1d83 /sql/hive/compatibility/src/test/scala | |
| parent | 830934976e8cf9e894bd3e5758fb941cad5d2f0b (diff) | |
| download | spark-1646f89d967913ee1f231d9606f8502d13c25804.tar.gz spark-1646f89d967913ee1f231d9606f8502d13c25804.tar.bz2 spark-1646f89d967913ee1f231d9606f8502d13c25804.zip | |
[SPARK-4508] [SQL] build native date type to conform behavior to Hive
Store daysSinceEpoch as an Int value(4 bytes) to represent DateType, instead of using java.sql.Date(8 bytes as Long) in catalyst row. This ensures the same comparison behavior of Hive and Catalyst.
Subsumes #3381
I thinks there are already some tests in JavaSQLSuite, and for python it will not affect python's datetime class.
Author: Daoyuan Wang <daoyuan.wang@intel.com>
Closes #3732 from adrian-wang/datenative and squashes the following commits:
0ed0fdc [Daoyuan Wang] fix test data
a2fdd4e [Daoyuan Wang] getDate
c37832b [Daoyuan Wang] row to catalyst
f0005b1 [Daoyuan Wang] add date in sql parser and java type conversion
024c9a6 [Daoyuan Wang] clean some import order
d6715fc [Daoyuan Wang] refactoring Date as Primitive Int internally
374abd5 [Daoyuan Wang] spark native date type support
Diffstat (limited to 'sql/hive/compatibility/src/test/scala')
| -rw-r--r-- | sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala index 0d934620ac..a6266f611c 100644 --- a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala +++ b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala @@ -357,6 +357,7 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { "database_drop", "database_location", "database_properties", + "date_1", "date_2", "date_3", "date_4", |