diff options
| author | Davies Liu <davies@databricks.com> | 2015-06-10 16:55:39 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-06-10 16:55:39 -0700 |
| commit | 37719e0cd0b00cc5ffee0ebe1652d465a574db0f (patch) | |
| tree | 326c8178ed25ef17135ed2978c6dbfaf9e7593e3 /sql/hive/compatibility | |
| parent | b928f543845ddd39e914a0e8f0b0205fd86100c5 (diff) | |
| download | spark-37719e0cd0b00cc5ffee0ebe1652d465a574db0f.tar.gz spark-37719e0cd0b00cc5ffee0ebe1652d465a574db0f.tar.bz2 spark-37719e0cd0b00cc5ffee0ebe1652d465a574db0f.zip | |
[SPARK-8189] [SQL] use Long for TimestampType in SQL
This PR change to use Long as internal type for TimestampType for efficiency, which means it will the precision below 100ns.
Author: Davies Liu <davies@databricks.com>
Closes #6733 from davies/timestamp and squashes the following commits:
d9565fa [Davies Liu] remove print
65cf2f1 [Davies Liu] fix Timestamp in SparkR
86fecfb [Davies Liu] disable two timestamp tests
8f77ee0 [Davies Liu] fix scala style
246ee74 [Davies Liu] address comments
309d2e1 [Davies Liu] use Long for TimestampType in SQL
Diffstat (limited to 'sql/hive/compatibility')
| -rw-r--r-- | sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala | 8 |
1 files changed, 5 insertions, 3 deletions
diff --git a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala index 0693c7ea5b..82c0b49459 100644 --- a/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala +++ b/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala @@ -252,7 +252,11 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { "load_dyn_part14.*", // These work alone but fail when run with other tests... // the answer is sensitive for jdk version - "udf_java_method" + "udf_java_method", + + // Spark SQL use Long for TimestampType, lose the precision under 100ns + "timestamp_1", + "timestamp_2" ) /** @@ -795,8 +799,6 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter { "stats_publisher_error_1", "subq2", "tablename_with_select", - "timestamp_1", - "timestamp_2", "timestamp_3", "timestamp_comparison", "timestamp_lazy", |