diff options
| author | Rene Treffer <treffer@measite.de> | 2015-06-13 11:58:22 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-06-13 11:58:22 -0700 |
| commit | d986fb9a378416248768828e6e6c7405697f9a5a (patch) | |
| tree | c18fecc4a66c828fe7b6f2d358800707d0bdb492 /sql | |
| parent | 4aed66f299a67f5a594da9316b6bf4c345838216 (diff) | |
| download | spark-d986fb9a378416248768828e6e6c7405697f9a5a.tar.gz spark-d986fb9a378416248768828e6e6c7405697f9a5a.tar.bz2 spark-d986fb9a378416248768828e6e6c7405697f9a5a.zip | |
[SPARK-7897] Improbe type for jdbc/"unsigned bigint"
The original fix uses DecimalType.Unlimited, which is harder to
handle afterwards. There is no scale and most data should fit into
a long, thus DecimalType(20,0) should be better.
Author: Rene Treffer <treffer@measite.de>
Closes #6789 from rtreffer/spark-7897-unsigned-bigint-as-decimal and squashes the following commits:
2006613 [Rene Treffer] Fix type for "unsigned bigint" jdbc loading.
Diffstat (limited to 'sql')
| -rw-r--r-- | sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala b/sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala index 667fc70cff..226b143923 100644 --- a/sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala +++ b/sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala @@ -55,7 +55,7 @@ private[sql] object JDBCRDD extends Logging { val answer = sqlType match { // scalastyle:off case java.sql.Types.ARRAY => null - case java.sql.Types.BIGINT => if (signed) { LongType } else { DecimalType.Unlimited } + case java.sql.Types.BIGINT => if (signed) { LongType } else { DecimalType(20,0) } case java.sql.Types.BINARY => BinaryType case java.sql.Types.BIT => BooleanType // @see JdbcDialect for quirks case java.sql.Types.BLOB => BinaryType |