diff options
author | Evan Yu <ehotou@gmail.com> | 2015-02-21 20:40:21 +0000 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2015-02-21 20:40:21 +0000 |
commit | 7683982faf920b8ac6cf46b79842450e7d46c5cc (patch) | |
tree | b14d7bffc1dd2e76f3a2bf3d41e7fad018a9c2b8 /streaming | |
parent | 7138816abe1060a1e967c4c77c72d5752586d557 (diff) | |
download | spark-7683982faf920b8ac6cf46b79842450e7d46c5cc.tar.gz spark-7683982faf920b8ac6cf46b79842450e7d46c5cc.tar.bz2 spark-7683982faf920b8ac6cf46b79842450e7d46c5cc.zip |
[SPARK-5860][CORE] JdbcRDD: overflow on large range with high number of partitions
Fix a overflow bug in JdbcRDD when calculating partitions for large BIGINT ids
Author: Evan Yu <ehotou@gmail.com>
Closes #4701 from hotou/SPARK-5860 and squashes the following commits:
9e038d1 [Evan Yu] [SPARK-5860][CORE] Prevent overflowing at the length level
7883ad9 [Evan Yu] [SPARK-5860][CORE] Prevent overflowing at the length level
c88755a [Evan Yu] [SPARK-5860][CORE] switch to BigInt instead of BigDecimal
4e9ff4f [Evan Yu] [SPARK-5860][CORE] JdbcRDD overflow on large range with high number of partitions
Diffstat (limited to 'streaming')
0 files changed, 0 insertions, 0 deletions