diff options
| author | Cheng Lian <lian.cs.zju@gmail.com> | 2014-08-29 15:36:04 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-08-29 15:36:19 -0700 |
| commit | 9bae345ab543b686e8b32e504711140950d9ea68 (patch) | |
| tree | dbfc8d65cadc4784f9824ecf33556016656a68d1 /tools | |
| parent | cf049efdc7caeb2577a88f5fa3e7f1b665635451 (diff) | |
| download | spark-9bae345ab543b686e8b32e504711140950d9ea68.tar.gz spark-9bae345ab543b686e8b32e504711140950d9ea68.tar.bz2 spark-9bae345ab543b686e8b32e504711140950d9ea68.zip | |
[SPARK-3269][SQL] Decreases initial buffer size for row set to prevent OOM
When a large batch size is specified, `SparkSQLOperationManager` OOMs even if the whole result set is much smaller than the batch size.
Author: Cheng Lian <lian.cs.zju@gmail.com>
Closes #2171 from liancheng/jdbc-fetch-size and squashes the following commits:
5e1623b [Cheng Lian] Decreases initial buffer size for row set to prevent OOM
(cherry picked from commit d94a44d7caaf3fe7559d9ad7b10872fa16cf81ca)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'tools')
0 files changed, 0 insertions, 0 deletions