diff options
| author | Davies Liu <davies@databricks.com> | 2016-03-11 15:39:21 -0800 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-03-11 15:39:21 -0800 |
| commit | 2ef4c5963bff3574fe17e669d703b25ddd064e5d (patch) | |
| tree | aa3eeb5eefec3d663bc6c994d4a9be41fd998223 /sql/core/src | |
| parent | 66d9d0edfef986895490bcdeacbc0ca38e091702 (diff) | |
| download | spark-2ef4c5963bff3574fe17e669d703b25ddd064e5d.tar.gz spark-2ef4c5963bff3574fe17e669d703b25ddd064e5d.tar.bz2 spark-2ef4c5963bff3574fe17e669d703b25ddd064e5d.zip | |
[SPARK-13830] prefer block manager than direct result for large result
## What changes were proposed in this pull request?
The current RPC can't handle large blocks very well, it's very slow to fetch 100M block (about 1 minute). Once switch to block manager to fetch that, it took about 10 seconds (still could be improved).
## How was this patch tested?
existing unit tests.
Author: Davies Liu <davies@databricks.com>
Closes #11659 from davies/direct_result.
Diffstat (limited to 'sql/core/src')
0 files changed, 0 insertions, 0 deletions