diff options
author | Shixiong Zhu <shixiong@databricks.com> | 2016-06-17 21:58:10 -0700 |
---|---|---|
committer | Shixiong Zhu <shixiong@databricks.com> | 2016-06-17 21:58:10 -0700 |
commit | d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e (patch) | |
tree | ebbde41dbc5f86479f4eb54e4578ad26ca01483a /launcher/src | |
parent | 8c198e246d64b5779dc3a2625d06ec958553a20b (diff) | |
download | spark-d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e.tar.gz spark-d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e.tar.bz2 spark-d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e.zip |
[SPARK-16020][SQL] Fix complete mode aggregation with console sink
## What changes were proposed in this pull request?
We cannot use `limit` on DataFrame in ConsoleSink because it will use a wrong planner. This PR just collects `DataFrame` and calls `show` on a batch DataFrame based on the result. This is fine since ConsoleSink is only for debugging.
## How was this patch tested?
Manually confirmed ConsoleSink now works with complete mode aggregation.
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #13740 from zsxwing/complete-console.
Diffstat (limited to 'launcher/src')
0 files changed, 0 insertions, 0 deletions