diff options
| author | Shixiong Zhu <shixiong@databricks.com> | 2016-06-17 21:58:10 -0700 |
|---|---|---|
| committer | Shixiong Zhu <shixiong@databricks.com> | 2016-06-17 21:58:10 -0700 |
| commit | d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e (patch) | |
| tree | ebbde41dbc5f86479f4eb54e4578ad26ca01483a /python | |
| parent | 8c198e246d64b5779dc3a2625d06ec958553a20b (diff) | |
| download | spark-d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e.tar.gz spark-d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e.tar.bz2 spark-d0ac0e6f433bfccf4ced3743a2526f67fdb5c38e.zip | |
[SPARK-16020][SQL] Fix complete mode aggregation with console sink
## What changes were proposed in this pull request?
We cannot use `limit` on DataFrame in ConsoleSink because it will use a wrong planner. This PR just collects `DataFrame` and calls `show` on a batch DataFrame based on the result. This is fine since ConsoleSink is only for debugging.
## How was this patch tested?
Manually confirmed ConsoleSink now works with complete mode aggregation.
Author: Shixiong Zhu <shixiong@databricks.com>
Closes #13740 from zsxwing/complete-console.
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions