diff options
author | Cheng Lian <lian@databricks.com> | 2016-05-26 16:23:48 -0700 |
---|---|---|
committer | Cheng Lian <lian@databricks.com> | 2016-05-26 16:23:48 -0700 |
commit | e7082caeb4a53c1ee172d136894eece1ac880f65 (patch) | |
tree | 0e72422a3b1df5e4c26595984ee2af78df2204df /mllib/src/main/scala | |
parent | fe6de16f781ff659b34e0ddda427d371d3d94536 (diff) | |
download | spark-e7082caeb4a53c1ee172d136894eece1ac880f65.tar.gz spark-e7082caeb4a53c1ee172d136894eece1ac880f65.tar.bz2 spark-e7082caeb4a53c1ee172d136894eece1ac880f65.zip |
[SPARK-15550][SQL] Dataset.show() should show contents nested products as rows
## What changes were proposed in this pull request?
This PR addresses two related issues:
1. `Dataset.showString()` should show case classes/Java beans at all levels as rows, while master code only handles top level ones.
2. `Dataset.showString()` should show full contents produced the underlying query plan
Dataset is only a view of the underlying query plan. Columns not referred by the encoder are still reachable using methods like `Dataset.col`. So it probably makes more sense to show full contents of the query plan.
## How was this patch tested?
Two new test cases are added in `DatasetSuite` to check `.showString()` output.
Author: Cheng Lian <lian@databricks.com>
Closes #13331 from liancheng/spark-15550-ds-show.
Diffstat (limited to 'mllib/src/main/scala')
0 files changed, 0 insertions, 0 deletions