aboutsummaryrefslogtreecommitdiff
path: root/python
diff options
context:
space:
mode:
authorSean Zhong <clockfly@gmail.com>2016-05-10 21:50:53 -0700
committerReynold Xin <rxin@databricks.com>2016-05-10 21:50:53 -0700
commit61e0bdcff2ed57b22541fb3c03146d6eec2bb70f (patch)
tree621f9ab55934b3efbaaf579118f47273cc3d9500 /python
parentd9ca9fd3e582f9d29f8887c095637c93a8b93651 (diff)
downloadspark-61e0bdcff2ed57b22541fb3c03146d6eec2bb70f.tar.gz
spark-61e0bdcff2ed57b22541fb3c03146d6eec2bb70f.tar.bz2
spark-61e0bdcff2ed57b22541fb3c03146d6eec2bb70f.zip
[SPARK-14476][SQL] Improve the physical plan visualization by adding meta info like table name and file path for data source.
## What changes were proposed in this pull request? Improve the physical plan visualization by adding meta info like table name and file path for data source. Meta info InputPaths and TableName are newly added. Example: ``` scala> spark.range(10).write.saveAsTable("tt") scala> spark.sql("select * from tt").explain() == Physical Plan == WholeStageCodegen : +- BatchedScan HadoopFiles[id#13L] Format: ParquetFormat, InputPaths: file:/home/xzhong10/spark-linux/assembly/spark-warehouse/tt, PushedFilters: [], ReadSchema: struct<id:bigint>, TableName: default.tt ``` ## How was this patch tested? manual tests. Changes for UI: Before: ![ui_before_change](https://cloud.githubusercontent.com/assets/2595532/15064559/3d423e3c-1388-11e6-8099-7803ef496c4d.jpg) After: ![fix_long_string](https://cloud.githubusercontent.com/assets/2595532/15133566/8ad09e26-1696-11e6-939c-99b908249b9d.jpg) ![for_load](https://cloud.githubusercontent.com/assets/2595532/15157224/3ba95c98-171d-11e6-885a-de0ee8dec27c.jpg) Author: Sean Zhong <clockfly@gmail.com> Closes #12947 from clockfly/spark-14476.
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions