aboutsummaryrefslogtreecommitdiff
path: root/python
diff options
context:
space:
mode:
authorCheng Lian <lian@databricks.com>2014-11-20 13:12:24 -0800
committerMichael Armbrust <michael@databricks.com>2014-11-20 13:12:38 -0800
commit2fb683c585d8f30a7b19027b941812c922e7d99a (patch)
tree15feaf906f6f3c66eaca0948c8bf092883c50383 /python
parentb676d9ad347e296929361809b0001c0f5c700514 (diff)
downloadspark-2fb683c585d8f30a7b19027b941812c922e7d99a.tar.gz
spark-2fb683c585d8f30a7b19027b941812c922e7d99a.tar.bz2
spark-2fb683c585d8f30a7b19027b941812c922e7d99a.zip
[SPARK-3938][SQL] Names in-memory columnar RDD with corresponding table name
This PR enables the Web UI storage tab to show the in-memory table name instead of the mysterious query plan string as the name of the in-memory columnar RDD. Note that after #2501, a single columnar RDD can be shared by multiple in-memory tables, as long as their query results are the same. In this case, only the first cached table name is shown. For example: ```sql CACHE TABLE first AS SELECT * FROM src; CACHE TABLE second AS SELECT * FROM src; ``` The Web UI only shows "In-memory table first". <!-- Reviewable:start --> [<img src="https://reviewable.io/review_button.png" height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/3383) <!-- Reviewable:end --> Author: Cheng Lian <lian@databricks.com> Closes #3383 from liancheng/columnar-rdd-name and squashes the following commits: 071907f [Cheng Lian] Fixes tests 12ddfa6 [Cheng Lian] Names in-memory columnar RDD with corresponding table name (cherry picked from commit abf29187f0342b607fcefe269391d4db58d2a957) Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions