diff options
author | Cheng Lian <lian@databricks.com> | 2014-11-20 13:12:24 -0800 |
---|---|---|
committer | Michael Armbrust <michael@databricks.com> | 2014-11-20 13:12:38 -0800 |
commit | 2fb683c585d8f30a7b19027b941812c922e7d99a (patch) | |
tree | 15feaf906f6f3c66eaca0948c8bf092883c50383 /python | |
parent | b676d9ad347e296929361809b0001c0f5c700514 (diff) | |
download | spark-2fb683c585d8f30a7b19027b941812c922e7d99a.tar.gz spark-2fb683c585d8f30a7b19027b941812c922e7d99a.tar.bz2 spark-2fb683c585d8f30a7b19027b941812c922e7d99a.zip |
[SPARK-3938][SQL] Names in-memory columnar RDD with corresponding table name
This PR enables the Web UI storage tab to show the in-memory table name instead of the mysterious query plan string as the name of the in-memory columnar RDD.
Note that after #2501, a single columnar RDD can be shared by multiple in-memory tables, as long as their query results are the same. In this case, only the first cached table name is shown. For example:
```sql
CACHE TABLE first AS SELECT * FROM src;
CACHE TABLE second AS SELECT * FROM src;
```
The Web UI only shows "In-memory table first".
<!-- Reviewable:start -->
[<img src="https://reviewable.io/review_button.png" height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/3383)
<!-- Reviewable:end -->
Author: Cheng Lian <lian@databricks.com>
Closes #3383 from liancheng/columnar-rdd-name and squashes the following commits:
071907f [Cheng Lian] Fixes tests
12ddfa6 [Cheng Lian] Names in-memory columnar RDD with corresponding table name
(cherry picked from commit abf29187f0342b607fcefe269391d4db58d2a957)
Signed-off-by: Michael Armbrust <michael@databricks.com>
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions