diff options
| author | Cheng Lian <lian.cs.zju@gmail.com> | 2014-06-11 00:06:50 -0700 |
|---|---|---|
| committer | Michael Armbrust <michael@databricks.com> | 2014-06-11 00:06:50 -0700 |
| commit | 0266a0c8a70e0fbaeb0df63031f7a750ffc31a80 (patch) | |
| tree | cf264a4e9ba80be39b734225e7d4c6bac47129a1 /python | |
| parent | 0402bd77ec786d1fa6cfd7f9cc3aa97c7ab16fd8 (diff) | |
| download | spark-0266a0c8a70e0fbaeb0df63031f7a750ffc31a80.tar.gz spark-0266a0c8a70e0fbaeb0df63031f7a750ffc31a80.tar.bz2 spark-0266a0c8a70e0fbaeb0df63031f7a750ffc31a80.zip | |
[SPARK-1968][SQL] SQL/HiveQL command for caching/uncaching tables
JIRA issue: [SPARK-1968](https://issues.apache.org/jira/browse/SPARK-1968)
This PR added support for SQL/HiveQL command for caching/uncaching tables:
```
scala> sql("CACHE TABLE src")
...
res0: org.apache.spark.sql.SchemaRDD =
SchemaRDD[0] at RDD at SchemaRDD.scala:98
== Query Plan ==
CacheCommandPhysical src, true
scala> table("src")
...
res1: org.apache.spark.sql.SchemaRDD =
SchemaRDD[3] at RDD at SchemaRDD.scala:98
== Query Plan ==
InMemoryColumnarTableScan [key#0,value#1], (HiveTableScan [key#0,value#1], (MetastoreRelation default, src, None), None), false
scala> isCached("src")
res2: Boolean = true
scala> sql("CACHE TABLE src")
...
res3: org.apache.spark.sql.SchemaRDD =
SchemaRDD[4] at RDD at SchemaRDD.scala:98
== Query Plan ==
CacheCommandPhysical src, false
scala> table("src")
...
res4: org.apache.spark.sql.SchemaRDD =
SchemaRDD[11] at RDD at SchemaRDD.scala:98
== Query Plan ==
HiveTableScan [key#2,value#3], (MetastoreRelation default, src, None), None
scala> isCached("src")
res5: Boolean = false
```
Things also work for `hql`.
Author: Cheng Lian <lian.cs.zju@gmail.com>
Closes #1038 from liancheng/sqlCacheTable and squashes the following commits:
ecb7194 [Cheng Lian] Trimmed the SQL string before parsing special commands
6f4ce42 [Cheng Lian] Moved logical command classes to a separate file
3458a24 [Cheng Lian] Added comment for public API
f0ffacc [Cheng Lian] Added isCached() predicate
15ec6d2 [Cheng Lian] Added "(UN)CACHE TABLE" SQL/HiveQL statements
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions