diff options
author | luogankun <luogankun@gmail.com> | 2014-12-30 12:18:55 -0800 |
---|---|---|
committer | Michael Armbrust <michael@databricks.com> | 2014-12-30 12:18:55 -0800 |
commit | 2deac748b4e1245c2cb9bd43ad87c80d6d130a83 (patch) | |
tree | f89dde22bcefdd8f95c117fef7cecad06d96c0a4 /docs | |
parent | f7a41a0e79561a722e41800257dca886732ccaad (diff) | |
download | spark-2deac748b4e1245c2cb9bd43ad87c80d6d130a83.tar.gz spark-2deac748b4e1245c2cb9bd43ad87c80d6d130a83.tar.bz2 spark-2deac748b4e1245c2cb9bd43ad87c80d6d130a83.zip |
[SPARK-4930][SQL][DOCS]Update SQL programming guide, CACHE TABLE is eager
`CACHE TABLE tbl` is now __eager__ by default not __lazy__
Author: luogankun <luogankun@gmail.com>
Closes #3773 from luogankun/SPARK-4930 and squashes the following commits:
cc17b7d [luogankun] [SPARK-4930][SQL][DOCS]Update SQL programming guide, add CACHE [LAZY] TABLE [AS SELECT] ...
bffe0e8 [luogankun] [SPARK-4930][SQL][DOCS]Update SQL programming guide, CACHE TABLE tbl is eager
Diffstat (limited to 'docs')
-rw-r--r-- | docs/sql-programming-guide.md | 9 |
1 files changed, 4 insertions, 5 deletions
diff --git a/docs/sql-programming-guide.md b/docs/sql-programming-guide.md index 1b5fde991e..729045b81a 100644 --- a/docs/sql-programming-guide.md +++ b/docs/sql-programming-guide.md @@ -1007,12 +1007,11 @@ let user control table caching explicitly: CACHE TABLE logs_last_month; UNCACHE TABLE logs_last_month; -**NOTE:** `CACHE TABLE tbl` is lazy, similar to `.cache` on an RDD. This command only marks `tbl` to ensure that -partitions are cached when calculated but doesn't actually cache it until a query that touches `tbl` is executed. -To force the table to be cached, you may simply count the table immediately after executing `CACHE TABLE`: +**NOTE:** `CACHE TABLE tbl` is now __eager__ by default not __lazy__. Don’t need to trigger cache materialization manually anymore. - CACHE TABLE logs_last_month; - SELECT COUNT(1) FROM logs_last_month; +Spark SQL newly introduced a statement to let user control table caching whether or not lazy since Spark 1.2.0: + + CACHE [LAZY] TABLE [AS SELECT] ... Several caching related features are not supported yet: |