diff options
| author | Prashant Sharma <prashant.s@imaginea.com> | 2014-07-24 18:15:37 -0700 |
|---|---|---|
| committer | Matei Zaharia <matei@databricks.com> | 2014-07-24 18:15:37 -0700 |
| commit | eff9714e1c88e39e28317358ca9ec87677f121dc (patch) | |
| tree | 2f0438b364a3dfa6b20f41a2e697a07a15ea715c /python/pyspark/rdd.py | |
| parent | a45d5480f65d2e969fc7fbd8f358b1717fb99bef (diff) | |
| download | spark-eff9714e1c88e39e28317358ca9ec87677f121dc.tar.gz spark-eff9714e1c88e39e28317358ca9ec87677f121dc.tar.bz2 spark-eff9714e1c88e39e28317358ca9ec87677f121dc.zip | |
[SPARK-2014] Make PySpark store RDDs in MEMORY_ONLY_SER with compression by default
Author: Prashant Sharma <prashant.s@imaginea.com>
Closes #1051 from ScrapCodes/SPARK-2014/pyspark-cache and squashes the following commits:
f192df7 [Prashant Sharma] Code Review
2a2f43f [Prashant Sharma] [SPARK-2014] Make PySpark store RDDs in MEMORY_ONLY_SER with compression by default
Diffstat (limited to 'python/pyspark/rdd.py')
| -rw-r--r-- | python/pyspark/rdd.py | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/python/pyspark/rdd.py b/python/pyspark/rdd.py index 94ba22306a..a38dd0b923 100644 --- a/python/pyspark/rdd.py +++ b/python/pyspark/rdd.py @@ -231,10 +231,10 @@ class RDD(object): def cache(self): """ - Persist this RDD with the default storage level (C{MEMORY_ONLY}). + Persist this RDD with the default storage level (C{MEMORY_ONLY_SER}). """ self.is_cached = True - self._jrdd.cache() + self.persist(StorageLevel.MEMORY_ONLY_SER) return self def persist(self, storageLevel): |