diff options
| author | emres <emre.sevinc@gmail.com> | 2015-04-21 16:39:56 -0400 |
|---|---|---|
| committer | Sean Owen <sowen@cloudera.com> | 2015-04-21 16:39:56 -0400 |
| commit | c25ca7c5a1f2a4f88f40b0c5cdbfa927c186cfa8 (patch) | |
| tree | a17b07e1fa7c16b674f8cc67357411f765a3e016 /python/pyspark/mllib/linalg.py | |
| parent | c035c0f2d72f2a303b86fe0037ec43d756fff060 (diff) | |
| download | spark-c25ca7c5a1f2a4f88f40b0c5cdbfa927c186cfa8.tar.gz spark-c25ca7c5a1f2a4f88f40b0c5cdbfa927c186cfa8.tar.bz2 spark-c25ca7c5a1f2a4f88f40b0c5cdbfa927c186cfa8.zip | |
SPARK-3276 Added a new configuration spark.streaming.minRememberDuration
SPARK-3276 Added a new configuration parameter ``spark.streaming.minRememberDuration``, with a default value of 1 minute.
So that when a Spark Streaming application is started, an arbitrary number of minutes can be taken as threshold for remembering.
Author: emres <emre.sevinc@gmail.com>
Closes #5438 from emres/SPARK-3276 and squashes the following commits:
766f938 [emres] SPARK-3276 Switched to using newly added getTimeAsSeconds method.
affee1d [emres] SPARK-3276 Changed the property name and variable name for minRememberDuration
c9d58ca [emres] SPARK-3276 Minor code re-formatting.
1c53ba9 [emres] SPARK-3276 Started to use ssc.conf rather than ssc.sparkContext.getConf, and also getLong method directly.
bfe0acb [emres] SPARK-3276 Moved the minRememberDurationMin to the class
daccc82 [emres] SPARK-3276 Changed the property name to reflect the unit of value and reduced number of fields.
43cc1ce [emres] SPARK-3276 Added a new configuration parameter spark.streaming.minRemember duration, with a default value of 1 minute.
Diffstat (limited to 'python/pyspark/mllib/linalg.py')
0 files changed, 0 insertions, 0 deletions