diff options
author | huangzhaowei <carlmartinmax@gmail.com> | 2015-06-16 08:16:09 +0200 |
---|---|---|
committer | Sean Owen <sowen@cloudera.com> | 2015-06-16 08:16:09 +0200 |
commit | ccf010f27bc62f7e7f409c6eef7488ab476de609 (patch) | |
tree | 7a5ae2fafab4a83860e649eca7bc5c6a2ee2c195 /graphx | |
parent | bc76a0f7506c9796209a96b027a236270c23bbf6 (diff) | |
download | spark-ccf010f27bc62f7e7f409c6eef7488ab476de609.tar.gz spark-ccf010f27bc62f7e7f409c6eef7488ab476de609.tar.bz2 spark-ccf010f27bc62f7e7f409c6eef7488ab476de609.zip |
[SPARK-8367] [STREAMING] Add a limit for 'spark.streaming.blockInterval` since a data loss bug.
Bug had reported in the jira [SPARK-8367](https://issues.apache.org/jira/browse/SPARK-8367)
The relution is limitting the configuration `spark.streaming.blockInterval` to a positive number.
Author: huangzhaowei <carlmartinmax@gmail.com>
Author: huangzhaowei <SaintBacchus@users.noreply.github.com>
Closes #6818 from SaintBacchus/SPARK-8367 and squashes the following commits:
c9d1927 [huangzhaowei] Update BlockGenerator.scala
bd3f71a [huangzhaowei] Use requre instead of if
3d17796 [huangzhaowei] [SPARK_8367][Streaming]Add a limit for 'spark.streaming.blockInterval' since a data loss bug.
Diffstat (limited to 'graphx')
0 files changed, 0 insertions, 0 deletions