diff options
| author | jerryshao <saisai.shao@intel.com> | 2014-12-23 15:45:53 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-12-23 15:45:53 -0800 |
| commit | 3f5f4cc4e7b3bc458e0579d247a0652dca365853 (patch) | |
| tree | af18738a5f941ab1a4c41423d7434174f33cab75 /core | |
| parent | 10d69e9cbfdabe95d0e513176d5347d7b59da0ee (diff) | |
| download | spark-3f5f4cc4e7b3bc458e0579d247a0652dca365853.tar.gz spark-3f5f4cc4e7b3bc458e0579d247a0652dca365853.tar.bz2 spark-3f5f4cc4e7b3bc458e0579d247a0652dca365853.zip | |
[SPARK-4671][Streaming]Do not replicate streaming block when WAL is enabled
Currently streaming block will be replicated when specific storage level is set, since WAL is already fault tolerant, so replication is needless and will hurt the throughput of streaming application.
Hi tdas , as per discussed about this issue, I fixed with this implementation, I'm not is this the way you want, would you mind taking a look at it? Thanks a lot.
Author: jerryshao <saisai.shao@intel.com>
Closes #3534 from jerryshao/SPARK-4671 and squashes the following commits:
500b456 [jerryshao] Do not replicate streaming block when WAL is enabled
Diffstat (limited to 'core')
0 files changed, 0 insertions, 0 deletions