diff options
author | jerryshao <saisai.shao@intel.com> | 2015-01-22 21:58:53 -0800 |
---|---|---|
committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-01-22 21:58:53 -0800 |
commit | 3c3fa632e6ba45ce536065aa1145698385301fb2 (patch) | |
tree | a4dda2d5d2fdebfb886a93c2c4514cfdbd270ab2 /docs | |
parent | 820ce03597350257abe0c5c96435c555038e3e6c (diff) | |
download | spark-3c3fa632e6ba45ce536065aa1145698385301fb2.tar.gz spark-3c3fa632e6ba45ce536065aa1145698385301fb2.tar.bz2 spark-3c3fa632e6ba45ce536065aa1145698385301fb2.zip |
[SPARK-5233][Streaming] Fix error replaying of WAL introduced bug
Because of lacking of `BlockAllocationEvent` in WAL recovery, the dangled event will mix into the new batch, which will lead to the wrong result. Details can be seen in [SPARK-5233](https://issues.apache.org/jira/browse/SPARK-5233).
Author: jerryshao <saisai.shao@intel.com>
Closes #4032 from jerryshao/SPARK-5233 and squashes the following commits:
f0b0c0b [jerryshao] Further address the comments
a237c75 [jerryshao] Address the comments
e356258 [jerryshao] Fix bug in unit test
558bdc3 [jerryshao] Correctly replay the WAL log when recovering from failure
Diffstat (limited to 'docs')
0 files changed, 0 insertions, 0 deletions