diff options
| author | jerryshao <saisai.shao@intel.com> | 2015-01-22 21:58:53 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-01-22 21:58:53 -0800 |
| commit | 3c3fa632e6ba45ce536065aa1145698385301fb2 (patch) | |
| tree | a4dda2d5d2fdebfb886a93c2c4514cfdbd270ab2 /examples/scala-2.10 | |
| parent | 820ce03597350257abe0c5c96435c555038e3e6c (diff) | |
| download | spark-3c3fa632e6ba45ce536065aa1145698385301fb2.tar.gz spark-3c3fa632e6ba45ce536065aa1145698385301fb2.tar.bz2 spark-3c3fa632e6ba45ce536065aa1145698385301fb2.zip | |
[SPARK-5233][Streaming] Fix error replaying of WAL introduced bug
Because of lacking of `BlockAllocationEvent` in WAL recovery, the dangled event will mix into the new batch, which will lead to the wrong result. Details can be seen in [SPARK-5233](https://issues.apache.org/jira/browse/SPARK-5233).
Author: jerryshao <saisai.shao@intel.com>
Closes #4032 from jerryshao/SPARK-5233 and squashes the following commits:
f0b0c0b [jerryshao] Further address the comments
a237c75 [jerryshao] Address the comments
e356258 [jerryshao] Fix bug in unit test
558bdc3 [jerryshao] Correctly replay the WAL log when recovering from failure
Diffstat (limited to 'examples/scala-2.10')
| -rw-r--r-- | examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/KafkaWordCount.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/KafkaWordCount.scala b/examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/KafkaWordCount.scala index 2adc63f7ff..387c0e4213 100644 --- a/examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/KafkaWordCount.scala +++ b/examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/KafkaWordCount.scala @@ -76,7 +76,7 @@ object KafkaWordCountProducer { val Array(brokers, topic, messagesPerSec, wordsPerMessage) = args - // Zookeper connection properties + // Zookeeper connection properties val props = new Properties() props.put("metadata.broker.list", brokers) props.put("serializer.class", "kafka.serializer.StringEncoder") |