diff options
| author | zsxwing <zsxwing@gmail.com> | 2015-08-18 20:15:54 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-08-18 20:15:54 -0700 |
| commit | 90273eff9604439a5a5853077e232d34555c67d7 (patch) | |
| tree | e6171b6c9a7c7683ae3f155b145043760dac9777 /sql/hive-thriftserver/src | |
| parent | 1aeae05bb20f01ab7ccaa62fe905a63e020074b5 (diff) | |
| download | spark-90273eff9604439a5a5853077e232d34555c67d7.tar.gz spark-90273eff9604439a5a5853077e232d34555c67d7.tar.bz2 spark-90273eff9604439a5a5853077e232d34555c67d7.zip | |
[SPARK-10102] [STREAMING] Fix a race condition that startReceiver may happen before setting trackerState to Started
Test failure: https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=spark-test/3305/testReport/junit/org.apache.spark.streaming/StreamingContextSuite/stop_gracefully/
There is a race condition that setting `trackerState` to `Started` could happen after calling `startReceiver`. Then `startReceiver` won't start the receivers because it uses `! isTrackerStarted` to check if ReceiverTracker is stopping or stopped. But actually, `trackerState` is `Initialized` and will be changed to `Started` soon.
Therefore, we should use `isTrackerStopping || isTrackerStopped`.
Author: zsxwing <zsxwing@gmail.com>
Closes #8294 from zsxwing/SPARK-9504.
Diffstat (limited to 'sql/hive-thriftserver/src')
0 files changed, 0 insertions, 0 deletions