diff options
| author | xutingjun <xutingjun@huawei.com> | 2015-09-04 15:40:02 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-09-04 15:40:02 -0700 |
| commit | eafe37236c56b41ab32adf6610743e1e9a0f230f (patch) | |
| tree | 478c7c65cd7ed11500dffcbacc9c36f219e64c69 /streaming/src/main | |
| parent | 2e1c17553d179f2d26a165805622cc01f92081b9 (diff) | |
| download | spark-eafe37236c56b41ab32adf6610743e1e9a0f230f.tar.gz spark-eafe37236c56b41ab32adf6610743e1e9a0f230f.tar.bz2 spark-eafe37236c56b41ab32adf6610743e1e9a0f230f.zip | |
[SPARK-10311] [STREAMING] Reload appId and attemptId when app starts with checkpoint file in cluster mode
Author: xutingjun <xutingjun@huawei.com>
Closes #8477 from XuTingjun/streaming-attempt.
Diffstat (limited to 'streaming/src/main')
| -rw-r--r-- | streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala b/streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala index cd5d960369..3985e1a3d9 100644 --- a/streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala +++ b/streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala @@ -49,6 +49,8 @@ class Checkpoint(@transient ssc: StreamingContext, val checkpointTime: Time) // Reload properties for the checkpoint application since user wants to set a reload property // or spark had changed its value and user wants to set it back. val propertiesToReload = List( + "spark.yarn.app.id", + "spark.yarn.app.attemptId", "spark.driver.host", "spark.driver.port", "spark.master", |