diff options
author | WangTao <barneystinson@aliyun.com> | 2014-11-14 20:11:51 -0800 |
---|---|---|
committer | Andrew Or <andrew@databricks.com> | 2014-11-14 20:12:05 -0800 |
commit | 118c89c28d1c3c048a5bd0335db4a0c65d71a4aa (patch) | |
tree | 8b3d5dc56773fef5a9aa59fe86c741df3df742f8 /bin/pyspark | |
parent | c425e31ad0132ddb0a817b26fe1e5d11a7ef7a63 (diff) | |
download | spark-118c89c28d1c3c048a5bd0335db4a0c65d71a4aa.tar.gz spark-118c89c28d1c3c048a5bd0335db4a0c65d71a4aa.tar.bz2 spark-118c89c28d1c3c048a5bd0335db4a0c65d71a4aa.zip |
[SPARK-4404]SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-proc...
...ess ends
https://issues.apache.org/jira/browse/SPARK-4404
When we have spark.driver.extra* or spark.driver.memory in SPARK_SUBMIT_PROPERTIES_FILE, spark-class will use SparkSubmitDriverBootstrapper to launch driver.
If we get process id of SparkSubmitDriverBootstrapper and wanna kill it during its running, we expect its SparkSubmit sub-process stop also.
Author: WangTao <barneystinson@aliyun.com>
Author: WangTaoTheTonic <barneystinson@aliyun.com>
Closes #3266 from WangTaoTheTonic/killsubmit and squashes the following commits:
e03eba5 [WangTaoTheTonic] add comments
57b5ca1 [WangTao] SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process ends
(cherry picked from commit 303a4e4d23e5cd93b541480cf88d5badb9cf9622)
Signed-off-by: Andrew Or <andrew@databricks.com>
Diffstat (limited to 'bin/pyspark')
0 files changed, 0 insertions, 0 deletions