diff options
| author | Ahir Reddy <ahirreddy@gmail.com> | 2014-04-24 20:21:10 -0700 |
|---|---|---|
| committer | Matei Zaharia <matei@databricks.com> | 2014-04-24 20:21:10 -0700 |
| commit | e53eb4f0159ebd4d72c4bbc3586fdfc66ccacab7 (patch) | |
| tree | b156c7c7cc8e5b3d3876e0c8268f4d979541cacc /project/SparkBuild.scala | |
| parent | ee6f7e22a449837864072e3cd2b6696005f134f1 (diff) | |
| download | spark-e53eb4f0159ebd4d72c4bbc3586fdfc66ccacab7.tar.gz spark-e53eb4f0159ebd4d72c4bbc3586fdfc66ccacab7.tar.bz2 spark-e53eb4f0159ebd4d72c4bbc3586fdfc66ccacab7.zip | |
[SPARK-986]: Job cancelation for PySpark
* Additions to the PySpark API to cancel jobs
* Monitor Thread in PythonRDD to kill Python workers if a task is interrupted
Author: Ahir Reddy <ahirreddy@gmail.com>
Closes #541 from ahirreddy/python-cancel and squashes the following commits:
dfdf447 [Ahir Reddy] Changed success -> completed and made logging message clearer
6c860ab [Ahir Reddy] PR Comments
4b4100a [Ahir Reddy] Success flag
adba6ed [Ahir Reddy] Destroy python workers
27a2f8f [Ahir Reddy] Start the writer thread...
d422f7b [Ahir Reddy] Remove unnecesssary vals
adda337 [Ahir Reddy] Busy wait on the ocntext.interrupted flag, and then kill the python worker
d9e472f [Ahir Reddy] Revert "removed unnecessary vals"
5b9cae5 [Ahir Reddy] removed unnecessary vals
07b54d9 [Ahir Reddy] Fix canceling unit test
8ae9681 [Ahir Reddy] Don't interrupt worker
7722342 [Ahir Reddy] Monitor Thread for python workers
db04e16 [Ahir Reddy] Added canceling api to PySpark
Diffstat (limited to 'project/SparkBuild.scala')
0 files changed, 0 insertions, 0 deletions