diff options
| author | Mridul Muralidharan <mridulm@yahoo-inc.com> | 2015-07-30 10:37:53 -0700 |
|---|---|---|
| committer | Marcelo Vanzin <vanzin@cloudera.com> | 2015-07-30 10:37:53 -0700 |
| commit | e53534655d6198e5b8a507010d26c7b4c4e7f1fd (patch) | |
| tree | bbdf3c91556225c98fbd6d2d66ae7f41813fe674 /python/pyspark/java_gateway.py | |
| parent | 5363ed71568c3e7c082146d654a9c669d692d894 (diff) | |
| download | spark-e53534655d6198e5b8a507010d26c7b4c4e7f1fd.tar.gz spark-e53534655d6198e5b8a507010d26c7b4c4e7f1fd.tar.bz2 spark-e53534655d6198e5b8a507010d26c7b4c4e7f1fd.zip | |
[SPARK-8297] [YARN] Scheduler backend is not notified in case node fails in YARN
This change adds code to notify the scheduler backend when a container dies in YARN.
Author: Mridul Muralidharan <mridulm@yahoo-inc.com>
Author: Marcelo Vanzin <vanzin@cloudera.com>
Closes #7431 from vanzin/SPARK-8297 and squashes the following commits:
471e4a0 [Marcelo Vanzin] Fix unit test after merge.
d4adf4e [Marcelo Vanzin] Merge branch 'master' into SPARK-8297
3b262e8 [Marcelo Vanzin] Merge branch 'master' into SPARK-8297
537da6f [Marcelo Vanzin] Make an expected log less scary.
04dc112 [Marcelo Vanzin] Use driver <-> AM communication to send "remove executor" request.
8855b97 [Marcelo Vanzin] Merge remote-tracking branch 'mridul/fix_yarn_scheduler_bug' into SPARK-8297
687790f [Mridul Muralidharan] Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into fix_yarn_scheduler_bug
e1b0067 [Mridul Muralidharan] Fix failing testcase, fix merge issue from our 1.3 -> master
9218fcc [Mridul Muralidharan] Fix failing testcase
362d64a [Mridul Muralidharan] Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into fix_yarn_scheduler_bug
62ad0cc [Mridul Muralidharan] Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into fix_yarn_scheduler_bug
bbf8811 [Mridul Muralidharan] Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into fix_yarn_scheduler_bug
9ee1307 [Mridul Muralidharan] Fix SPARK-8297
a3a0f01 [Mridul Muralidharan] Fix SPARK-8297
Diffstat (limited to 'python/pyspark/java_gateway.py')
0 files changed, 0 insertions, 0 deletions