diff options
| author | Thomas Graves <tgraves@apache.org> | 2014-09-05 09:56:22 -0500 |
|---|---|---|
| committer | Thomas Graves <tgraves@apache.org> | 2014-09-05 09:56:22 -0500 |
| commit | 62c557609929982eeec170fe12f810bedfcf97f2 (patch) | |
| tree | 91f235155df9bb216aaed78fb73fbca15383726b /bin | |
| parent | 51b53a758c85f2e20ad9bd73ed815fcfa9c7180b (diff) | |
| download | spark-62c557609929982eeec170fe12f810bedfcf97f2.tar.gz spark-62c557609929982eeec170fe12f810bedfcf97f2.tar.bz2 spark-62c557609929982eeec170fe12f810bedfcf97f2.zip | |
[SPARK-3375] spark on yarn container allocation issues
If yarn doesn't get the containers immediately it stops asking for them and the yarn application hangs with never getting any executors.
The issue here is that we are sending the number of containers as 0 after we send the original one of X. on the yarn side this clears out the original request.
For a ping we should just send empty asks.
Author: Thomas Graves <tgraves@apache.org>
Closes #2275 from tgravescs/SPARK-3375 and squashes the following commits:
74b6820 [Thomas Graves] send empty resource requests when we aren't asking for containers
Diffstat (limited to 'bin')
0 files changed, 0 insertions, 0 deletions