diff options
| author | Matei Zaharia <matei@eecs.berkeley.edu> | 2013-11-27 18:24:39 -0800 |
|---|---|---|
| committer | Matei Zaharia <matei@eecs.berkeley.edu> | 2013-11-27 18:24:39 -0800 |
| commit | 743a31a7ca4421cbbd5b615b773997a06a7ab4ee (patch) | |
| tree | 36ad6245012f63fdff398edfdb1a5aad05502486 /python | |
| parent | fb6875dd5c9334802580155464cef9ac4d4cc1f0 (diff) | |
| parent | db998a6e14389768f93b1fdd6be7847d5f7604fd (diff) | |
| download | spark-743a31a7ca4421cbbd5b615b773997a06a7ab4ee.tar.gz spark-743a31a7ca4421cbbd5b615b773997a06a7ab4ee.tar.bz2 spark-743a31a7ca4421cbbd5b615b773997a06a7ab4ee.zip | |
Merge pull request #210 from haitaoyao/http-timeout
add http timeout for httpbroadcast
While pulling task bytecode from HttpBroadcast server, there's no timeout value set. This may cause spark executor code hang and other task in the same executor process wait for the lock. I have encountered the issue in my cluster. Here's the stacktrace I captured : https://gist.github.com/haitaoyao/7655830
So add a time out value to ensure the task fail fast.
Diffstat (limited to 'python')
0 files changed, 0 insertions, 0 deletions