diff options
author | Jiacheng Guo <guojc03@gmail.com> | 2014-03-09 11:37:44 -0700 |
---|---|---|
committer | Patrick Wendell <pwendell@gmail.com> | 2014-03-09 11:38:40 -0700 |
commit | f6f9d02e85d17da2f742ed0062f1648a9293e73c (patch) | |
tree | cbc3e4e183131494fae678153d61a23f13746e4a /repl | |
parent | 52834d761b059264214dfc6a1f9c70b8bc7ec089 (diff) | |
download | spark-f6f9d02e85d17da2f742ed0062f1648a9293e73c.tar.gz spark-f6f9d02e85d17da2f742ed0062f1648a9293e73c.tar.bz2 spark-f6f9d02e85d17da2f742ed0062f1648a9293e73c.zip |
Add timeout for fetch file
Currently, when fetch a file, the connection's connect timeout
and read timeout is based on the default jvm setting, in this change, I change it to
use spark.worker.timeout. This can be usefull, when the
connection status between worker is not perfect. And prevent
prematurely remove task set.
Author: Jiacheng Guo <guojc03@gmail.com>
Closes #98 from guojc/master and squashes the following commits:
abfe698 [Jiacheng Guo] add space according request
2a37c34 [Jiacheng Guo] Add timeout for fetch file Currently, when fetch a file, the connection's connect timeout and read timeout is based on the default jvm setting, in this change, I change it to use spark.worker.timeout. This can be usefull, when the connection status between worker is not perfect. And prevent prematurely remove task set.
Diffstat (limited to 'repl')
0 files changed, 0 insertions, 0 deletions