diff options
| author | zsxwing <zsxwing@gmail.com> | 2015-04-21 18:37:53 -0700 |
|---|---|---|
| committer | Reynold Xin <rxin@databricks.com> | 2015-04-21 18:37:53 -0700 |
| commit | 3a3f7100f4ead9b7ac50e9711ac50b603ebf6bea (patch) | |
| tree | 9270d0d9a0b0616465c30efe0902a12245de0d3a /docs/configuration.md | |
| parent | a0761ec7063f984dcadc8d154f83dd9cfd1c5e0b (diff) | |
| download | spark-3a3f7100f4ead9b7ac50e9711ac50b603ebf6bea.tar.gz spark-3a3f7100f4ead9b7ac50e9711ac50b603ebf6bea.tar.bz2 spark-3a3f7100f4ead9b7ac50e9711ac50b603ebf6bea.zip | |
[SPARK-6490][Docs] Add docs for rpc configurations
Added docs for rpc configurations and also fixed two places that should have been fixed in #5595.
Author: zsxwing <zsxwing@gmail.com>
Closes #5607 from zsxwing/SPARK-6490-docs and squashes the following commits:
25a6736 [zsxwing] Increase the default timeout to 120s
6e37c30 [zsxwing] Update docs
5577540 [zsxwing] Use spark.network.timeout as the default timeout if it presents
4f07174 [zsxwing] Fix unit tests
1c2cf26 [zsxwing] Add docs for rpc configurations
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 34 |
1 files changed, 32 insertions, 2 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index d9e9e67026..d587b91124 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -963,8 +963,9 @@ Apart from these, the following properties are also available, and may be useful <td> Default timeout for all network interactions. This config will be used in place of <code>spark.core.connection.ack.wait.timeout</code>, <code>spark.akka.timeout</code>, - <code>spark.storage.blockManagerSlaveTimeoutMs</code> or - <code>spark.shuffle.io.connectionTimeout</code>, if they are not configured. + <code>spark.storage.blockManagerSlaveTimeoutMs</code>, + <code>spark.shuffle.io.connectionTimeout</code>, <code>spark.rpc.askTimeout</code> or + <code>spark.rpc.lookupTimeout</code> if they are not configured. </td> </tr> <tr> @@ -982,6 +983,35 @@ Apart from these, the following properties are also available, and may be useful This is only relevant for the Spark shell. </td> </tr> +<tr> + <td><code>spark.rpc.numRetries</code></td> + <td>3</td> + Number of times to retry before an RPC task gives up. + An RPC task will run at most times of this number. + <td> + </td> +</tr> +<tr> + <td><code>spark.rpc.retry.wait</code></td> + <td>3s</td> + <td> + Duration for an RPC ask operation to wait before retrying. + </td> +</tr> +<tr> + <td><code>spark.rpc.askTimeout</code></td> + <td>120s</td> + <td> + Duration for an RPC ask operation to wait before timing out. + </td> +</tr> +<tr> + <td><code>spark.rpc.lookupTimeout</code></td> + <td>120s</td> + Duration for an RPC remote endpoint lookup operation to wait before timing out. + <td> + </td> +</tr> </table> #### Scheduling |