diff options
| author | Prashant Sharma <scrapcodes@gmail.com> | 2013-11-26 20:44:47 +0530 |
|---|---|---|
| committer | Prashant Sharma <scrapcodes@gmail.com> | 2013-11-26 20:47:38 +0530 |
| commit | dca946ff6779cda9c50ae0069734b7802bb4d24a (patch) | |
| tree | b14f5d41128d31ad037a113e2c4b0e9c54dbf0a3 /docs | |
| parent | 560e44a8e1d5a2cf42bf640090016f6201c6fbd7 (diff) | |
| download | spark-dca946ff6779cda9c50ae0069734b7802bb4d24a.tar.gz spark-dca946ff6779cda9c50ae0069734b7802bb4d24a.tar.bz2 spark-dca946ff6779cda9c50ae0069734b7802bb4d24a.zip | |
Documenting the newly added spark properties.
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/configuration.md | 23 |
1 files changed, 22 insertions, 1 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 97183bafdb..25e7cecbfc 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -275,12 +275,33 @@ Apart from these, the following properties are also available, and may be useful </tr> <tr> <td>spark.akka.timeout</td> - <td>20</td> + <td>60</td> <td> Communication timeout between Spark nodes, in seconds. </td> </tr> <tr> + <td>spark.akka.pauses</td> + <td>60</td> + <td> + Acceptable heart beat pause in seconds for akka, tune this if you expect GC pauses or network delays (reconnections) etc. + </td> +</tr> +<tr> + <td>spark.akka.failure-detector.threshold</td> + <td>12.0</td> + <td> + Tuning this is not recommended unless you are sure what you are doing. This maps to akka's `akka.remote.transport-failure-detector.threshold`. Usually having a larger value of `spark.akka.pauses` should suffice. + </td> +</tr> +<tr> + <td>spark.akka.heartbeat.interval</td> + <td>5</td> + <td> + A larger interval value in seconds reduces network overhead and a smaller value might be more informative for akka's failure detector. Tune this in combination of `spark.akka.pauses` and `spark.akka.failure-detector.threshold` if you need to. + </td> +</tr> +<tr> <td>spark.driver.host</td> <td>(local hostname)</td> <td> |