diff options
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index 36178efb97..af16489a44 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -207,6 +207,16 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td><code>spark.python.worker.reuse</code></td> + <td>true</td> + <td> + Reuse Python worker or not. If yes, it will use a fixed number of Python workers, + does not need to fork() a Python process for every tasks. It will be very useful + if there is large broadcast, then the broadcast will not be needed to transfered + from JVM to Python worker for every task. + </td> +</tr> +<tr> <td><code>spark.executorEnv.[EnvironmentVariableName]</code></td> <td>(none)</td> <td> |