diff options
Diffstat (limited to 'docs/configuration.md')
| -rw-r--r-- | docs/configuration.md | 19 |
1 files changed, 19 insertions, 0 deletions
diff --git a/docs/configuration.md b/docs/configuration.md index a6dd7245e1..791b6f2aa3 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -207,6 +207,25 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> + <td><code>spark.python.profile</code></td> + <td>false</td> + <td> + Enable profiling in Python worker, the profile result will show up by `sc.show_profiles()`, + or it will be displayed before the driver exiting. It also can be dumped into disk by + `sc.dump_profiles(path)`. If some of the profile results had been displayed maually, + they will not be displayed automatically before driver exiting. + </td> +</tr> +<tr> + <td><code>spark.python.profile.dump</code></td> + <td>(none)</td> + <td> + The directory which is used to dump the profile result before driver exiting. + The results will be dumped as separated file for each RDD. They can be loaded + by ptats.Stats(). If this is specified, the profile result will not be displayed + automatically. +</tr> +<tr> <td><code>spark.python.worker.reuse</code></td> <td>true</td> <td> |