diff options
| author | Wenchen Fan <wenchen@databricks.com> | 2016-02-24 12:44:54 -0800 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-02-24 12:44:54 -0800 |
| commit | a60f91284ceee64de13f04559ec19c13a820a133 (patch) | |
| tree | 68d7d84620835d5e66cc3f94771a11655c4cbe2b /python/.gitignore | |
| parent | f92f53faeea020d80638a06752d69ca7a949cdeb (diff) | |
| download | spark-a60f91284ceee64de13f04559ec19c13a820a133.tar.gz spark-a60f91284ceee64de13f04559ec19c13a820a133.tar.bz2 spark-a60f91284ceee64de13f04559ec19c13a820a133.zip | |
[SPARK-13467] [PYSPARK] abstract python function to simplify pyspark code
## What changes were proposed in this pull request?
When we pass a Python function to JVM side, we also need to send its context, e.g. `envVars`, `pythonIncludes`, `pythonExec`, etc. However, it's annoying to pass around so many parameters at many places. This PR abstract python function along with its context, to simplify some pyspark code and make the logic more clear.
## How was the this patch tested?
by existing unit tests.
Author: Wenchen Fan <wenchen@databricks.com>
Closes #11342 from cloud-fan/python-clean.
Diffstat (limited to 'python/.gitignore')
0 files changed, 0 insertions, 0 deletions