diff options
author | ksonj <kson@siberie.de> | 2015-04-01 17:23:57 -0700 |
---|---|---|
committer | Josh Rosen <joshrosen@databricks.com> | 2015-04-01 17:24:21 -0700 |
commit | 757b2e91756ba49d7d1ab89abf19b00c7f5fd721 (patch) | |
tree | 1d5f80905278c7f2e3de5fc5c789fd9080588cec /python/pyspark/mllib/tests.py | |
parent | 86b43993517104e6d5ad0785704ceec6db8acc20 (diff) | |
download | spark-757b2e91756ba49d7d1ab89abf19b00c7f5fd721.tar.gz spark-757b2e91756ba49d7d1ab89abf19b00c7f5fd721.tar.bz2 spark-757b2e91756ba49d7d1ab89abf19b00c7f5fd721.zip |
[SPARK-6553] [pyspark] Support functools.partial as UDF
Use `f.__repr__()` instead of `f.__name__` when instantiating `UserDefinedFunction`s, so `functools.partial`s may be used.
Author: ksonj <kson@siberie.de>
Closes #5206 from ksonj/partials and squashes the following commits:
ea66f3d [ksonj] Inserted blank lines for PEP8 compliance
d81b02b [ksonj] added tests for udf with partial function and callable object
2c76100 [ksonj] Makes UDFs work with all types of callables
b814a12 [ksonj] support functools.partial as udf
(cherry picked from commit 98f72dfc17853b570d05c20e97c78919682b6df6)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>
Diffstat (limited to 'python/pyspark/mllib/tests.py')
0 files changed, 0 insertions, 0 deletions