diff options
| author | David Tolpin <david.tolpin@gmail.com> | 2015-11-19 13:57:23 -0800 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-11-19 13:57:23 -0800 |
| commit | 599a8c6e2bf7da70b20ef3046f5ce099dfd637f8 (patch) | |
| tree | 620b913655b307547d9aee37c1f7ec6d68a3d0ef /sql | |
| parent | 4700074530d9a398843e13f0ef514be97a237cea (diff) | |
| download | spark-599a8c6e2bf7da70b20ef3046f5ce099dfd637f8.tar.gz spark-599a8c6e2bf7da70b20ef3046f5ce099dfd637f8.tar.bz2 spark-599a8c6e2bf7da70b20ef3046f5ce099dfd637f8.zip | |
[SPARK-11812][PYSPARK] invFunc=None works properly with python's reduceByKeyAndWindow
invFunc is optional and can be None. Instead of invFunc (the parameter) invReduceFunc (a local function) was checked for trueness (that is, not None, in this context). A local function is never None,
thus the case of invFunc=None (a common one when inverse reduction is not defined) was treated incorrectly, resulting in loss of data.
In addition, the docstring used wrong parameter names, also fixed.
Author: David Tolpin <david.tolpin@gmail.com>
Closes #9775 from dtolpin/master.
Diffstat (limited to 'sql')
0 files changed, 0 insertions, 0 deletions