diff options
| author | Davies Liu <davies.liu@gmail.com> | 2014-09-24 13:00:05 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@apache.org> | 2014-09-24 13:00:05 -0700 |
| commit | bb96012b7360b099a19fecc80f0209b30f118ada (patch) | |
| tree | 03d5224e97d17e05122d35ef8a95e96d87267725 /external/kafka/src/test | |
| parent | c854b9fcb5595b1d70b6ce257fc7574602ac5e49 (diff) | |
| download | spark-bb96012b7360b099a19fecc80f0209b30f118ada.tar.gz spark-bb96012b7360b099a19fecc80f0209b30f118ada.tar.bz2 spark-bb96012b7360b099a19fecc80f0209b30f118ada.zip | |
[SPARK-3679] [PySpark] pickle the exact globals of functions
function.func_code.co_names has all the names used in the function, including name of attributes. It will pickle some unnecessary globals if there is a global having the same name with attribute (in co_names).
There is a regression introduced by #2144, revert part of changes in that PR.
cc JoshRosen
Author: Davies Liu <davies.liu@gmail.com>
Closes #2522 from davies/globals and squashes the following commits:
dfbccf5 [Davies Liu] fix bug while pickle globals of function
Diffstat (limited to 'external/kafka/src/test')
0 files changed, 0 insertions, 0 deletions