diff options
author | David Gingrich <david@textio.com> | 2017-04-11 12:18:31 -0700 |
---|---|---|
committer | Holden Karau <holden@us.ibm.com> | 2017-04-11 12:18:31 -0700 |
commit | 6297697f975960a3006c4e58b4964d9ac40eeaf5 (patch) | |
tree | fb8e7a38b1fee01fa1b32a346e041f716c4631b0 /python/pyspark/broadcast.py | |
parent | 123b4fbbc331f116b45f11b9f7ecbe0b0575323d (diff) | |
download | spark-6297697f975960a3006c4e58b4964d9ac40eeaf5.tar.gz spark-6297697f975960a3006c4e58b4964d9ac40eeaf5.tar.bz2 spark-6297697f975960a3006c4e58b4964d9ac40eeaf5.zip |
[SPARK-19505][PYTHON] AttributeError on Exception.message in Python3
## What changes were proposed in this pull request?
Added `util._message_exception` helper to use `str(e)` when `e.message` is unavailable (Python3). Grepped for all occurrences of `.message` in `pyspark/` and these were the only occurrences.
## How was this patch tested?
- Doctests for helper function
## Legal
This is my original work and I license the work to the project under the project’s open source license.
Author: David Gingrich <david@textio.com>
Closes #16845 from dgingrich/topic-spark-19505-py3-exceptions.
Diffstat (limited to 'python/pyspark/broadcast.py')
-rw-r--r-- | python/pyspark/broadcast.py | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/python/pyspark/broadcast.py b/python/pyspark/broadcast.py index 74dee14207..b1b59f73d6 100644 --- a/python/pyspark/broadcast.py +++ b/python/pyspark/broadcast.py @@ -21,6 +21,7 @@ import gc from tempfile import NamedTemporaryFile from pyspark.cloudpickle import print_exec +from pyspark.util import _exception_message if sys.version < '3': import cPickle as pickle @@ -82,7 +83,8 @@ class Broadcast(object): except pickle.PickleError: raise except Exception as e: - msg = "Could not serialize broadcast: " + e.__class__.__name__ + ": " + e.message + msg = "Could not serialize broadcast: %s: %s" \ + % (e.__class__.__name__, _exception_message(e)) print_exec(sys.stderr) raise pickle.PicklingError(msg) f.close() |