aboutsummaryrefslogtreecommitdiff
path: root/python/pyspark/broadcast.py
diff options
context:
space:
mode:
authorDavid Gingrich <david@textio.com>2017-04-11 12:18:31 -0700
committerHolden Karau <holden@us.ibm.com>2017-04-11 12:18:31 -0700
commit6297697f975960a3006c4e58b4964d9ac40eeaf5 (patch)
treefb8e7a38b1fee01fa1b32a346e041f716c4631b0 /python/pyspark/broadcast.py
parent123b4fbbc331f116b45f11b9f7ecbe0b0575323d (diff)
downloadspark-6297697f975960a3006c4e58b4964d9ac40eeaf5.tar.gz
spark-6297697f975960a3006c4e58b4964d9ac40eeaf5.tar.bz2
spark-6297697f975960a3006c4e58b4964d9ac40eeaf5.zip
[SPARK-19505][PYTHON] AttributeError on Exception.message in Python3
## What changes were proposed in this pull request? Added `util._message_exception` helper to use `str(e)` when `e.message` is unavailable (Python3). Grepped for all occurrences of `.message` in `pyspark/` and these were the only occurrences. ## How was this patch tested? - Doctests for helper function ## Legal This is my original work and I license the work to the project under the project’s open source license. Author: David Gingrich <david@textio.com> Closes #16845 from dgingrich/topic-spark-19505-py3-exceptions.
Diffstat (limited to 'python/pyspark/broadcast.py')
-rw-r--r--python/pyspark/broadcast.py4
1 files changed, 3 insertions, 1 deletions
diff --git a/python/pyspark/broadcast.py b/python/pyspark/broadcast.py
index 74dee14207..b1b59f73d6 100644
--- a/python/pyspark/broadcast.py
+++ b/python/pyspark/broadcast.py
@@ -21,6 +21,7 @@ import gc
from tempfile import NamedTemporaryFile
from pyspark.cloudpickle import print_exec
+from pyspark.util import _exception_message
if sys.version < '3':
import cPickle as pickle
@@ -82,7 +83,8 @@ class Broadcast(object):
except pickle.PickleError:
raise
except Exception as e:
- msg = "Could not serialize broadcast: " + e.__class__.__name__ + ": " + e.message
+ msg = "Could not serialize broadcast: %s: %s" \
+ % (e.__class__.__name__, _exception_message(e))
print_exec(sys.stderr)
raise pickle.PicklingError(msg)
f.close()