diff options
| author | MechCoder <manojkumarsivaraj334@gmail.com> | 2015-06-17 11:10:16 -0700 |
|---|---|---|
| committer | Davies Liu <davies@databricks.com> | 2015-06-17 11:10:16 -0700 |
| commit | 6765ef98dff070768bbcd585d341ee7664fbe76c (patch) | |
| tree | 9e88fed33b78a098e8fb91b276eefe0957644e72 /python/pyspark/sql/dataframe.py | |
| parent | 104f30c36f3d44b7567f6f77adb92e0a96494541 (diff) | |
| download | spark-6765ef98dff070768bbcd585d341ee7664fbe76c.tar.gz spark-6765ef98dff070768bbcd585d341ee7664fbe76c.tar.bz2 spark-6765ef98dff070768bbcd585d341ee7664fbe76c.zip | |
[SPARK-6390] [SQL] [MLlib] Port MatrixUDT to PySpark
MatrixUDT was recently coded in scala. This has been ported to PySpark
Author: MechCoder <manojkumarsivaraj334@gmail.com>
Closes #6354 from MechCoder/spark-6390 and squashes the following commits:
fc4dc1e [MechCoder] Better error message
c940a44 [MechCoder] Added test
aa9c391 [MechCoder] Add pyUDT to MatrixUDT
62a2a7d [MechCoder] [SPARK-6390] Port MatrixUDT to PySpark
Diffstat (limited to 'python/pyspark/sql/dataframe.py')
| -rw-r--r-- | python/pyspark/sql/dataframe.py | 6 |
1 files changed, 5 insertions, 1 deletions
diff --git a/python/pyspark/sql/dataframe.py b/python/pyspark/sql/dataframe.py index 9615e57649..152b87351d 100644 --- a/python/pyspark/sql/dataframe.py +++ b/python/pyspark/sql/dataframe.py @@ -194,7 +194,11 @@ class DataFrame(object): StructType(List(StructField(age,IntegerType,true),StructField(name,StringType,true))) """ if self._schema is None: - self._schema = _parse_datatype_json_string(self._jdf.schema().json()) + try: + self._schema = _parse_datatype_json_string(self._jdf.schema().json()) + except AttributeError as e: + raise Exception( + "Unable to parse datatype from schema. %s" % e) return self._schema @since(1.3) |