diff options
| author | Liang-Chi Hsieh <simonh@tw.ibm.com> | 2016-04-23 21:15:31 -0700 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-04-23 21:15:31 -0700 |
| commit | ba5e0b87a043e46e9599695c82d90e7572185aa5 (patch) | |
| tree | 7c13d9c4015caac6b187f858cf07ccac70db28da /sql/catalyst/src | |
| parent | 1b7eab74e64f554bbf892c8ef7b7ec00b359d2c0 (diff) | |
| download | spark-ba5e0b87a043e46e9599695c82d90e7572185aa5.tar.gz spark-ba5e0b87a043e46e9599695c82d90e7572185aa5.tar.bz2 spark-ba5e0b87a043e46e9599695c82d90e7572185aa5.zip | |
[SPARK-14838] [SQL] Set default size for ObjecType to avoid failure when estimating sizeInBytes in ObjectProducer
## What changes were proposed in this pull request?
We have logical plans that produce domain objects which are `ObjectType`. As we can't estimate the size of `ObjectType`, we throw an `UnsupportedOperationException` if trying to do that. We should set a default size for `ObjectType` to avoid this failure.
## How was this patch tested?
`DatasetSuite`.
Author: Liang-Chi Hsieh <simonh@tw.ibm.com>
Closes #12599 from viirya/skip-broadcast-objectproducer.
Diffstat (limited to 'sql/catalyst/src')
| -rw-r--r-- | sql/catalyst/src/main/scala/org/apache/spark/sql/types/ObjectType.scala | 3 |
1 files changed, 1 insertions, 2 deletions
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/types/ObjectType.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/types/ObjectType.scala index b7b1acc582..c741a2dd3e 100644 --- a/sql/catalyst/src/main/scala/org/apache/spark/sql/types/ObjectType.scala +++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/types/ObjectType.scala @@ -37,8 +37,7 @@ private[sql] object ObjectType extends AbstractDataType { * outside of the execution engine. */ private[sql] case class ObjectType(cls: Class[_]) extends DataType { - override def defaultSize: Int = - throw new UnsupportedOperationException("No size estimation available for objects.") + override def defaultSize: Int = 4096 def asNullable: DataType = this |