diff options
| author | Michael Armbrust <michael@databricks.com> | 2014-08-27 23:05:34 -0700 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2014-08-27 23:06:14 -0700 |
| commit | 233c283e3d946bdcbf418375122c5763559c0119 (patch) | |
| tree | e1d62e10fca07ada31decef9ac502b213c937587 /sql/catalyst | |
| parent | 54ccd93e621c1bc4afc709a208b609232ab701d1 (diff) | |
| download | spark-233c283e3d946bdcbf418375122c5763559c0119.tar.gz spark-233c283e3d946bdcbf418375122c5763559c0119.tar.bz2 spark-233c283e3d946bdcbf418375122c5763559c0119.zip | |
[HOTFIX][SQL] Remove cleaning of UDFs
It is not safe to run the closure cleaner on slaves. #2153 introduced this which broke all UDF execution on slaves. Will re-add cleaning of UDF closures in a follow-up PR.
Author: Michael Armbrust <michael@databricks.com>
Closes #2174 from marmbrus/fixUdfs and squashes the following commits:
55406de [Michael Armbrust] [HOTFIX] Remove cleaning of UDFs
(cherry picked from commit 024178c57419f915d26414e1b91ea0019c3650db)
Signed-off-by: Patrick Wendell <pwendell@gmail.com>
Diffstat (limited to 'sql/catalyst')
| -rw-r--r-- | sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala | 3 |
1 files changed, 0 insertions, 3 deletions
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala index 0b3c1df453..589816ccec 100644 --- a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala +++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala @@ -23,9 +23,6 @@ import org.apache.spark.util.ClosureCleaner case class ScalaUdf(function: AnyRef, dataType: DataType, children: Seq[Expression]) extends Expression { - // Clean function when not called with default no-arg constructor. - if (function != null) { ClosureCleaner.clean(function) } - type EvaluatedType = Any def nullable = true |