diff options
| author | Davies Liu <davies@databricks.com> | 2016-01-05 18:46:52 -0800 |
|---|---|---|
| committer | Davies Liu <davies.liu@gmail.com> | 2016-01-05 18:46:52 -0800 |
| commit | 70fe6ce52f26904aa53bd20409db69b52bccf315 (patch) | |
| tree | c4669d8395ba2572c1aab3c3bd3197aadb8126d3 /project | |
| parent | 0d42292f6a2dbe626e8f6a50e6c61dd79533f235 (diff) | |
| download | spark-70fe6ce52f26904aa53bd20409db69b52bccf315.tar.gz spark-70fe6ce52f26904aa53bd20409db69b52bccf315.tar.bz2 spark-70fe6ce52f26904aa53bd20409db69b52bccf315.zip | |
[SPARK-12659] fix NPE in UnsafeExternalSorter (used by cartesian product)
Cartesian product use UnsafeExternalSorter without comparator to do spilling, it will NPE if spilling happens.
This bug also hitted by #10605
cc JoshRosen
Author: Davies Liu <davies@databricks.com>
Closes #10606 from davies/fix_spilling.
Diffstat (limited to 'project')
| -rw-r--r-- | project/MimaExcludes.scala | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/project/MimaExcludes.scala b/project/MimaExcludes.scala index 8c3a40d241..940fedfa2a 100644 --- a/project/MimaExcludes.scala +++ b/project/MimaExcludes.scala @@ -40,6 +40,7 @@ object MimaExcludes { excludePackage("org.apache.spark.rpc"), excludePackage("org.spark-project.jetty"), excludePackage("org.apache.spark.unused"), + excludePackage("org.apache.spark.util.collection.unsafe"), excludePackage("org.apache.spark.sql.catalyst"), excludePackage("org.apache.spark.sql.execution"), ProblemFilters.exclude[MissingMethodProblem]("org.apache.spark.mllib.feature.PCAModel.this"), |