diff options
| author | Sean Owen <sowen@cloudera.com> | 2014-12-08 16:13:03 -0800 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2014-12-17 12:13:47 -0800 |
| commit | 26dfac6e9cd4253eccea7eccf8b65ba00f5c03a3 (patch) | |
| tree | 3477dc27ce8f7d62136d90be45900a345be3cad2 /LICENSE | |
| parent | 7ecf30e35a893dc2a34d92e9c03d0a0f3c30f39a (diff) | |
| download | spark-26dfac6e9cd4253eccea7eccf8b65ba00f5c03a3.tar.gz spark-26dfac6e9cd4253eccea7eccf8b65ba00f5c03a3.tar.bz2 spark-26dfac6e9cd4253eccea7eccf8b65ba00f5c03a3.zip | |
SPARK-3926 [CORE] Reopened: result of JavaRDD collectAsMap() is not serializable
My original 'fix' didn't fix at all. Now, there's a unit test to check whether it works. Of the two options to really fix it -- copy the `Map` to a `java.util.HashMap`, or copy and modify Scala's implementation in `Wrappers.MapWrapper`, I went with the latter.
Author: Sean Owen <sowen@cloudera.com>
Closes #3587 from srowen/SPARK-3926 and squashes the following commits:
8586bb9 [Sean Owen] Remove unneeded no-arg constructor, and add additional note about copied code in LICENSE
7bb0e66 [Sean Owen] Make SerializableMapWrapper actually serialize, and add unit test
(cherry picked from commit e829bfa1ab9b68f44c489d26efb042f793fd9362)
Signed-off-by: Josh Rosen <joshrosen@databricks.com>
Diffstat (limited to 'LICENSE')
| -rw-r--r-- | LICENSE | 3 |
1 files changed, 2 insertions, 1 deletions
@@ -646,7 +646,8 @@ THE SOFTWARE. ======================================================================== For Scala Interpreter classes (all .scala files in repl/src/main/scala -except for Main.Scala, SparkHelper.scala and ExecutorClassLoader.scala): +except for Main.Scala, SparkHelper.scala and ExecutorClassLoader.scala), +and for SerializableMapWrapper in JavaUtils.scala: ======================================================================== Copyright (c) 2002-2013 EPFL |