diff options
| author | Tathagata Das <tathagata.das1565@gmail.com> | 2015-05-20 16:21:23 -0700 |
|---|---|---|
| committer | Tathagata Das <tathagata.das1565@gmail.com> | 2015-05-20 16:21:23 -0700 |
| commit | 3c434cbfd0d6821e5bcf572be792b787a514018b (patch) | |
| tree | 39ef01f8d38f44b18681f06c101b2ab463f8c8de /core | |
| parent | 9b84443dd43777e25b0b00468c61814fe6d26c23 (diff) | |
| download | spark-3c434cbfd0d6821e5bcf572be792b787a514018b.tar.gz spark-3c434cbfd0d6821e5bcf572be792b787a514018b.tar.bz2 spark-3c434cbfd0d6821e5bcf572be792b787a514018b.zip | |
[SPARK-7767] [STREAMING] Added test for checkpoint serialization in StreamingContext.start()
Currently, the background checkpointing thread fails silently if the checkpoint is not serializable. It is hard to debug and therefore its best to fail fast at `start()` when checkpointing is enabled and the checkpoint is not serializable.
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #6292 from tdas/SPARK-7767 and squashes the following commits:
51304e6 [Tathagata Das] Addressed comments.
c35237b [Tathagata Das] Added test for checkpoint serialization in StreamingContext.start()
Diffstat (limited to 'core')
| -rw-r--r-- | core/src/main/scala/org/apache/spark/serializer/SerializationDebugger.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/serializer/SerializationDebugger.scala b/core/src/main/scala/org/apache/spark/serializer/SerializationDebugger.scala index 5abfa467c0..bb5db54553 100644 --- a/core/src/main/scala/org/apache/spark/serializer/SerializationDebugger.scala +++ b/core/src/main/scala/org/apache/spark/serializer/SerializationDebugger.scala @@ -27,7 +27,7 @@ import scala.util.control.NonFatal import org.apache.spark.Logging -private[serializer] object SerializationDebugger extends Logging { +private[spark] object SerializationDebugger extends Logging { /** * Improve the given NotSerializableException with the serialization path leading from the given |