diff options
| author | Daniel Darabos <darabos.daniel@gmail.com> | 2014-07-08 10:43:46 -0700 |
|---|---|---|
| committer | Aaron Davidson <aaron@databricks.com> | 2014-07-08 10:44:02 -0700 |
| commit | 3bd32f023d9bd83da7afab37fffe614064df3e6b (patch) | |
| tree | 44ba94bbff3fc2e59772c3877b75ffe9d76d9e2d /sql/core | |
| parent | 4bf8ddaeefb5e078bfd163d3a6041b9c53b929df (diff) | |
| download | spark-3bd32f023d9bd83da7afab37fffe614064df3e6b.tar.gz spark-3bd32f023d9bd83da7afab37fffe614064df3e6b.tar.bz2 spark-3bd32f023d9bd83da7afab37fffe614064df3e6b.zip | |
[SPARK-2403] Catch all errors during serialization in DAGScheduler
https://issues.apache.org/jira/browse/SPARK-2403
Spark hangs for us whenever we forget to register a class with Kryo. This should be a simple fix for that. But let me know if you have a better suggestion.
I did not write a new test for this. It would be pretty complicated and I'm not sure it's worthwhile for such a simple change. Let me know if you disagree.
Author: Daniel Darabos <darabos.daniel@gmail.com>
Closes #1329 from darabos/spark-2403 and squashes the following commits:
3aceaad [Daniel Darabos] Print full stack trace for miscellaneous exceptions during serialization.
52c22ba [Daniel Darabos] Only catch NonFatal exceptions.
361e962 [Daniel Darabos] Catch all errors during serialization in DAGScheduler.
(cherry picked from commit c8a2313cdf825e0191680a423d17619b5504ff89)
Signed-off-by: Aaron Davidson <aaron@databricks.com>
Diffstat (limited to 'sql/core')
0 files changed, 0 insertions, 0 deletions