diff options
author | Ankur Dave <ankurdave@gmail.com> | 2011-10-26 21:07:17 +0000 |
---|---|---|
committer | Ankur Dave <ankurdave@gmail.com> | 2011-11-14 01:54:53 +0000 |
commit | 35b6358a7c4e9558789577e07c1953c9008d3e9c (patch) | |
tree | 093262d22a10a948754193831ba69ca3e57404f2 /project | |
parent | 07532021fee9e2d27ee954b21c30830687478d8b (diff) | |
download | spark-35b6358a7c4e9558789577e07c1953c9008d3e9c.tar.gz spark-35b6358a7c4e9558789577e07c1953c9008d3e9c.tar.bz2 spark-35b6358a7c4e9558789577e07c1953c9008d3e9c.zip |
Report errors in tasks to the driver via a Mesos status update
When a task throws an exception, the Spark executor previously just
logged it to a local file on the slave and exited. This commit causes
Spark to also report the exception back to the driver using a Mesos
status update, so the user doesn't have to look through a log file on
the slave.
Here's what the reporting currently looks like:
# ./run spark.examples.ExceptionHandlingTest master@203.0.113.1:5050
[...]
11/10/26 21:04:13 INFO spark.SimpleJob: Lost TID 1 (task 0:1)
11/10/26 21:04:13 INFO spark.SimpleJob: Loss was due to java.lang.Exception: Testing exception handling
[...]
11/10/26 21:04:16 INFO spark.SparkContext: Job finished in 5.988547328 s
Diffstat (limited to 'project')
0 files changed, 0 insertions, 0 deletions