aboutsummaryrefslogtreecommitdiff
path: root/core/src/main/scala/org/apache
diff options
context:
space:
mode:
authorTathagata Das <tathagata.das1565@gmail.com>2013-12-12 20:41:51 -0800
committerTathagata Das <tathagata.das1565@gmail.com>2013-12-12 20:48:02 -0800
commit097e120c0c4132f007bfd0b0254b362ee9a02d8f (patch)
tree84e1d5585a5ff8ba3b16a88998b467d3e50bc8c7 /core/src/main/scala/org/apache
parent6169fe14a140146602fb07cfcd13eee6efad98f9 (diff)
downloadspark-097e120c0c4132f007bfd0b0254b362ee9a02d8f.tar.gz
spark-097e120c0c4132f007bfd0b0254b362ee9a02d8f.tar.bz2
spark-097e120c0c4132f007bfd0b0254b362ee9a02d8f.zip
Refactored streaming scheduler and added listener interface.
- Refactored Scheduler + JobManager to JobGenerator + JobScheduler and added JobSet for cleaner code. Moved scheduler related code to streaming.scheduler package. - Added StreamingListener trait (similar to SparkListener) to enable gathering to streaming stats like processing times and delays. StreamingContext.addListener() to added listeners. - Deduped some code in streaming tests by modifying TestSuiteBase, and added StreamingListenerSuite.
Diffstat (limited to 'core/src/main/scala/org/apache')
-rw-r--r--core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala2
1 files changed, 1 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala b/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala
index 3841b5616d..2c5d87419d 100644
--- a/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala
+++ b/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala
@@ -63,7 +63,7 @@ trait SparkListener {
* Called when a task begins remotely fetching its result (will not be called for tasks that do
* not need to fetch the result remotely).
*/
- def onTaskGettingResult(taskGettingResult: SparkListenerTaskGettingResult) { }
+ def onTaskGettingResult(taskGettingResult: SparkListenerTaskGettingResult) { }
/**
* Called when a task ends