diff options
author | Tathagata Das <tathagata.das1565@gmail.com> | 2013-12-12 20:41:51 -0800 |
---|---|---|
committer | Tathagata Das <tathagata.das1565@gmail.com> | 2013-12-12 20:48:02 -0800 |
commit | 097e120c0c4132f007bfd0b0254b362ee9a02d8f (patch) | |
tree | 84e1d5585a5ff8ba3b16a88998b467d3e50bc8c7 /core/src/main/scala | |
parent | 6169fe14a140146602fb07cfcd13eee6efad98f9 (diff) | |
download | spark-097e120c0c4132f007bfd0b0254b362ee9a02d8f.tar.gz spark-097e120c0c4132f007bfd0b0254b362ee9a02d8f.tar.bz2 spark-097e120c0c4132f007bfd0b0254b362ee9a02d8f.zip |
Refactored streaming scheduler and added listener interface.
- Refactored Scheduler + JobManager to JobGenerator + JobScheduler and
added JobSet for cleaner code. Moved scheduler related code to
streaming.scheduler package.
- Added StreamingListener trait (similar to SparkListener) to enable
gathering to streaming stats like processing times and delays.
StreamingContext.addListener() to added listeners.
- Deduped some code in streaming tests by modifying TestSuiteBase, and
added StreamingListenerSuite.
Diffstat (limited to 'core/src/main/scala')
-rw-r--r-- | core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala b/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala index 3841b5616d..2c5d87419d 100644 --- a/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala +++ b/core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala @@ -63,7 +63,7 @@ trait SparkListener { * Called when a task begins remotely fetching its result (will not be called for tasks that do * not need to fetch the result remotely). */ - def onTaskGettingResult(taskGettingResult: SparkListenerTaskGettingResult) { } + def onTaskGettingResult(taskGettingResult: SparkListenerTaskGettingResult) { } /** * Called when a task ends |