diff options
| author | Kostas Sakellis <kostas@cloudera.com> | 2015-01-15 17:53:42 -0800 |
|---|---|---|
| committer | Patrick Wendell <pwendell@gmail.com> | 2015-01-15 17:53:42 -0800 |
| commit | 96c2c714f4f9abe20d4c42d99ffaafcb269714a1 (patch) | |
| tree | 1c6f0ef3e9e4291fb2f42def7b6b7e3d818948c2 /yarn | |
| parent | 65858ba555c4c0aea988b8f4b1c8476c42377eb9 (diff) | |
| download | spark-96c2c714f4f9abe20d4c42d99ffaafcb269714a1.tar.gz spark-96c2c714f4f9abe20d4c42d99ffaafcb269714a1.tar.bz2 spark-96c2c714f4f9abe20d4c42d99ffaafcb269714a1.zip | |
[SPARK-4857] [CORE] Adds Executor membership events to SparkListener
Adds onExecutorAdded and onExecutorRemoved events to the SparkListener. This will allow a client to get notified when an executor has been added/removed and provide additional information such as how many vcores it is consuming.
In addition, this commit adds a SparkListenerAdapter to the Java API that provides default implementations to the SparkListener. This is to get around the fact that default implementations for traits don't work in Java. Having Java clients extend SparkListenerAdapter moving forward will prevent breakage in java when we add new events to SparkListener.
Author: Kostas Sakellis <kostas@cloudera.com>
Closes #3711 from ksakellis/kostas-spark-4857 and squashes the following commits:
946d2c5 [Kostas Sakellis] Added executorAdded/Removed events to MesosSchedulerBackend
b1d054a [Kostas Sakellis] Remove executorInfo from ExecutorRemoved event
1727b38 [Kostas Sakellis] Renamed ExecutorDetails back to ExecutorInfo and other CR feedback
14fe78d [Kostas Sakellis] Added executor added/removed events to json protocol
93d087b [Kostas Sakellis] [SPARK-4857] [CORE] Adds Executor membership events to SparkListener
Diffstat (limited to 'yarn')
0 files changed, 0 insertions, 0 deletions