diff options
author | José Hiram Soltren <jose@cloudera.com> | 2017-01-19 09:08:18 -0600 |
---|---|---|
committer | Imran Rashid <irashid@cloudera.com> | 2017-01-19 09:08:18 -0600 |
commit | 640f942337e1ce87075195998bd051e19c4b50b9 (patch) | |
tree | b1904dc723de8a075e95cd53b3de8ca1a495efe4 /dev/.rat-excludes | |
parent | 064fadd2a25d1c118e062e505a0ed56be31bdf34 (diff) | |
download | spark-640f942337e1ce87075195998bd051e19c4b50b9.tar.gz spark-640f942337e1ce87075195998bd051e19c4b50b9.tar.bz2 spark-640f942337e1ce87075195998bd051e19c4b50b9.zip |
[SPARK-16654][CORE] Add UI coverage for Application Level Blacklisting
Builds on top of work in SPARK-8425 to update Application Level Blacklisting in the scheduler.
## What changes were proposed in this pull request?
Adds a UI to these patches by:
- defining new listener events for blacklisting and unblacklisting, nodes and executors;
- sending said events at the relevant points in BlacklistTracker;
- adding JSON (de)serialization code for these events;
- augmenting the Executors UI page to show which, and how many, executors are blacklisted;
- adding a unit test to make sure events are being fired;
- adding HistoryServerSuite coverage to verify that the SHS reads these events correctly.
- updates the Executor UI to show Blacklisted/Active/Dead as a tri-state in Executors Status
Updates .rat-excludes to pass tests.
username squito
## How was this patch tested?
./dev/run-tests
testOnly org.apache.spark.util.JsonProtocolSuite
testOnly org.apache.spark.scheduler.BlacklistTrackerSuite
testOnly org.apache.spark.deploy.history.HistoryServerSuite
https://github.com/jsoltren/jose-utils/blob/master/blacklist/test-blacklist.sh
![blacklist-20161219](https://cloud.githubusercontent.com/assets/1208477/21335321/9eda320a-c623-11e6-8b8c-9c912a73c276.jpg)
Author: José Hiram Soltren <jose@cloudera.com>
Closes #16346 from jsoltren/SPARK-16654-submit.
Diffstat (limited to 'dev/.rat-excludes')
-rw-r--r-- | dev/.rat-excludes | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/dev/.rat-excludes b/dev/.rat-excludes index 6be1c72bc6..6d24434ccc 100644 --- a/dev/.rat-excludes +++ b/dev/.rat-excludes @@ -73,6 +73,8 @@ logs .*dependency-reduced-pom.xml known_translations json_expectation +app-20161115172038-0000 +app-20161116163331-0000 local-1422981759269 local-1422981780767 local-1425081759269 |