aboutsummaryrefslogtreecommitdiff
path: root/core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json
diff options
context:
space:
mode:
authorJosé Hiram Soltren <jose@cloudera.com>2017-01-19 09:08:18 -0600
committerImran Rashid <irashid@cloudera.com>2017-01-19 09:08:18 -0600
commit640f942337e1ce87075195998bd051e19c4b50b9 (patch)
treeb1904dc723de8a075e95cd53b3de8ca1a495efe4 /core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json
parent064fadd2a25d1c118e062e505a0ed56be31bdf34 (diff)
downloadspark-640f942337e1ce87075195998bd051e19c4b50b9.tar.gz
spark-640f942337e1ce87075195998bd051e19c4b50b9.tar.bz2
spark-640f942337e1ce87075195998bd051e19c4b50b9.zip
[SPARK-16654][CORE] Add UI coverage for Application Level Blacklisting
Builds on top of work in SPARK-8425 to update Application Level Blacklisting in the scheduler. ## What changes were proposed in this pull request? Adds a UI to these patches by: - defining new listener events for blacklisting and unblacklisting, nodes and executors; - sending said events at the relevant points in BlacklistTracker; - adding JSON (de)serialization code for these events; - augmenting the Executors UI page to show which, and how many, executors are blacklisted; - adding a unit test to make sure events are being fired; - adding HistoryServerSuite coverage to verify that the SHS reads these events correctly. - updates the Executor UI to show Blacklisted/Active/Dead as a tri-state in Executors Status Updates .rat-excludes to pass tests. username squito ## How was this patch tested? ./dev/run-tests testOnly org.apache.spark.util.JsonProtocolSuite testOnly org.apache.spark.scheduler.BlacklistTrackerSuite testOnly org.apache.spark.deploy.history.HistoryServerSuite https://github.com/jsoltren/jose-utils/blob/master/blacklist/test-blacklist.sh ![blacklist-20161219](https://cloud.githubusercontent.com/assets/1208477/21335321/9eda320a-c623-11e6-8b8c-9c912a73c276.jpg) Author: José Hiram Soltren <jose@cloudera.com> Closes #16346 from jsoltren/SPARK-16654-submit.
Diffstat (limited to 'core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json')
-rw-r--r--core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json4
1 files changed, 2 insertions, 2 deletions
diff --git a/core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json b/core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json
index e63039f6a1..88c601512d 100644
--- a/core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json
+++ b/core/src/test/resources/HistoryServerExpectations/one_app_multi_attempt_json_expectation.json
@@ -9,8 +9,8 @@
"duration" : 34935,
"sparkUser" : "irashid",
"completed" : true,
- "startTimeEpoch" : 1426633910242,
"endTimeEpoch" : 1426633945177,
+ "startTimeEpoch" : 1426633910242,
"lastUpdatedEpoch" : 0
}, {
"attemptId" : "1",
@@ -20,8 +20,8 @@
"duration" : 34935,
"sparkUser" : "irashid",
"completed" : true,
- "startTimeEpoch" : 1426533910242,
"endTimeEpoch" : 1426533945177,
+ "startTimeEpoch" : 1426533910242,
"lastUpdatedEpoch" : 0
} ]
}