diff options
author | jerryshao <saisai.shao@intel.com> | 2014-12-31 14:45:31 -0800 |
---|---|---|
committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-12-31 14:45:51 -0800 |
commit | 14dbd8312b107a95fb65f0b0d24d0a6bf3a05d87 (patch) | |
tree | ebcacfc11fedb4fa176924e8d137d9cea6877512 | |
parent | bd70ff99e82571b3827bd5876087d7aa81283b97 (diff) | |
download | spark-14dbd8312b107a95fb65f0b0d24d0a6bf3a05d87.tar.gz spark-14dbd8312b107a95fb65f0b0d24d0a6bf3a05d87.tar.bz2 spark-14dbd8312b107a95fb65f0b0d24d0a6bf3a05d87.zip |
[SPARK-5028][Streaming]Add total received and processed records metrics to Streaming UI
This is a follow-up work of [SPARK-4537](https://issues.apache.org/jira/browse/SPARK-4537). Adding total received records and processed records metrics back to UI.
![screenshot](https://dl.dropboxusercontent.com/u/19230832/screenshot.png)
Author: jerryshao <saisai.shao@intel.com>
Closes #3852 from jerryshao/SPARK-5028 and squashes the following commits:
c8c4877 [jerryshao] Add total received and processed metrics to Streaming UI
(cherry picked from commit fdc2aa4918fd4c510f04812b782cc0bfef9a2107)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
-rw-r--r-- | streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala b/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala index 1353e487c7..98e9a2e639 100644 --- a/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala +++ b/streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala @@ -67,6 +67,12 @@ private[ui] class StreamingPage(parent: StreamingTab) <li> <strong>Waiting batches: </strong>{listener.numUnprocessedBatches} </li> + <li> + <strong>Received records: </strong>{listener.numTotalReceivedRecords} + </li> + <li> + <strong>Processed records: </strong>{listener.numTotalProcessedRecords} + </li> </ul> } |