diff options
author | jerryshao <saisai.shao@intel.com> | 2014-12-25 19:39:49 -0800 |
---|---|---|
committer | Tathagata Das <tathagata.das1565@gmail.com> | 2014-12-25 19:39:49 -0800 |
commit | f205fe477c33a541053c198cd43a5811d6cf9fe2 (patch) | |
tree | f42adec11f8580e67e1ab3a16a54619f0f000c0a /mllib | |
parent | ac8278593ea68dd3be8cddf8cd5ce739f163ab84 (diff) | |
download | spark-f205fe477c33a541053c198cd43a5811d6cf9fe2.tar.gz spark-f205fe477c33a541053c198cd43a5811d6cf9fe2.tar.bz2 spark-f205fe477c33a541053c198cd43a5811d6cf9fe2.zip |
[SPARK-4537][Streaming] Expand StreamingSource to add more metrics
Add `processingDelay`, `schedulingDelay` and `totalDelay` for the last completed batch. Add `lastReceivedBatchRecords` and `totalReceivedBatchRecords` to the received records counting.
Author: jerryshao <saisai.shao@intel.com>
Closes #3466 from jerryshao/SPARK-4537 and squashes the following commits:
00f5f7f [jerryshao] Change the code style and add totalProcessedRecords
44721a6 [jerryshao] Further address the comments
c097ddc [jerryshao] Address the comments
02dd44f [jerryshao] Fix the addressed comments
c7a9376 [jerryshao] Expand StreamingSource to add more metrics
Diffstat (limited to 'mllib')
0 files changed, 0 insertions, 0 deletions