diff options
| author | Josh Rosen <joshrosen@databricks.com> | 2015-06-26 00:12:05 -0700 |
|---|---|---|
| committer | Josh Rosen <joshrosen@databricks.com> | 2015-06-26 00:12:05 -0700 |
| commit | 9fed6abfdcb7afcf92be56e5ccbed6599fe66bc4 (patch) | |
| tree | 9b68575cdbbe7e4a7ecc26b327eaaf0e5d680d87 /.gitignore | |
| parent | 1a79f0eb8da7e850c443383b3bb24e0bf8e1e7cb (diff) | |
| download | spark-9fed6abfdcb7afcf92be56e5ccbed6599fe66bc4.tar.gz spark-9fed6abfdcb7afcf92be56e5ccbed6599fe66bc4.tar.bz2 spark-9fed6abfdcb7afcf92be56e5ccbed6599fe66bc4.zip | |
[SPARK-8344] Add message processing time metric to DAGScheduler
This commit adds a new metric, `messageProcessingTime`, to the DAGScheduler metrics source. This metrics tracks the time taken to process messages in the scheduler's event processing loop, which is a helpful debugging aid for diagnosing performance issues in the scheduler (such as SPARK-4961).
In order to do this, I moved the creation of the DAGSchedulerSource metrics source into DAGScheduler itself, similar to how MasterSource is created and registered in Master.
Author: Josh Rosen <joshrosen@databricks.com>
Closes #7002 from JoshRosen/SPARK-8344 and squashes the following commits:
57f914b [Josh Rosen] Fix import ordering
7d6bb83 [Josh Rosen] Add message processing time metrics to DAGScheduler
Diffstat (limited to '.gitignore')
0 files changed, 0 insertions, 0 deletions