diff options
author | Patrick Wendell <pwendell@gmail.com> | 2013-09-08 18:32:16 -0700 |
---|---|---|
committer | Patrick Wendell <pwendell@gmail.com> | 2013-09-08 18:32:16 -0700 |
commit | f68848d95d896b578235c063be51483b4fce518e (patch) | |
tree | fcbfaecaa189fcc472b6d01c498d941cadce81e4 /docs | |
parent | 0b957997ada10fcfa96e42780482d986bf7e4885 (diff) | |
parent | b4e382c210b4987da78421f5de11199e4d74f0e7 (diff) | |
download | spark-f68848d95d896b578235c063be51483b4fce518e.tar.gz spark-f68848d95d896b578235c063be51483b4fce518e.tar.bz2 spark-f68848d95d896b578235c063be51483b4fce518e.zip |
Merge pull request #906 from pwendell/ganglia-sink
Clean-up of Metrics Code/Docs and Add Ganglia Sink
Diffstat (limited to 'docs')
-rw-r--r-- | docs/monitoring.md | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/docs/monitoring.md b/docs/monitoring.md index 0ec987107c..4c4f174503 100644 --- a/docs/monitoring.md +++ b/docs/monitoring.md @@ -31,6 +31,15 @@ set of sinks to which metrics are reported. The following instances are currentl * `executor`: A Spark executor. * `driver`: The Spark driver process (the process in which your SparkContext is created). +Each instance can report to zero or more _sinks_. Sinks are contained in the +`org.apache.spark.metrics.sink` package: + +* `ConsoleSink`: Logs metrics information to the console. +* `CSVSink`: Exports metrics data to CSV files at regular intervals. +* `GangliaSink`: Sends metrics to a Ganglia node or multicast group. +* `JmxSink`: Registers metrics for viewing in a JXM console. +* `MetricsServlet`: Adds a servlet within the existing Spark UI to serve metrics data as JSON data. + The syntax of the metrics configuration file is defined in an example configuration file, `$SPARK_HOME/conf/metrics.conf.template`. |