Spark: configuration file 'metrics.properties'

[allonsy <lu...@gmail.com>]

Hi,

Spark's configuration file (useful to retrieve metrics), namely
//conf/metrics.properties/, states what follows:


Within an instance, a "source" specifies a particular set of grouped
metrics. there are two kinds of sources:

1. Spark internal sources, like /MasterSource/, /WorkerSource/, etc, which
will collect a Spark component's internal state. Each instance is paired
with a Spark source that is added automatically.

2. Common sources, like /JvmSource/, which will collect low level state.
These can be added through configuration options and are then loaded using
reflection.


Some examples follow, as

*master.source.jvm.class=org.apache.spark.metrics.source.JvmSource
*

Yet, there is no example explaining how to get metrics from other sources as
/MasterSource/ or /WorkerSource/, and just replacing JvmSource is not doing
the trick.

Suggestions?



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-configuration-file-metrics-properties-tp23985.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org