You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ɓukasz Stefaniak <lu...@gmail.com> on 2014/12/30 20:24:23 UTC

Spark Accumulators exposed as Metrics to Graphite

Hi
Does spark have built in possiblity of exposing current value of
Accumulator [1] using Monitoring and Instrumentation [2].
Unfortunately I couldn't find anything in Sources which could be used.

Does it mean only way to expose current accumulator value is to implement
new Source which would hook to Accumulator in the driver process, or listen
for events on the bus?

Many thanks!

[1]
https://spark.apache.org/docs/1.1.0/api/scala/index.html#org.apache.spark.Accumulator
[2] http://spark.apache.org/docs/1.1.1/monitoring.html