[jira] [Created] (SPARK-8526) Provide a way to define custom metrics and custom metric sink in Spark

["Dmitry Goldenberg (JIRA)" <ji...@apache.org>]

Dmitry Goldenberg created SPARK-8526:
----------------------------------------

             Summary: Provide a way to define custom metrics and custom metric sink in Spark
                 Key: SPARK-8526
                 URL: https://issues.apache.org/jira/browse/SPARK-8526
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 1.4.0
            Reporter: Dmitry Goldenberg


There is a number of user questions posted into the Spark mailing list regarding how to instrument custom metrics within Spark applications:
* how to define custom metrics
* how to define a custom metrics sink such as a custom metrics servlet
* how to call back into the consumers from the sink to report on some actions potentially taken by the metrics sink

Some of this may be a documentation issue. Currently the Metrics section under https://spark.apache.org/docs/latest/monitoring.html is rather sparse.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org