You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2018/10/16 22:04:00 UTC

[jira] [Assigned] (SPARK-25394) Expose App status metrics as Source

     [ https://issues.apache.org/jira/browse/SPARK-25394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin reassigned SPARK-25394:
--------------------------------------

    Assignee: Stavros Kontopoulos

> Expose App status metrics as Source
> -----------------------------------
>
>                 Key: SPARK-25394
>                 URL: https://issues.apache.org/jira/browse/SPARK-25394
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.4.0
>            Reporter: Stavros Kontopoulos
>            Assignee: Stavros Kontopoulos
>            Priority: Major
>             Fix For: 3.0.0
>
>
> ApplicationListener in Spark core captures useful metrics like job duration which are exposed via the spark rest api (available both at the driver's ui and the history server ui) only. From a devops perspective and especially on k8s where metrics scrapping is often done via the prometheus jmx exporter it would be good to have all metrics in one place, avoidn scraping the metrics rest api.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org