You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Nicholas Parker (JIRA)" <ji...@apache.org> on 2018/06/08 23:42:00 UTC

[jira] [Created] (SPARK-24501) Add metrics for Mesos Driver and Dispatcher

Nicholas Parker created SPARK-24501:
---------------------------------------

             Summary: Add metrics for Mesos Driver and Dispatcher
                 Key: SPARK-24501
                 URL: https://issues.apache.org/jira/browse/SPARK-24501
             Project: Spark
          Issue Type: Improvement
          Components: Mesos
    Affects Versions: 2.3.1
            Reporter: Nicholas Parker


The Mesos Dispatcher currently only has three gauge metrics, for the number of waiting, launched, and retrying drivers, defined in MesosClusterSchedulerSource.scala. Meanwhile, the Mesos Driver doesn't have any metrics defined at all.

Implement additional metrics for both the Mesos Dispatcher and Mesos Driver, including e.g. types of events received, how long it takes jobs to run, for use by operators to monitor and/or diagnose their Spark environment.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org