You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 05:35:28 UTC

[jira] [Updated] (SPARK-4440) Enhance the job progress API to expose more information

     [ https://issues.apache.org/jira/browse/SPARK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-4440:
--------------------------------
    Labels: bulk-closed  (was: )

> Enhance the job progress API to expose more information
> -------------------------------------------------------
>
>                 Key: SPARK-4440
>                 URL: https://issues.apache.org/jira/browse/SPARK-4440
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Rui Li
>            Priority: Major
>              Labels: bulk-closed
>
> The progress API introduced in SPARK-2321 provides a new way for user to monitor job progress. However the information exposed in the API is relatively limited. It'll be much more useful if we can enhance the API to expose more data.
> Some improvement for example may include but not limited to:
> 1. Stage submission and completion time.
> 2. Task metrics.
> The requirement is initially identified for the hive on spark project(HIVE-7292), other application should benefit as well.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org