You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2014/11/24 01:29:12 UTC

[jira] [Commented] (SPARK-4440) Enhance the job progress API to expose more information

    [ https://issues.apache.org/jira/browse/SPARK-4440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14222549#comment-14222549 ] 

Xuefu Zhang commented on SPARK-4440:
------------------------------------

CC: [~sandyr], [~rxin]

> Enhance the job progress API to expose more information
> -------------------------------------------------------
>
>                 Key: SPARK-4440
>                 URL: https://issues.apache.org/jira/browse/SPARK-4440
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Rui Li
>
> The progress API introduced in SPARK-2321 provides a new way for user to monitor job progress. However the information exposed in the API is relatively limited. It'll be much more useful if we can enhance the API to expose more data.
> Some improvement for example may include but not limited to:
> 1. Stage submission and completion time.
> 2. Task metrics.
> The requirement is initially identified for the hive on spark project(HIVE-7292), other application should benefit as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org