[jira] [Commented] (HIVE-7439) Spark job monitoring and error reporting [Spark Branch]

["Xuefu Zhang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167062#comment-14167062 ] 

Xuefu Zhang commented on HIVE-7439:
-----------------------------------

Hi [~chengxiang li], This looks very nice. Just wondering if we can also show the total number of stages in the progressor? Otherwise, user sees 29/29 thinking that the job is done and then finds there are 5 more stages to go. :)

> Spark job monitoring and error reporting [Spark Branch]
> -------------------------------------------------------
>
>                 Key: HIVE-7439
>                 URL: https://issues.apache.org/jira/browse/HIVE-7439
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Chengxiang Li
>              Labels: Spark-M3
>         Attachments: HIVE-7439.1-spark.patch, hive on spark job status.PNG
>
>
> After Hive submits a job to Spark cluster, we need to report to user the job progress, such as the percentage done, to the user. This is especially important for long running queries. Moreover, if there is an error during job submission or execution, it's also crucial for hive to fetch the error log and/or stacktrace and feedback it to the user.
> Please refer design doc on wiki for more information.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)