You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "shahid (JIRA)" <ji...@apache.org> on 2019/04/18 16:32:00 UTC

[jira] [Comment Edited] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

    [ https://issues.apache.org/jira/browse/SPARK-27068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821286#comment-16821286 ] 

shahid edited comment on SPARK-27068 at 4/18/19 4:31 PM:
---------------------------------------------------------

cc [~srowen] Can we raise a PR for the issue?. The actual issue is, when there are lots of jobs, UI cleans older jobs if the number of jobs exceeds a threshold. Eventually it removes failure jobs as well. If user want to see the reason for failure, it won't be available in UI. 
 The solution could be, we can remove the jobs only from successful jobs table and retain failed or killed jobs table. Kindly give the feedback


was (Author: shahid):
cc [~srowen] Can we raise a PR for the issue?. The actual issue is, when there are lots of jobs, UI cleans older jobs if the number of jobs exceeds a threshold. Eventually it removes failure jobs as well. If user want to see the reason for failure, it won't be available in UI. 
 The solution could be, we can remove the jobs only from successful jobs table and retain failed of killed jobs table. Kindly give the feedback

> Support failed jobs ui and completed jobs ui use different queue
> ----------------------------------------------------------------
>
>                 Key: SPARK-27068
>                 URL: https://issues.apache.org/jira/browse/SPARK-27068
>             Project: Spark
>          Issue Type: Improvement
>          Components: Web UI
>    Affects Versions: 2.4.0
>            Reporter: zhoukang
>            Priority: Major
>
> For some long running jobs,we may want to check out the cause of some failed jobs.
> But most jobs has completed and failed jobs ui may disappear, we can use different queue for this two kinds of jobs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org