You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "shahid (JIRA)" <ji...@apache.org> on 2018/10/10 07:34:00 UTC
[jira] [Commented] (SPARK-25698) spark live UI shows wrong
completed Job Message
[ https://issues.apache.org/jira/browse/SPARK-25698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644573#comment-16644573 ]
shahid commented on SPARK-25698:
--------------------------------
Thank you [~abhishek.akg], I am working on it
> spark live UI shows wrong completed Job Message
> -----------------------------------------------
>
> Key: SPARK-25698
> URL: https://issues.apache.org/jira/browse/SPARK-25698
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.3.2
> Reporter: ABHISHEK KUMAR GUPTA
> Priority: Major
>
> 1. spark.ui.retainedJobs = 100000 in Spark-default conf of JDBC and Job History
> 2. Restart Job History and JDBC Server
> 3. Run beeline jobs
> 4. Open Live UI from Yarn Resource page and click on RUNNING application link
> 5. Click on the Application Master of JDBC running application ID
> 6. Message display as Completed Jobs ( XXX, Showing YYY )
> *Note*
> Here XXX is always less than YYY( sometime difference is of 2 Jobs or sometime 5 Jobs )
> Also Number of completed jobs are less than the configured value of spark.ui.retainedJobs
> 7. Now open the Job History UI Page
> 8. Click on the application ID from Incomplete Application and Launch Jobs Page, Value of the completed Jobs shows Completed Jobs( XXX)
> Issue is to handle why in Live UI and Job History UI, the Message of completed Job is different for running application.
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org