You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Matt Cheah (JIRA)" <ji...@apache.org> on 2015/04/16 01:16:59 UTC
[jira] [Comment Edited] (SPARK-6950) Spark master UI believes some
applications are in progress when they are actually completed
[ https://issues.apache.org/jira/browse/SPARK-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497273#comment-14497273 ]
Matt Cheah edited comment on SPARK-6950 at 4/15/15 11:16 PM:
-------------------------------------------------------------
It is not the same as SPARK-6107. I'm not sure if SPARK-5344 fixes it - was that merged in before or after the 1.3.0 official release? We're just using the official release.
I checked my event log directory and the event logs that should be picked up do not end with .inprogress.
was (Author: mcheah):
It is not the same as SPARK-6107. I'm not sure if SPARK-5344 fixes it - was that merged in before or after the 1.3.0 official release? We're just using the official release.
> Spark master UI believes some applications are in progress when they are actually completed
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-6950
> URL: https://issues.apache.org/jira/browse/SPARK-6950
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.3.0
> Reporter: Matt Cheah
>
> In Spark 1.2.x, I was able to set my spark event log directory to be a different location from the default, and after the job finishes, I can replay the UI by clicking on the appropriate link under "Completed Applications".
> Now, on a non-deterministic basis (but seems to happen most of the time), when I click on the link under "Completed Applications", I instead get a webpage that says:
> Application history not found (app-20150415052927-0014)
> Application myApp is still in progress.
> I am able to view the application's UI using the Spark history server, so something regressed in the Spark master code between 1.2 and 1.3, but that regression does not apply in the history server use case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org