[jira] [Commented] (SPARK-8143) Spark application history cannot be found even for finished jobs

["Sean Owen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575876#comment-14575876 ] 

Sean Owen commented on SPARK-8143:
----------------------------------

[~devl.development] please have a look around JIRA first. I think this is the same as many issues here:

https://issues.apache.org/jira/browse/SPARK-6107
https://issues.apache.org/jira/browse/SPARK-5344
https://issues.apache.org/jira/browse/SPARK-6950

.. at least one of which is resolved in 1.4. It's best to try to reproduce this against master (here, ~= 1.4) first.

> Spark application history cannot be found even for finished jobs
> ----------------------------------------------------------------
>
>                 Key: SPARK-8143
>                 URL: https://issues.apache.org/jira/browse/SPARK-8143
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 1.3.0, 1.3.1
>            Reporter: Dev Lakhani
>
> Whenever a job is killed or finished, because of an application error or otherwise and when I then click on Application Detail UI, even through the job state is : FINISHED, I get no log results and the message states:
> Application history not found for (app-xyz-abc) 
> Application "ABC" is still in progress. 
> An no logs are presented.
> I'm using spark.eventLog.enabled, true and spark.eventLog.dir=/tmp/spark under which I see lots of files
> app-2015xyz-abc.inprogress
> Even through the job has failed or finished.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org