You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dev Lakhani (JIRA)" <ji...@apache.org> on 2015/06/06 19:23:00 UTC

[jira] [Updated] (SPARK-8143) Spark application history cannot be found even for finished jobs

     [ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dev Lakhani updated SPARK-8143:
-------------------------------
    Description: 
Whenever a job is killed or finished, because of an application error or otherwise and when I then click on Application Detail UI, even through the job state is : FINISHED, I get no log results and the message states:

Application history not found for (app-xyz-abc) 

Application "ABC" is still in progress. 

An no logs are presented.

I'm using spark.eventLog.enabled, true and spark.eventLog.dir=/tmp/spark under which I see lots of files

app-2015xyz-abc.inprogress

Even through the job has failed or finished.

  was:
Whenever a job is killed or finished, because of an application error or otherwise and when I then click on Application Detail UI, even through the job state is : FINISHED, I get no log results and the message states:

Application history not found for (app-xyz-abc) 

Application "ABC" is still in progress. 

An no logs are presented.

I'm using spark.eventLog.enabled, true and spark.eventLog.dir=/tmp/sparkunder which I see lots of files

app-2015xyz-abc.inprogress

Even through the job has failed or finished.


> Spark application history cannot be found even for finished jobs
> ----------------------------------------------------------------
>
>                 Key: SPARK-8143
>                 URL: https://issues.apache.org/jira/browse/SPARK-8143
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 1.3.0, 1.3.1
>            Reporter: Dev Lakhani
>
> Whenever a job is killed or finished, because of an application error or otherwise and when I then click on Application Detail UI, even through the job state is : FINISHED, I get no log results and the message states:
> Application history not found for (app-xyz-abc) 
> Application "ABC" is still in progress. 
> An no logs are presented.
> I'm using spark.eventLog.enabled, true and spark.eventLog.dir=/tmp/spark under which I see lots of files
> app-2015xyz-abc.inprogress
> Even through the job has failed or finished.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org