You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Yifan LI <ia...@gmail.com> on 2015/05/13 15:04:59 UTC

applications are still in progress?

Hi,

I have some applications finished(but actually failed before), that in WebUI show
Application myApp is still in progress.

and, in the eventlog folder, there are several log files like this:

app-20150512***.inprogress

So, I am wondering what the “inprogress” means…

Thanks! :)


Best,
Yifan LI

Re: applications are still in progress?

Posted by Imran Rashid <ir...@cloudera.com>.

Most likely, you never call sc.stop().

Note that in 1.4, this will happen for you automatically in a shutdown
hook, taken care of by https://issues.apache.org/jira/browse/SPARK-3090

On Wed, May 13, 2015 at 8:04 AM, Yifan LI <ia...@gmail.com> wrote:

> Hi,
>
> I have some applications finished(but actually failed before), that in
> WebUI show
> Application myApp is still in progress.
>
> and, in the eventlog folder, there are several log files like this:
>
> app-20150512***.inprogress
>
> So, I am wondering what the “inprogress” means…
>
> Thanks! :)
>
>
> Best,
> Yifan LI
>
>
>
>
>
>