You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by nihed mbarek <ni...@gmail.com> on 2016/04/14 14:53:24 UTC

Spark Yarn closing sparkContext

Hi,
I have an issue with closing my application context, the process take a
long time with a fail at the end. In other part, my result was generate in
the write folder and _SUCESS file was created.
I'm using spark 1.6 with yarn.

any idea ?

regards,

-- 

MBAREK Med Nihed,
Fedora Ambassador, TUNISIA, Northern Africa
http://www.nihed.com

<http://tn.linkedin.com/in/nihed>

Re: Spark Yarn closing sparkContext

Posted by Ted Yu <yu...@gmail.com>.

Can you pastebin the failure message ?

Did you happen to take jstack during the close ?

Which Hadoop version do you use ?

Thanks 

> On Apr 14, 2016, at 5:53 AM, nihed mbarek <ni...@gmail.com> wrote:
> 
> Hi, 
> I have an issue with closing my application context, the process take a long time with a fail at the end. In other part, my result was generate in the write folder and _SUCESS file was created. 
> I'm using spark 1.6 with yarn. 
> 
> any idea ? 
> 
> regards, 
> 
> -- 
> 
> MBAREK Med Nihed,
> Fedora Ambassador, TUNISIA, Northern Africa
> http://www.nihed.com
> 
> 
>