You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Priya Ch <le...@gmail.com> on 2015/09/01 20:28:51 UTC

Executor lost failure

Hi All,

 I have a spark streaming application which writes the processed results to
cassandra. In local mode, the code seems to work fine. The moment i start
running in distributed mode using yarn, i see executor lost failure. I
increased executor memory to occupy entire node's memory which is around
12gb/ But still see the same issue.

What could be the possible scenarios for executor lost failure ?

Re: Executor lost failure

Posted by Andrew Duffy <an...@gmail.com>.

If you're using YARN with Spark 1.3.1, you could be running into
https://issues.apache.org/jira/browse/SPARK-8119, although without more
information it's impossible to know.

On Tue, Sep 1, 2015 at 11:28 AM, Priya Ch <le...@gmail.com>
wrote:

> Hi All,
>
>  I have a spark streaming application which writes the processed results
> to cassandra. In local mode, the code seems to work fine. The moment i
> start running in distributed mode using yarn, i see executor lost failure.
> I increased executor memory to occupy entire node's memory which is around
> 12gb/ But still see the same issue.
>
> What could be the possible scenarios for executor lost failure ?
>