You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Shay Rojansky <ro...@roji.org> on 2014/08/11 21:17:04 UTC

Failed jobs show up as succeeded in YARN?

Spark 1.0.2, Python, Cloudera 5.1 (Hadoop 2.3.0)

It seems that Python jobs I'm sending to YARN show up as succeeded even if
they failed... Am I doing something wrong, is this a known issue?

Thanks,

Shay

Re: Failed jobs show up as succeeded in YARN?

Posted by Arun Ahuja <aa...@gmail.com>.

We see this all the time as well, I don't the believe there is much a
relationship before the Spark job status and the what Yarn shows as the
status.

On Mon, Aug 11, 2014 at 3:17 PM, Shay Rojansky <ro...@roji.org> wrote:

> Spark 1.0.2, Python, Cloudera 5.1 (Hadoop 2.3.0)
>
> It seems that Python jobs I'm sending to YARN show up as succeeded even if
> they failed... Am I doing something wrong, is this a known issue?
>
> Thanks,
>
> Shay
>