You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2014/09/22 19:11:36 UTC

[jira] [Commented] (SPARK-3627) spark on yarn reports success even though job fails

    [ https://issues.apache.org/jira/browse/SPARK-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143438#comment-14143438 ] 

Thomas Graves commented on SPARK-3627:
--------------------------------------

We could make this a separate issue, but I've also seen it report failure when it actually succeeded.  In that case I believe it did an sc.stop() and System.exit(0). 



> spark on yarn reports success even though job fails
> ---------------------------------------------------
>
>                 Key: SPARK-3627
>                 URL: https://issues.apache.org/jira/browse/SPARK-3627
>             Project: Spark
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.2.0
>            Reporter: Thomas Graves
>            Priority: Critical
>
> I was running a wordcount and saving the output to hdfs.  If the output directory already exists, yarn reports success even though the job fails since it requires the output directory to not be there.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org