You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/03/07 17:35:38 UTC
[jira] [Resolved] (SPARK-1289) improve yarn stable error logging
when passing bad arguments
[ https://issues.apache.org/jira/browse/SPARK-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-1289.
------------------------------
Resolution: Won't Fix
Obsolete because it concerns yarn-alpha
> improve yarn stable error logging when passing bad arguments
> ------------------------------------------------------------
>
> Key: SPARK-1289
> URL: https://issues.apache.org/jira/browse/SPARK-1289
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 0.9.0, 1.0.0
> Reporter: Thomas Graves
>
> There is a difference in the errors shown to the user between yarn alpha and yarn stable (I was running in yarn-cluster mode). For instance if I call SparkHdfsLR with a non-existent hdfs file, yarn alpha shows me the following error in the logs:
> Caused by: org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: hdfs://nn1.com:8020/user/testuser/lr_data_foo.txt
> at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:231)
> at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:251)
> I do the same things on yarn stable and all I see is:
> 14/03/20 17:26:04 INFO yarn.ApplicationMaster: finishApplicationMaster with FAILED
> it doesn't give the user why it failed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org