You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Gergely Novák (JIRA)" <ji...@apache.org> on 2016/04/11 16:55:25 UTC
[jira] [Commented] (MAPREDUCE-5990) If output directory can not be
created, error message on stdout does not provide any clue.
[ https://issues.apache.org/jira/browse/MAPREDUCE-5990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235216#comment-15235216 ]
Gergely Novák commented on MAPREDUCE-5990:
------------------------------------------
It looks like your problem is not caused by the missing permissions but something else.
If I run the builtin wordcount with an output directory that the current user has no permission to write to (/xy): {{bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1-SNAPSHOT.jar wordcount input /xy/zz}} then I get {{java.io.IOException: Mkdirs failed to create file:/xy/zz/_temporary/0/_temporary/attempt_local731757024_0001_r_000000_0}}.
> If output directory can not be created, error message on stdout does not provide any clue.
> ------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-5990
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5990
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: examples
> Reporter: Suhas Gogate
> Labels: newbie
>
> In the following wordcount example output directory path can not be created because /temp does not exists and user has not privileges to create output path at "/".
> hadoop --config ./clustdir/ jar /homes/gogate/wordcount.jar com.XXXX.wordcount.WordCount /in-path/gogate/myfile /temp/mywc-gogate
> 09/04/28 23:00:32 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
> 09/04/28 23:00:32 INFO mapred.FileInputFormat: Total input paths to process : 1
> 09/04/28 23:00:32 INFO mapred.FileInputFormat: Total input paths to process : 1
> 09/04/28 23:00:33 INFO mapred.JobClient: Running job: job_200904282249_0004
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1113)
> at com.XXXX.wordcount.WordCount.main(WordCount.java:55)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)