You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Mohamed Riadh Trad <Mo...@inria.fr> on 2010/04/11 16:26:43 UTC
Local and Distributed FileSystem
Hi,
Am running hadoop with both local and dfs:
local file system for input data
and
dfs for hadoop pipe binary to be shared by all slaves in addition to additional lib
but i get this trace :
10/04/11 16:21:08 INFO mapred.JobClient: Task Id : attempt_201003311822_0081_m_000005_0, Status : FAILED
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.IllegalArgumentException: Wrong FS: file:/local/trad/pic_test/264913_64dd48bb10.jpg, expected: hdfs://casso***********
at org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:178)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:356)
at MultiFileIndex$FileRecordReader.next(MultiFileIndex.java:301)
at MultiFileIndex$FileRecordReader.next(MultiFileIndex.java:257)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.moveToNext(MapTask.java:192)
at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.next(MapTask.java:176)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:88)
... 3 more
How to set up such configuration?
Regards