You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Mohamed Riadh Trad <Mo...@inria.fr> on 2010/02/20 03:14:38 UTC
Hadoop Pipes Exception: RecordReader not defined at /home/oom/work/eclipse/hadoop-20/src/c++/pipes/impl/HadoopPipes.cc:691
Hi,
I am new with hadoop and specially the c++ api.
I am running the Wordcount example but it crashes during the Map and prints this log.
Regards,
Trad Riadh
./hadoop pipes -input input -output output -program /user/trad/main
10/02/20 03:01:12 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
10/02/20 03:01:12 INFO mapred.FileInputFormat: Total input paths to process : 14
10/02/20 03:01:12 INFO mapred.JobClient: Running job: job_201002200300_0001
10/02/20 03:01:13 INFO mapred.JobClient: map 0% reduce 0%
10/02/20 03:01:23 INFO mapred.JobClient: Task Id : attempt_201002200300_0001_m_000000_0, Status : FAILED
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:298)
at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:319)
at org.apache.hadoop.mapred.pipes.BinaryProtocol$UplinkReaderThread.run(BinaryProtocol.java:114)
attempt_201002200300_0001_m_000000_0: Hadoop Pipes Exception: RecordReader not defined at /home/oom/work/eclipse/hadoop-20/src/c++/pipes/impl/HadoopPipes.cc:691 in virtual void HadoopPipes::TaskContextImpl::runMap(std::string, int, bool)
10/02/20 03:01:23 INFO mapred.JobClient: Task Id : attempt_201002200300_0001_m_000001_0, Status : FAILED
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:298)
at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:319)
at org.apache.hadoop.mapred.pipes.BinaryProtocol$UplinkReaderThread.run(BinaryProtocol.java:114)
attempt_201002200300_0001_m_000001_0: Hadoop Pipes Exception: RecordReader not defined at /home/oom/work/eclipse/hadoop-20/src/c++/pipes/impl/HadoopPipes.cc:691 in virtual void HadoopPipes::TaskContextImpl::runMap(std::string, int, bool)
10/02/20 03:01:29 INFO mapred.JobClient: Task Id : attempt_201002200300_0001_m_000001_1, Status : FAILED
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:298)
at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:319)
at org.apache.hadoop.mapred.pipes.BinaryProtocol$UplinkReaderThread.run(BinaryProtocol.java:114)
attempt_201002200300_0001_m_000001_1: Hadoop Pipes Exception: RecordReader not defined at /home/oom/work/eclipse/hadoop-20/src/c++/pipes/impl/HadoopPipes.cc:691 in virtual void HadoopPipes::TaskContextImpl::runMap(std::string, int, bool)
10/02/20 03:01:29 INFO mapred.JobClient: Task Id : attempt_201002200300_0001_m_000000_1, Status : FAILED
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:298)
at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:319)
at org.apache.hadoop.mapred.pipes.BinaryProtocol$UplinkReaderThread.run(BinaryProtocol.java:114)
attempt_201002200300_0001_m_000000_1: Hadoop Pipes Exception: RecordReader not defined at /home/oom/work/eclipse/hadoop-20/src/c++/pipes/impl/HadoopPipes.cc:691 in virtual void HadoopPipes::TaskContextImpl::runMap(std::string, int, bool)
10/02/20 03:01:35 INFO mapred.JobClient: Task Id : attempt_201002200300_0001_m_000000_2, Status : FAILED
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:298)
at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:319)
at org.apache.hadoop.mapred.pipes.BinaryProtocol$UplinkReaderThread.run(BinaryProtocol.java:114)
attempt_201002200300_0001_m_000000_2: Hadoop Pipes Exception: RecordReader not defined at /home/oom/work/eclipse/hadoop-20/src/c++/pipes/impl/HadoopPipes.cc:691 in virtual void HadoopPipes::TaskContextImpl::runMap(std::string, int, bool)
10/02/20 03:01:35 INFO mapred.JobClient: Task Id : attempt_201002200300_0001_m_000001_2, Status : FAILED
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:151)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:101)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:250)
at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:298)
at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:319)
at org.apache.hadoop.mapred.pipes.BinaryProtocol$UplinkReaderThread.run(BinaryProtocol.java:114)
attempt_201002200300_0001_m_000001_2: Hadoop Pipes Exception: RecordReader not defined at /home/oom/work/eclipse/hadoop-20/src/c++/pipes/impl/HadoopPipes.cc:691 in virtual void HadoopPipes::TaskContextImpl::runMap(std::string, int, bool)
10/02/20 03:01:44 INFO mapred.JobClient: Job complete: job_201002200300_0001
10/02/20 03:01:44 INFO mapred.JobClient: Counters: 3
10/02/20 03:01:44 INFO mapred.JobClient: Job Counters
10/02/20 03:01:44 INFO mapred.JobClient: Launched map tasks=8
10/02/20 03:01:44 INFO mapred.JobClient: Data-local map tasks=8
10/02/20 03:01:44 INFO mapred.JobClient: Failed map tasks=1
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252)
at org.apache.hadoop.mapred.pipes.Submitter.runJob(Submitter.java:248)
at org.apache.hadoop.mapred.pipes.Submitter.run(Submitter.java:479)
at org.apache.hadoop.mapred.pipes.Submitter.main(Submitter.java:494)