You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Decimus Phostle <de...@gmail.com> on 2011/07/27 22:55:42 UTC
Hadoop pipes (wordcount) example failing (with hadoop 0.21.0)
Hello Folks,
I am trying to run a simplistic Hadoop pipes program (the typical
wordcount example). Unfortunately I am seeing a bunch of errors while
running it as follows:
$ bin/hadoop pipes -Dhadoop.pipes.java.recordreader=true \
-Dhadoop.pipes.java.recordwriter=true \
-input <inputHDFSPath> \
-output <outputHDFSPath> \
-program <cppBinaryHDFSPath>
This is resulting in a NullPointerException:
java.io.IOException: pipe child exception
at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
at org.apache.hadoop.mapred.Child.main(Child.java:211)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
... 7 more
More details have been posted here: http://goo.gl/GMy8Q
It would be great if someone could point me in the right direction.
Thanks in advance!!
Regards,
DP
Re: Hadoop pipes (wordcount) example failing (with hadoop 0.21.0)
Posted by Decimus Phostle <de...@gmail.com>.
Does anyone have any inputs on this? Was waiting to hear from someone
out there...
Any help would be most appreciated.
On Wed, Jul 27, 2011 at 4:55 PM, Decimus Phostle
<de...@gmail.com> wrote:
> Hello Folks,
>
> I am trying to run a simplistic Hadoop pipes program (the typical
> wordcount example). Unfortunately I am seeing a bunch of errors while
> running it as follows:
>
> $ bin/hadoop pipes -Dhadoop.pipes.java.recordreader=true \
> -Dhadoop.pipes.java.recordwriter=true \
> -input <inputHDFSPath> \
> -output <outputHDFSPath> \
> -program <cppBinaryHDFSPath>
>
> This is resulting in a NullPointerException:
>
> java.io.IOException: pipe child exception
> at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
> at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
> at org.apache.hadoop.mapred.Child.main(Child.java:211)
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
> ... 7 more
>
> More details have been posted here: http://goo.gl/GMy8Q
>
> It would be great if someone could point me in the right direction.
> Thanks in advance!!
>
> Regards,
> DP
>