You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Decimus Phostle <de...@gmail.com> on 2011/07/27 22:55:42 UTC

Hadoop pipes (wordcount) example failing (with hadoop 0.21.0)

Hello Folks,

I am trying to run a simplistic Hadoop pipes program (the typical
wordcount example). Unfortunately I am seeing a bunch of errors while
running it as follows:

$ bin/hadoop pipes -Dhadoop.pipes.java.recordreader=true \
                  -Dhadoop.pipes.java.recordwriter=true \
                  -input <inputHDFSPath> \
                  -output <outputHDFSPath> \
                  -program <cppBinaryHDFSPath>

This is resulting in a NullPointerException:

java.io.IOException: pipe child exception
        at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
        at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
        at org.apache.hadoop.mapred.Child.main(Child.java:211)
Caused by: java.lang.NullPointerException
        at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
        ... 7 more

More details have been posted here: http://goo.gl/GMy8Q

It would be great if someone could point me in the right direction.
Thanks in advance!!

Regards,
DP

Re: Hadoop pipes (wordcount) example failing (with hadoop 0.21.0)

Posted by Decimus Phostle <de...@gmail.com>.
Does anyone have any inputs on this? Was waiting to hear from someone
out there...

Any help would be most appreciated.

On Wed, Jul 27, 2011 at 4:55 PM, Decimus Phostle
<de...@gmail.com> wrote:
> Hello Folks,
>
> I am trying to run a simplistic Hadoop pipes program (the typical
> wordcount example). Unfortunately I am seeing a bunch of errors while
> running it as follows:
>
> $ bin/hadoop pipes -Dhadoop.pipes.java.recordreader=true \
>                  -Dhadoop.pipes.java.recordwriter=true \
>                  -input <inputHDFSPath> \
>                  -output <outputHDFSPath> \
>                  -program <cppBinaryHDFSPath>
>
> This is resulting in a NullPointerException:
>
> java.io.IOException: pipe child exception
>        at org.apache.hadoop.mapred.pipes.Application.abort(Application.java:160)
>        at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:102)
>        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:397)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
>        at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at javax.security.auth.Subject.doAs(Subject.java:396)
>        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
>        at org.apache.hadoop.mapred.Child.main(Child.java:211)
> Caused by: java.lang.NullPointerException
>        at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:86)
>        ... 7 more
>
> More details have been posted here: http://goo.gl/GMy8Q
>
> It would be great if someone could point me in the right direction.
> Thanks in advance!!
>
> Regards,
> DP
>