You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by "Periya.Data" <pe...@gmail.com> on 2012/08/29 18:36:02 UTC

Hadoop streaming - Subprocess failed

Hi,
    I am running a map-reduce job in Python and I get this error message. I
do not understand what it means. Output is not written to HDFS. I am using
CDH3u3. Any suggestion is appreciated.

MapAttempt TASK_TYPE="MAP" TASKID="task_201208232245_2812_m_000000"
TASK_ATTEMPT_ID="attempt_201208232245_2812_m_000000_0"
TASK_STATUS="FAILED"  *ERROR="java\.lang\.RuntimeException:
PipeMapRed\.waitOutputThreads(): subprocess failed with code 1*
        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.waitOutputThreads(PipeMapRed\.java:362)
        at
org\.apache\.hadoop\.streaming\.PipeMapRed\.mapRedFinished(PipeMapRed\.java:572)
        at
org\.apache\.hadoop\.streaming\.PipeMapper\.close(PipeMapper\.java:136)
        at org\.apache\.hadoop\.mapred\.MapRunner\.run(MapRunner\.java:57)
        at
org\.apache\.hadoop\.streaming\.PipeMapRunner\.run(PipeMapRunner\.java:34)
        at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:391)
        at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:325)
        at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:270)
        at java\.security\.AccessController\.doPrivileged(Native Method)
        at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
        at
org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1157)
        at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:264)
" .