[jira] Updated: (HADOOP-1154) streaming hang. (PipeMapRed$MROutputThread gone)

["Koji Noguchi (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated HADOOP-1154:
---------------------------------

    Attachment: 1154.patch

This patch would fail the task when MROutput/ErrThread throws a Throwable.
Right now, I propagate the Throwable by including in the IOException. 
This is probably not the right approach.  I'd appreciate any suggestions.

> streaming hang. (PipeMapRed$MROutputThread gone)
> ------------------------------------------------
>
>                 Key: HADOOP-1154
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1154
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Koji Noguchi
>         Attachments: 1154.patch, PipeReducer.jstack
>
>
> One streaming reducer ('cat')  hang, 
>  '/bin/cat' reducer waiting in 
>     0 S _____  24587 24557  0  75   0 -   631 pipe_w Mar22 ?        00:00:02 /bin/cat
> strace showed that it's waiting in write.
> $ strace -p 24587
> Process 24587 attached - interrupt to quit
> write(1, "________  "..., 138 <unfinished ...>
> Process 24587 detached
> When I looked at the jstack of ReduceTask process, I couldn't find the PipeMapRed$MROutputThread.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.