You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2008/03/05 10:33:40 UTC

[jira] Created: (HADOOP-2941) Streaming map task is not failed when the subprocess exited abnormally.

Streaming map task is not failed when the subprocess exited abnormally.
-----------------------------------------------------------------------

                 Key: HADOOP-2941
                 URL: https://issues.apache.org/jira/browse/HADOOP-2941
             Project: Hadoop Core
          Issue Type: Bug
          Components: contrib/streaming
            Reporter: Amareshwari Sriramadasu
             Fix For: 0.17.0


The launched streaming process exited with a non-zero exit code. But the task was succesful. thereby, job was succesful.

Job tracker logs show: 
08/03/05 14:30:43 INFO mapred.TaskTracker: Task task_200803051430_0001_m_000000_1 is done.
08/03/05 14:30:43 INFO mapred.TaskRunner: Saved output of task 'task_200803051430_0001_m_000000_1' to hdfs://localhost:46796/testing/out
08/03/05 14:30:43 INFO mapred.JobInProgress: Task 'task_200803051430_0001_m_000000_1' has completed tip_200803051430_0001_m_000000 successfully.

But the syslog of the task has :
2008-03-05 14:30:43,174 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMapRed.waitOutputThreads(): subprocess failed with code 1 in org.apache.hadoop.streaming.PipeMapRed

We could not know whether the job was successful or not, until we validate the output and found that there is no output.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-2941) Streaming map task is not failed when the subprocess exited abnormally.

Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sriramadasu resolved HADOOP-2941.
---------------------------------------------

    Resolution: Duplicate

This issue is a duplicate of HADOOP-2057

> Streaming map task is not failed when the subprocess exited abnormally.
> -----------------------------------------------------------------------
>
>                 Key: HADOOP-2941
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2941
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Amareshwari Sriramadasu
>             Fix For: 0.17.0
>
>
> The launched streaming process exited with a non-zero exit code. But the task was succesful. thereby, job was succesful.
> Job tracker logs show: 
> 08/03/05 14:30:43 INFO mapred.TaskTracker: Task task_200803051430_0001_m_000000_1 is done.
> 08/03/05 14:30:43 INFO mapred.TaskRunner: Saved output of task 'task_200803051430_0001_m_000000_1' to hdfs://localhost:46796/testing/out
> 08/03/05 14:30:43 INFO mapred.JobInProgress: Task 'task_200803051430_0001_m_000000_1' has completed tip_200803051430_0001_m_000000 successfully.
> But the syslog of the task has :
> 2008-03-05 14:30:43,174 INFO org.apache.hadoop.streaming.PipeMapRed: PipeMapRed.waitOutputThreads(): subprocess failed with code 1 in org.apache.hadoop.streaming.PipeMapRed
> We could not know whether the job was successful or not, until we validate the output and found that there is no output.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.