You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2007/06/13 19:14:25 UTC

[jira] Created: (HADOOP-1488) Remove all use of auto-progress threads in map/reduce

Remove all use of auto-progress threads in map/reduce
-----------------------------------------------------

                 Key: HADOOP-1488
                 URL: https://issues.apache.org/jira/browse/HADOOP-1488
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
            Reporter: Owen O'Malley


During the last rework of the shuffle, a lot of the stages of the shuffle had auto-progress threads added, leading to system lockups when the shuffle stalls. We need to add Progressables to the sort and fetching interfaces so that if any task gets stuck, it will eventually be killed by the framework.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-1488) Remove all use of auto-progress threads in map/reduce

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved HADOOP-1488.
-----------------------------------

    Resolution: Duplicate

> Remove all use of auto-progress threads in map/reduce
> -----------------------------------------------------
>
>                 Key: HADOOP-1488
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1488
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Owen O'Malley
>
> During the last rework of the shuffle, a lot of the stages of the shuffle had auto-progress threads added, leading to system lockups when the shuffle stalls. We need to add Progressables to the sort and fetching interfaces so that if any task gets stuck, it will eventually be killed by the framework.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1488) Remove all use of auto-progress threads in map/reduce

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12504359 ] 

Devaraj Das commented on HADOOP-1488:
-------------------------------------

I think the patch for HADOOP-1462 addresses this concern.

> Remove all use of auto-progress threads in map/reduce
> -----------------------------------------------------
>
>                 Key: HADOOP-1488
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1488
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Owen O'Malley
>
> During the last rework of the shuffle, a lot of the stages of the shuffle had auto-progress threads added, leading to system lockups when the shuffle stalls. We need to add Progressables to the sort and fetching interfaces so that if any task gets stuck, it will eventually be killed by the framework.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.