You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Bochun Bai (JIRA)" <ji...@apache.org> on 2010/12/24 08:52:46 UTC

[jira] Created: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Blacklisted TT reset time should be configurable
------------------------------------------------

                 Key: MAPREDUCE-2231
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: jobtracker
            Reporter: Bochun Bai


A TaskTracker in the blacklist will be reset to healthy state after a day.
"after a day" should be configurable.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bochun Bai updated MAPREDUCE-2231:
----------------------------------

    Attachment: MAPREDUCE-2231-v1.patch

> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bochun Bai updated MAPREDUCE-2231:
----------------------------------

    Attachment: MAPREDUCE-2231-v3.patch

> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch, MAPREDUCE-2231-v2.patch, MAPREDUCE-2231-v3.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bochun Bai updated MAPREDUCE-2231:
----------------------------------

    Release Note: Adds mapreduce.jobtracker.update.faulty.tracker.interval, which means how long a blacklisted tasktracker should back to normal.
          Status: Patch Available  (was: Open)

> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch, MAPREDUCE-2231-v2.patch, MAPREDUCE-2231-v3.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bochun Bai updated MAPREDUCE-2231:
----------------------------------

    Attachment: MAPREDUCE-2231-v2.patch

> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch, MAPREDUCE-2231-v2.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Greg Roelofs (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12977450#action_12977450 ] 

Greg Roelofs commented on MAPREDUCE-2231:
-----------------------------------------

Note that heuristic blacklisting doesn't work very well in the first place.  See MAPREDUCE-1966 for more info.

> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch, MAPREDUCE-2231-v2.patch, MAPREDUCE-2231-v3.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12999838#comment-12999838 ] 

Hadoop QA commented on MAPREDUCE-2231:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12466945/MAPREDUCE-2231-v3.patch
  against trunk revision 1074251.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    -1 contrib tests.  The patch failed contrib unit tests.

    +1 system test framework.  The patch passed system test framework compile.

Test results: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/42//testReport/
Findbugs warnings: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/42//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://hudson.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/42//console

This message is automatically generated.

> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch, MAPREDUCE-2231-v2.patch, MAPREDUCE-2231-v3.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-2231:
-------------------------------------

    Status: Open  (was: Patch Available)

Sorry to come in late, the patch has gone stale. Can you please rebase? Thanks.

Given this is not an issue with MRv2 should we still commit this? I'm happy to, but not sure it's useful. Thanks.

> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch, MAPREDUCE-2231-v2.patch, MAPREDUCE-2231-v3.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (MAPREDUCE-2231) Blacklisted TT reset time should be configurable

Posted by "Bochun Bai (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12975408#action_12975408 ] 

Bochun Bai commented on MAPREDUCE-2231:
---------------------------------------

test-patch.sh passed locally.
Will someone fire a hudson build please?

+1 overall.  

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 system test framework.  The patch passed system test framework compile.




> Blacklisted TT reset time should be configurable
> ------------------------------------------------
>
>                 Key: MAPREDUCE-2231
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2231
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: jobtracker
>            Reporter: Bochun Bai
>         Attachments: MAPREDUCE-2231-v1.patch, MAPREDUCE-2231-v2.patch, MAPREDUCE-2231-v3.patch
>
>
> A TaskTracker in the blacklist will be reset to healthy state after a day.
> "after a day" should be configurable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.