You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Jonathan Eagles (JIRA)" <ji...@apache.org> on 2011/06/06 20:55:59 UTC

[jira] [Created] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
------------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-2569
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2
            Reporter: Jonathan Eagles
            Assignee: Jonathan Eagles
            Priority: Minor




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Eagles updated MAPREDUCE-2569:
---------------------------------------

    Status: Patch Available  (was: Open)

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048913#comment-13048913 ] 

Jonathan Eagles commented on MAPREDUCE-2569:
--------------------------------------------

Thanks, Arun.

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048737#comment-13048737 ] 

Arun C Murthy commented on MAPREDUCE-2569:
------------------------------------------

+1, looks good.

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated MAPREDUCE-2569:
-------------------------------------

    Status: Open  (was: Patch Available)

Jonathan, I'd just move the check to ParentQueue.ParentQueue or ParentQueue.setupQueueConfigs rather than do it CapacitySchedulerConfiguration.

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046033#comment-13046033 ] 

Robert Joseph Evans commented on MAPREDUCE-2569:
------------------------------------------------

Looks good to me.

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Eagles updated MAPREDUCE-2569:
---------------------------------------

    Attachment: MAPREDUCE-2569-MR-279-v1.patch

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Eagles updated MAPREDUCE-2569:
---------------------------------------

    Status: Patch Available  (was: Open)

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahadev konar updated MAPREDUCE-2569:
-------------------------------------

    Fix Version/s: 0.23.0

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Douglas updated MAPREDUCE-2569:
-------------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

I committed this. Thanks, Jon!

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13047819#comment-13047819 ] 

Jonathan Eagles commented on MAPREDUCE-2569:
--------------------------------------------

v2 of the patch incorporates Arun's comments

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046031#comment-13046031 ] 

Hadoop QA commented on MAPREDUCE-2569:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12481825/MAPREDUCE-2569-MR-279-v1.patch
  against trunk revision 1133226.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/362//console

This message is automatically generated.

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13047497#comment-13047497 ] 

Hadoop QA commented on MAPREDUCE-2569:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12482105/MAPREDUCE-2569-MR-279-v2.patch
  against trunk revision 1134180.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/374//console

This message is automatically generated.

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13046594#comment-13046594 ] 

Jonathan Eagles commented on MAPREDUCE-2569:
--------------------------------------------

Currenty, capacity at every level except the root level in the hierarchical queues is required to sum to 100% and throw IllegalArgumentException otherwise. This patch further extends this to required capacity at the root level to also be 100%, throwing IllegalArgumentException otherwise.

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Eagles updated MAPREDUCE-2569:
---------------------------------------

    Description: root.capacity is set to 90% without failure

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-2569) MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error

Posted by "Jonathan Eagles (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Eagles updated MAPREDUCE-2569:
---------------------------------------

    Attachment: MAPREDUCE-2569-MR-279-v2.patch

> MR-279: Restarting resource manager with root capacity not equal to 100 percent should result in error
> ------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2569
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2569
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>            Reporter: Jonathan Eagles
>            Assignee: Jonathan Eagles
>            Priority: Minor
>         Attachments: MAPREDUCE-2569-MR-279-v1.patch, MAPREDUCE-2569-MR-279-v2.patch
>
>
> root.capacity is set to 90% without failure

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira