You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@oodt.apache.org by "Gabe Resneck (JIRA)" <ji...@apache.org> on 2011/07/21 03:13:58 UTC

[jira] [Created] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Make the Resource Manager manage different queues of jobs independently
-----------------------------------------------------------------------

                 Key: OODT-305
                 URL: https://issues.apache.org/jira/browse/OODT-305
             Project: OODT
          Issue Type: New Feature
          Components: resource manager
            Reporter: Gabe Resneck


Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Chris A. Mattmann (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris A. Mattmann updated OODT-305:
-----------------------------------

    Fix Version/s:     (was: 0.4)
                   0.5

- push to 0.5
                
> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>             Fix For: 0.5
>
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Gabe Resneck (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102811#comment-13102811 ] 

Gabe Resneck commented on OODT-305:
-----------------------------------

I don't think that this patch could be applied as is.  For one thing, the FifoMappedJobQueue hasn't been added (at all) to the repo.  The only thing holding me up is the time to write a patch appropriate for our repo.

> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>             Fix For: 0.4
>
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103380#comment-13103380 ] 

Chris A. Mattmann commented on OODT-305:
----------------------------------------

Got it. So once we get FifoMappedQueue, we're good on this one?

> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>             Fix For: 0.4
>
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Gabe Resneck (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gabe Resneck updated OODT-305:
------------------------------

    Attachment: OODT-305.08-19-11.gabe.txt

This patch is created from the changes that I committed to an internal branch of the Resource Manager that we maintain here at JPL.  It is intended merely to demonstrate the nature and method for implementing the changes listed in this issue.  It is not for committing.  I will post another patch (containing whatever changes are needed to better suit the code to the Apache repo) for review some time soon.

> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Gabe Resneck (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104624#comment-13104624 ] 

Gabe Resneck commented on OODT-305:
-----------------------------------

I think so.

> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>             Fix For: 0.4
>
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Gabe Resneck (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gabe Resneck reassigned OODT-305:
---------------------------------

    Assignee: Gabe Resneck

> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101689#comment-13101689 ] 

Chris A. Mattmann commented on OODT-305:
----------------------------------------

Gabe, this patch, from a quick review, looks good. Anything in particular you are waiting on before committing it?

> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>             Fix For: 0.4
>
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Chris A. Mattmann (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris A. Mattmann updated OODT-305:
-----------------------------------

    Fix Version/s: 0.4

- schedule

> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>             Fix For: 0.4
>
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (OODT-305) Make the Resource Manager manage different queues of jobs independently

Posted by "Chris A. Mattmann (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris A. Mattmann updated OODT-305:
-----------------------------------


- push out to 0.5
                
> Make the Resource Manager manage different queues of jobs independently
> -----------------------------------------------------------------------
>
>                 Key: OODT-305
>                 URL: https://issues.apache.org/jira/browse/OODT-305
>             Project: OODT
>          Issue Type: New Feature
>          Components: resource manager
>            Reporter: Gabe Resneck
>            Assignee: Gabe Resneck
>             Fix For: 0.5
>
>         Attachments: OODT-305.08-19-11.gabe.txt
>
>
> Currently, the Resource Manager lumps all jobs together, regardless of the queue to which they belong.  This can cause bottlenecks that greatly reduce the efficiency of the RM when set up in certain configurations.  In order to address this issue, the RM needs some way in which to separate jobs in different queues and schedule them independently of each other.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira