You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Vivek Ratan (JIRA)" <ji...@apache.org> on 2008/05/26 13:33:57 UTC
[jira] Created: (HADOOP-3444) Implementing a Resource Manager (V1)
for Hadoop
Implementing a Resource Manager (V1) for Hadoop
-----------------------------------------------
Key: HADOOP-3444
URL: https://issues.apache.org/jira/browse/HADOOP-3444
Project: Hadoop Core
Issue Type: New Feature
Reporter: Vivek Ratan
HADOOP-3421 lists the requirements for a Resource Manager for Hadoop. This Jira tracks its implementation.
It is expected that this Jira will be used to keep track of various other Jiras that will be opened towards implementing Version 1 of the Resource Manager.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3444) Implementing a Resource Manager
(V1) for Hadoop
Posted by "Vivek Ratan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12599867#action_12599867 ]
Vivek Ratan commented on HADOOP-3444:
-------------------------------------
HADOOP-3445 tracks the implementation of the core scheduling component.
> Implementing a Resource Manager (V1) for Hadoop
> -----------------------------------------------
>
> Key: HADOOP-3444
> URL: https://issues.apache.org/jira/browse/HADOOP-3444
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Vivek Ratan
> Attachments: RMArch-V1.jpg
>
>
> HADOOP-3421 lists the requirements for a Resource Manager for Hadoop. This Jira tracks its implementation.
> It is expected that this Jira will be used to keep track of various other Jiras that will be opened towards implementing Version 1 of the Resource Manager.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3444) Implementing a Resource Manager (V1)
for Hadoop
Posted by "Vivek Ratan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vivek Ratan updated HADOOP-3444:
--------------------------------
Attachment: RMArch-V1.jpg
RMArch-V1.jpg is a high level architecture.
It is proposed that today's JT be extended to support queues of jobs (actually, JobInProgress objects). The JobQueueManager handles these queues, which are persisted to disk. Users can interact with the queues, which are configured appropriately.
The JT today handles at least three separate functionalities: scheduling, monitoring, and Web serving. It is likely that in the future, these three are separated out, at least in terms of components/modules/classes within JT, if not outside it.
> Implementing a Resource Manager (V1) for Hadoop
> -----------------------------------------------
>
> Key: HADOOP-3444
> URL: https://issues.apache.org/jira/browse/HADOOP-3444
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Vivek Ratan
> Attachments: RMArch-V1.jpg
>
>
> HADOOP-3421 lists the requirements for a Resource Manager for Hadoop. This Jira tracks its implementation.
> It is expected that this Jira will be used to keep track of various other Jiras that will be opened towards implementing Version 1 of the Resource Manager.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3444) Implementing a Resource Manager
(V1) for Hadoop
Posted by "Vivek Ratan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12599821#action_12599821 ]
Vivek Ratan commented on HADOOP-3444:
-------------------------------------
My guess is, we'll need separate Jiras to track at least the following:
* the core scheduling component (the part of the new JT that includes the JobQueueManager and handles scheduling, guaranteed capacities for Orgs, user limits, etc.).
* configuration for Orgs, queues, users,quotas, limits, etc.
* Security, access control
* scalability/availability
* user interaction with the job queues (through Web, CLI)
* accounting
others?
> Implementing a Resource Manager (V1) for Hadoop
> -----------------------------------------------
>
> Key: HADOOP-3444
> URL: https://issues.apache.org/jira/browse/HADOOP-3444
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Vivek Ratan
> Attachments: RMArch-V1.jpg
>
>
> HADOOP-3421 lists the requirements for a Resource Manager for Hadoop. This Jira tracks its implementation.
> It is expected that this Jira will be used to keep track of various other Jiras that will be opened towards implementing Version 1 of the Resource Manager.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.