You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Harsh J (JIRA)" <ji...@apache.org> on 2012/06/17 09:07:42 UTC

[jira] [Created] (MAPREDUCE-4345) ZK-based High Availability (HA) for ResourceManager (RM)

Harsh J created MAPREDUCE-4345:
----------------------------------

             Summary: ZK-based High Availability (HA) for ResourceManager (RM)
                 Key: MAPREDUCE-4345
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4345
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Harsh J


One of the goals presented on MAPREDUCE-279 was to have high availability. One way that was discussed, per Mahadev/others on https://issues.apache.org/jira/browse/MAPREDUCE-2648 and other places, was ZK:

{quote}
Am not sure, if you already know about the MR-279 branch (the next version of MR framework). We've been trying to integrate ZK into the framework from the beginning. As for now, we are just doing restart with ZK but soon we should have a HA soln with ZK.
{quote}

There is now MAPREDUCE-4343 that tracks recoverability via ZK. This JIRA is meant to track HA via ZK.

Currently there isn't a HA solution for RM, via ZK or otherwise.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4345) ZK-based High Availability (HA) for ResourceManager (RM)

Posted by "Bikas Saha (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bikas Saha updated MAPREDUCE-4345:
----------------------------------

    Assignee: Bikas Saha

Assigning to myself since this looks like something that follows directly after MAPREDUCE-4326 and design/implementation would be closely related with it.
                
> ZK-based High Availability (HA) for ResourceManager (RM)
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-4345
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4345
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Harsh J
>            Assignee: Bikas Saha
>
> One of the goals presented on MAPREDUCE-279 was to have high availability. One way that was discussed, per Mahadev/others on https://issues.apache.org/jira/browse/MAPREDUCE-2648 and other places, was ZK:
> {quote}
> Am not sure, if you already know about the MR-279 branch (the next version of MR framework). We've been trying to integrate ZK into the framework from the beginning. As for now, we are just doing restart with ZK but soon we should have a HA soln with ZK.
> {quote}
> There is now MAPREDUCE-4343 that tracks recoverability via ZK. This JIRA is meant to track HA via ZK.
> Currently there isn't a HA solution for RM, via ZK or otherwise.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (MAPREDUCE-4345) ZK-based High Availability (HA) for ResourceManager (RM)

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy resolved MAPREDUCE-4345.
--------------------------------------

    Resolution: Duplicate

Duplicate of MAPREDUCE-4326.
                
> ZK-based High Availability (HA) for ResourceManager (RM)
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-4345
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4345
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Harsh J
>            Assignee: Bikas Saha
>
> One of the goals presented on MAPREDUCE-279 was to have high availability. One way that was discussed, per Mahadev/others on https://issues.apache.org/jira/browse/MAPREDUCE-2648 and other places, was ZK:
> {quote}
> Am not sure, if you already know about the MR-279 branch (the next version of MR framework). We've been trying to integrate ZK into the framework from the beginning. As for now, we are just doing restart with ZK but soon we should have a HA soln with ZK.
> {quote}
> There is now MAPREDUCE-4343 that tracks recoverability via ZK. This JIRA is meant to track HA via ZK.
> Currently there isn't a HA solution for RM, via ZK or otherwise.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Reopened] (MAPREDUCE-4345) ZK-based High Availability (HA) for ResourceManager (RM)

Posted by "Harsh J (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J reopened MAPREDUCE-4345:
--------------------------------


Thanks Bikas! Agree it is related to resurrecting RM restart.

Arun - It isn't a duplicate, at least the way I see it the MAPREDUCE-4326 targets a restart-recovery while this one I'd opened to target proper HA (multiple RMs, failing over automatically, with client code covered too). It is what may come after restart-ability is achieved. Thanks, I've reopened it :)
                
> ZK-based High Availability (HA) for ResourceManager (RM)
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-4345
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4345
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Harsh J
>            Assignee: Bikas Saha
>
> One of the goals presented on MAPREDUCE-279 was to have high availability. One way that was discussed, per Mahadev/others on https://issues.apache.org/jira/browse/MAPREDUCE-2648 and other places, was ZK:
> {quote}
> Am not sure, if you already know about the MR-279 branch (the next version of MR framework). We've been trying to integrate ZK into the framework from the beginning. As for now, we are just doing restart with ZK but soon we should have a HA soln with ZK.
> {quote}
> There is now MAPREDUCE-4343 that tracks recoverability via ZK. This JIRA is meant to track HA via ZK.
> Currently there isn't a HA solution for RM, via ZK or otherwise.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira